Skip to main content
AAO-HNSF 2024 Annual Meeting & OTO EXPO Main banner
Icon Legend
This session is not in your schedule.
This session is in your schedule. Click again to remove it.
Back

Scientific Oral Presentations

Professional and Personal Development

Session: Scientific Oral Presentations - Personal and Professional Development

EMYWAY Workplace-Based Assessments in Postgraduate Otorhinolaryngologic Resident Training: A Nationwide Experience From an Entrustable Professional Activities (EPAs) Program

Monday, September 30, 2024
10:12 AM – 10:18 AM EDT
Location: MBCC, 214-215
Disclosure(s):
Jeng-Wen Chen, MD, MSC:

faculty for this accredited education activity has no relationship(s) with ineligible companies to disclose.

Wei-Chung Hsu, MD, PhD:

faculty for this accredited education activity has no relationship(s) with ineligible companies to disclose.

Pa-Chun Wang, MD, PhD:

faculty for this accredited education activity has no relationship(s) with ineligible companies to disclose.

Introduction: In 2020, the Taiwan Society of Otorhinolaryngology–Head and Neck Surgery (TSO-HNS) created an Entrustable Professional Activities (EPA)-based framework with 11 EPAs tied to milestones to gauge resident otolaryngologists' competency. From 2021, TSO-HNS has utilized the EMYWAY platform for nationwide workplace-based assessments and training accreditation. This study reports on the first two years of usage.

Methods: The EMYWAY system includes a study calendar, case log, EPA-based assessment workflow, coaching feedback, and a dashboard showcasing residents' entrustment-supervision levels. Data are analyzed annually for accreditation and curriculum enhancement.

Results: A total of 412 instructors and 270 trainees from 34 programs engaged with the EMYWAY platform. From August 2022 to July 2023, 9,805 responses were recorded, mainly from surgical theaters (45.9%; 4,502/9,805) and third-year residents (23.8%; 2,331/9,805). The top evaluated EPAs were "head and neck" (17.5%; 1,716/9,805), "sinonasal" (13.5%; 1,324/9,805), and "ear" (12.2%; 1,193/9,805), with task complexity correlating with seniority (P <.0001). A positive correlation existed between trainees' self-assessments and instructors' ratings (r=.531; P<.001). Over 98.2% of trainees and 88.4% of trainers provided substantial feedback (>10 words). Analysis of entrustment-supervision levels by program and EPA identified faculty development targets and teaching-intensive tasks. The quality of reflections and feedback, assessed by natural language processing, showed ongoing improvement.

Conclusions: EMYWAY effectively documents teaching and learning in the workplace, tracking resident competency progression. Continuous enhancement of workplace-based assessments is pivotal for advancing the Competency-Based Medical Education Ecosystem.

    Presenting Author(s)

  • Jeng-Wen Chen, MD, MSC

    Deputy Superintendent
    Cardinal Tien Hospital and Fu Jen Catholic University
    New Taipei City, New Taipei, Taiwan (Republic of China)

    Disclosure(s):

    faculty for this accredited education activity has no relationship(s) with ineligible companies to disclose.

    • Co-Author(s)

  • Wei-Chung Hsu, MD, PhD

    Pr.
    Department of Otolaryngology, National Taiwan University Hospital and Children's Hospital, Taipei, Taiwan
    Taipei, Taipei, Taiwan (Republic of China)

    Disclosure(s):

    faculty for this accredited education activity has no relationship(s) with ineligible companies to disclose.

  • PW

    Pa-Chun Wang, MD, PhD

    Cathay General Hospital, Taipei, Taiwan (Republic of China)

    Disclosure(s):

    faculty for this accredited education activity has no relationship(s) with ineligible companies to disclose.

  • HT

    Hai-Lun Tu, PhD

    Professor
    Fu Jen Catholic University, New Taipei, Taiwan (Republic of China)

    Disclosure information not submitted.