(0608) Assessing ChatGPT Responses to Common Patient Questions Regarding Tonsillectomies

Introduction: ChatGPT is an artificial intelligence (AI) platform developed by OpenAI that interacts with users conversationally via prompts input through a web-based chatbot or mobile application. It has rapidly gained popularity due to its accessibility and versatility. Recent studies have evaluated its implementation in the medical field for patient education. However, little is known on how effective ChatGPT answers frequently asked patient questions on common head and neck-related procedures. This study aimed to investigate whether ChatGPT could appropriately answer frequently asked questions related to tonsillectomies.

Methods: A total of 10 frequently asked patient questions on tonsillectomy were gathered from 10 well-known healthcare institution webpages. The questions were input into ChatGPT, and the responses were analyzed for accuracy, clarity, and appropriateness using an evidence-based approach. They were categorized as: " Excellent requiring no clarification,” "Satisfactory necessitating minimal clarification," "Satisfactory necessitating moderate clarification," or "Unsatisfactory requiring substantial clarification.”

Results: Of the responses provided by ChatGPT, 2 received a rating of "Excellent requiring no clarification,” 3 were categorized as "Satisfactory necessitating minimal clarification," and 5 were "Satisfactory necessitating moderate clarification." Additionally, the responses appropriately emphasized consulting a healthcare specialist.

Conclusions: ChatGPT has the potential to be an effective supplementary tool for patient education on common head and neck-related procedures. However, the majority of responses required at least minimal clarification. Thus, primary patient education should occur through consultation with a healthcare provider.