ChatGPT Versus Consultants: Blinded Evaluation on Answering Otorhinolaryngology Case-Based Questions.

Christoph Raphael Buhr Harry Smith Tilman Huppertz Katharina Bahr Christoph Matthias Andrew Blaikie Thomas W Kelsey Sebastian Kuhn Jonas Eckrich

Published in: JMIR medical education (2023)

While ChatGPT provided longer answers to medical problems, medical adequacy and conciseness were significantly lower compared to ORL consultants' answers. LLMs have potential as augmentative tools for medical care, but their "consultation" for medical problems carries a high risk of misinformation as their high semantic quality may mask contextual deficits.

Keyphrases

healthcare
mental health
traumatic brain injury
palliative care
social media
randomized controlled trial
climate change