ChatGPT versus NASS clinical guidelines for degenerative spondylolisthesis: a comparative analysis.
Wasil AhmedMichael SaturnoRami RajjoubAkiro H DueyBashar ZaidatTimothy HoangMateo Restrepo MejiaZachary S GallateNancy ShresthaJustin TangIvan ZapolskyJun S KimSamuel K ChoPublished in: European spine journal : official publication of the European Spine Society, the European Spinal Deformity Society, and the European Section of the Cervical Spine Research Society (2024)
This study sheds light on the duality of LLM applications within clinical settings: one of accuracy and utility in some contexts versus inaccuracy and risk in others. ChatGPT was concordant for most clinical questions NASS offered recommendations for. However, for questions NASS did not offer best practices, ChatGPT generated answers that were either too general or inconsistent with the literature, and even fabricated data/citations. Thus, clinicians should exercise extreme caution when attempting to consult ChatGPT for clinical recommendations, taking care to ensure its reliability within the context of recent literature.