New Artificial Intelligence ChatGPT Performs Poorly on the 2022 Self-assessment Study Program for Urology.

Linda My HuynhBenjamin T BonebrakeKaitlyn SchultisAlan QuachChristopher M Deibert

Published in: Urology practice (2023)

ChatGPT previously demonstrated promise on medical licensing exams; however, application to the 2022 Self-assessment Study Program was not demonstrated. Performance improved with multiple-choice over open-ended questions. More importantly were the persistent justifications for incorrect responses-left unchecked, utilization of ChatGPT in medicine may facilitate medical misinformation.

Keyphrases

artificial intelligence
big data
machine learning
healthcare
deep learning
quality improvement
social media