Evaluating ChatGPT-4's Diagnostic Accuracy: Impact of Visual Data Integration.
Takanobu HirosawaYukinori HaradaKazuki TokumasuTakahiro ItoTomoharu SuzukiTaro ShimizuPublished in: JMIR medical informatics (2024)
Our findings reveal that currently, ChatGPT-4V predominantly relies on textual data, limiting its ability to fully use the diagnostic potential of visual information. This study underscores the need for further development of multimodal generative AI systems to effectively integrate and use clinical image data. Enhancing the diagnostic performance of such AI systems through improved multimodal data integration could significantly benefit patient care by providing more accurate and comprehensive diagnostic insights. Future research should focus on overcoming these limitations, paving the way for the practical application of advanced AI in medicine.