Login / Signup

An Empirical Evaluation of Prompting Strategies for Large Language Models in Zero-Shot Clinical Natural Language Processing: Algorithm Development and Validation Study.

Sonish SivarajkumarMark KelleyAlyssa Samolyk-MazzantiShyam VisweswaranYanshan Wang
Published in: JMIR medical informatics (2024)
This study provides a rigorous evaluation of prompt engineering methodologies and introduces innovative techniques for clinical information extraction, demonstrating the potential of in-context learning in the clinical domain. These findings offer clear guidelines for future prompt-based clinical NLP research, facilitating engagement by non-NLP experts in clinical NLP advancements. To the best of our knowledge, this is one of the first works on the empirical evaluation of different prompt engineering approaches for clinical NLP in this era of generative artificial intelligence, and we hope that it will inspire and inform future research in this area.
Keyphrases
  • artificial intelligence
  • healthcare
  • autism spectrum disorder
  • social media
  • current status
  • climate change
  • human health