Login / Signup

Structured information extraction from scientific text with large language models.

John M DagdelenAlexander DunnSanghoon LeeNicholas WalkerAndrew S RosenGerbrand CederKristin Aslaug PerssonEvan Walter Clark Spotte-Smith
Published in: Nature communications (2024)
Extracting structured knowledge from scientific text remains a challenging task for machine learning models. Here, we present a simple approach to joint named entity recognition and relation extraction and demonstrate how pretrained large language models (GPT-3, Llama-2) can be fine-tuned to extract useful records of complex scientific knowledge. We test three representative tasks in materials chemistry: linking dopants and host materials, cataloging metal-organic frameworks, and general composition/phase/morphology/application information extraction. Records are extracted from single sentences or entire paragraphs, and the output can be returned as simple English sentences or a more structured format such as a list of JSON objects. This approach represents a simple, accessible, and highly flexible route to obtaining large databases of structured specialized scientific knowledge extracted from research papers.
Keyphrases
  • healthcare
  • machine learning
  • metal organic framework
  • autism spectrum disorder
  • smoking cessation
  • oxidative stress
  • palliative care
  • air pollution
  • big data
  • working memory
  • cross sectional
  • deep learning