A foundation model for clinical-grade computational pathology and rare cancers detection.
Eugene VorontsovAlican BozkurtAdam CassonGeorge ShaikovskiMichal ZelechowskiKristen A SeversonEric ZimmermannJames HallNeil A TenenholtzNicolo FusiEllen YangPhilippe MathieuAlexander van EckDonghun LeeJulian ViretEric RobertYi Kan WangJeremy D KunzMatthew C H LeeJan H BernhardRan A GodrichGerard OakleyEwan MillarMatthew HannaHannah WenJuan A RetameroWilliam A MoyeRazik YousfiChristopher KananDavid S KlimstraBrandon RothrockSiqi LiuThomas J FuchsPublished in: Nature medicine (2024)
The analysis of histopathology images with artificial intelligence aims to enable clinical decision support systems and precision medicine. The success of such applications depends on the ability to model the diverse patterns observed in pathology images. To this end, we present Virchow, the largest foundation model for computational pathology to date. In addition to the evaluation of biomarker prediction and cell identification, we demonstrate that a large foundation model enables pan-cancer detection, achieving 0.95 specimen-level area under the (receiver operating characteristic) curve across nine common and seven rare cancers. Furthermore, we show that with less training data, the pan-cancer detector built on Virchow can achieve similar performance to tissue-specific clinical-grade models in production and outperform them on some rare variants of cancer. Virchow's performance gains highlight the value of a foundation model and open possibilities for many high-impact applications with limited amounts of labeled training data.
Keyphrases
- artificial intelligence
- papillary thyroid
- deep learning
- clinical decision support
- big data
- electronic health record
- machine learning
- gene expression
- stem cells
- magnetic resonance imaging
- squamous cell carcinoma
- magnetic resonance
- optical coherence tomography
- mesenchymal stem cells
- childhood cancer
- dna methylation
- minimally invasive
- young adults
- label free
- pet ct
- contrast enhanced
- monte carlo