Login / Signup

Self-supervised attention-based deep learning for pan-cancer mutation prediction from histopathology.

Oliver Lester SaldanhaChiara M L LoefflerJan Moritz NiehuesMarko van TreeckTobias Paul SeraphinKatherine Jane HewittDidem CifciGregory Patrick VeldhuizenSiddhi RameshAlexander T PearsonJakob Nikolas Kather
Published in: NPJ precision oncology (2023)
The histopathological phenotype of tumors reflects the underlying genetic makeup. Deep learning can predict genetic alterations from pathology slides, but it is unclear how well these predictions generalize to external datasets. We performed a systematic study on Deep-Learning-based prediction of genetic alterations from histology, using two large datasets of multiple tumor types. We show that an analysis pipeline that integrates self-supervised feature extraction and attention-based multiple instance learning achieves a robust predictability and generalizability.
Keyphrases
  • deep learning
  • machine learning
  • artificial intelligence
  • convolutional neural network
  • genome wide
  • working memory
  • copy number
  • papillary thyroid
  • rna seq
  • gene expression
  • young adults