Clinically applicable deep learning for diagnosis and referral in retinal disease.
Jeffrey De FauwJoseph R LedsamBernardino Romera-ParedesStanislav NikolovNenad TomasevSam BlackwellHarry AskhamXavier GlorotBrendan O'DonoghueDaniel VisentinGeorge van den DriesscheBalaji LakshminarayananClemens MeyerFaith MackinderSimon BoutonKareem AyoubReena ChopraDominic KingAlan KarthikesalingamCían Owen HughesRosalind RaineJulian HughesDawn A SimCatherine EganAdnan TufailHugh E MontgomeryDemis HassabisGeraint ReesTrevor BackPeng T KhawMustafa SuleymanJulien CornebisePearse Andrew KeaneOlaf RonnebergerPublished in: Nature medicine (2018)
The volume and complexity of diagnostic imaging is increasing at a pace faster than the availability of human expertise to interpret it. Artificial intelligence has shown great promise in classifying two-dimensional photographs of some common diseases and typically relies on databases of millions of annotated images. Until now, the challenge of reaching the performance of expert clinicians in a real-world clinical pathway with three-dimensional diagnostic scans has remained unsolved. Here, we apply a novel deep learning architecture to a clinically heterogeneous set of three-dimensional optical coherence tomography scans from patients referred to a major eye hospital. We demonstrate performance in making a referral recommendation that reaches or exceeds that of experts on a range of sight-threatening retinal diseases after training on only 14,884 scans. Moreover, we demonstrate that the tissue segmentations produced by our architecture act as a device-independent representation; referral accuracy is maintained when using tissue segmentations from a different type of device. Our work removes previous barriers to wider clinical use without prohibitive training data requirements across multiple pathologies in a real-world setting.
Keyphrases
- deep learning
- artificial intelligence
- big data
- optical coherence tomography
- convolutional neural network
- computed tomography
- diabetic retinopathy
- machine learning
- primary care
- end stage renal disease
- newly diagnosed
- chronic kidney disease
- ejection fraction
- healthcare
- contrast enhanced
- palliative care
- prognostic factors
- peritoneal dialysis
- virtual reality
- high resolution
- photodynamic therapy
- electronic health record
- magnetic resonance
- adverse drug