Spectral imaging enables contrast agent-free real-time ischemia monitoring in laparoscopic surgery.
Leonardo AyalaTim Julian AdlerSilvia SeidlitzSebastian WirkertChristina EngelsAlexander SeitelJan SellnerAlexey AksenovMatthias BodenbachPia BaderSebastian BaronAnant VemuriManuel WiesenfarthNicholas SchreckDiana Mindroc-FilimonMinu TizabiSebastian PirmannBrittaney EverittDominik T SchneiderDogu TeberLena Maier-HeinPublished in: Science advances (2023)
Laparoscopic surgery has evolved as a key technique for cancer diagnosis and therapy. While characterization of the tissue perfusion is crucial in various procedures, such as partial nephrectomy, doing so by means of visual inspection remains highly challenging. We developed a laparoscopic real-time multispectral imaging system featuring a compact and lightweight multispectral camera and the possibility to complement the conventional surgical view of the patient with functional information at a video rate of 25 Hz. To enable contrast agent-free ischemia monitoring during laparoscopic partial nephrectomy, we phrase the problem of ischemia detection as an out-of-distribution detection problem that does not rely on data from any other patient and uses an ensemble of invertible neural networks at its core. An in-human trial demonstrates the feasibility of our approach and highlights the potential of spectral imaging combined with advanced deep learning-based analysis tools for fast, efficient, reliable, and safe functional laparoscopic imaging.
Keyphrases
- laparoscopic surgery
- high resolution
- neural network
- deep learning
- fluorescence imaging
- magnetic resonance
- endothelial cells
- optical coherence tomography
- case report
- randomized controlled trial
- squamous cell carcinoma
- contrast enhanced
- stem cells
- clinical trial
- study protocol
- computed tomography
- risk assessment
- young adults
- mesenchymal stem cells
- electronic health record
- big data
- climate change
- induced pluripotent stem cells
- label free
- quantum dots
- double blind