Spectral imaging enables contrast agent-free real-time ischemia monitoring in laparoscopic surgery.
Leonardo AyalaTim Julian AdlerSilvia SeidlitzSebastian WirkertChristina EngelsAlexander SeitelJan SellnerAlexey AksenovMatthias BodenbachPia BaderSebastian BaronAnant VemuriManuel WiesenfarthNicholas SchreckDiana Mindroc-FilimonMinu TizabiSebastian PirmannBrittaney EverittDominik T SchneiderDogu TeberLena Maier-HeinPublished in: Science advances (2023)
Laparoscopic surgery has evolved as a key technique for cancer diagnosis and therapy. While characterization of the tissue perfusion is crucial in various procedures, such as partial nephrectomy, doing so by means of visual inspection remains highly challenging. We developed a laparoscopic real-time multispectral imaging system featuring a compact and lightweight multispectral camera and the possibility to complement the conventional surgical view of the patient with functional information at a video rate of 25 Hz. To enable contrast agent-free ischemia monitoring during laparoscopic partial nephrectomy, we phrase the problem of ischemia detection as an out-of-distribution detection problem that does not rely on data from any other patient and uses an ensemble of invertible neural networks at its core. An in-human trial demonstrates the feasibility of our approach and highlights the potential of spectral imaging combined with advanced deep learning-based analysis tools for fast, efficient, reliable, and safe functional laparoscopic imaging.
Keyphrases
- laparoscopic surgery
- high resolution
- deep learning
- fluorescence imaging
- neural network
- robot assisted
- magnetic resonance
- endothelial cells
- clinical trial
- squamous cell carcinoma
- machine learning
- optical coherence tomography
- magnetic resonance imaging
- stem cells
- case report
- randomized controlled trial
- young adults
- electronic health record
- phase iii
- bone marrow
- high speed
- climate change
- human health
- study protocol
- mesenchymal stem cells
- sensitive detection
- smoking cessation