Spectral imaging enables contrast agent-free real-time ischemia monitoring in laparoscopic surgery.
Leonardo AyalaTim Julian AdlerSilvia SeidlitzSebastian WirkertChristina EngelsAlexander SeitelJan SellnerAlexey AksenovMatthias BodenbachPia BaderSebastian BaronAnant VemuriManuel WiesenfarthNicholas SchreckDiana Mindroc-FilimonMinu TizabiSebastian PirmannBrittaney EverittDominik T SchneiderDogu TeberLena Maier-HeinPublished in: Science advances (2023)
Laparoscopic surgery has evolved as a key technique for cancer diagnosis and therapy. While characterization of the tissue perfusion is crucial in various procedures, such as partial nephrectomy, doing so by means of visual inspection remains highly challenging. We developed a laparoscopic real-time multispectral imaging system featuring a compact and lightweight multispectral camera and the possibility to complement the conventional surgical view of the patient with functional information at a video rate of 25 Hz. To enable contrast agent-free ischemia monitoring during laparoscopic partial nephrectomy, we phrase the problem of ischemia detection as an out-of-distribution detection problem that does not rely on data from any other patient and uses an ensemble of invertible neural networks at its core. An in-human trial demonstrates the feasibility of our approach and highlights the potential of spectral imaging combined with advanced deep learning-based analysis tools for fast, efficient, reliable, and safe functional laparoscopic imaging.
Keyphrases
- laparoscopic surgery
- high resolution
- neural network
- deep learning
- fluorescence imaging
- robot assisted
- optical coherence tomography
- endothelial cells
- clinical trial
- case report
- healthcare
- contrast enhanced
- machine learning
- magnetic resonance imaging
- risk assessment
- photodynamic therapy
- health information
- label free
- climate change
- human health
- mesenchymal stem cells
- social media
- young adults
- computed tomography
- phase ii
- replacement therapy
- quantum dots
- sensitive detection
- induced pluripotent stem cells
- smoking cessation
- squamous cell