Spectral imaging enables contrast agent-free real-time ischemia monitoring in laparoscopic surgery.
Leonardo AyalaTim Julian AdlerSilvia SeidlitzSebastian WirkertChristina EngelsAlexander SeitelJan SellnerAlexey AksenovMatthias BodenbachPia BaderSebastian BaronAnant VemuriManuel WiesenfarthNicholas SchreckDiana Mindroc-FilimonMinu TizabiSebastian PirmannBrittaney EverittDominik T SchneiderDogu TeberLena Maier-HeinPublished in: Science advances (2023)
Laparoscopic surgery has evolved as a key technique for cancer diagnosis and therapy. While characterization of the tissue perfusion is crucial in various procedures, such as partial nephrectomy, doing so by means of visual inspection remains highly challenging. We developed a laparoscopic real-time multispectral imaging system featuring a compact and lightweight multispectral camera and the possibility to complement the conventional surgical view of the patient with functional information at a video rate of 25 Hz. To enable contrast agent-free ischemia monitoring during laparoscopic partial nephrectomy, we phrase the problem of ischemia detection as an out-of-distribution detection problem that does not rely on data from any other patient and uses an ensemble of invertible neural networks at its core. An in-human trial demonstrates the feasibility of our approach and highlights the potential of spectral imaging combined with advanced deep learning-based analysis tools for fast, efficient, reliable, and safe functional laparoscopic imaging.
Keyphrases
- laparoscopic surgery
- high resolution
- deep learning
- fluorescence imaging
- neural network
- robot assisted
- magnetic resonance
- endothelial cells
- optical coherence tomography
- magnetic resonance imaging
- convolutional neural network
- clinical trial
- study protocol
- computed tomography
- bone marrow
- mesenchymal stem cells
- mass spectrometry
- photodynamic therapy
- electronic health record
- risk assessment
- social media
- quantum dots
- sensitive detection
- open label
- pluripotent stem cells