Unsupervised adversarial neural network for enhancing vasculature in photoacoustic tomography images using optical coherence tomography angiography.
Yutian ZhongZhenyang LiuXiaoming ZhangZhaoyong LiangWufan ChenCuixia DaiLi QiPublished in: Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society (2024)
Photoacoustic tomography (PAT) is a powerful imaging modality for visualizing tissue physiology and exogenous contrast agents. However, PAT faces challenges in visualizing deep-seated vascular structures due to light scattering, absorption, and reduced signal intensity with depth. Optical coherence tomography angiography (OCTA) offers high-contrast visualization of vasculature networks, yet its imaging depth is limited to a millimeter scale. Herein, we propose OCPA-Net, a novel unsupervised deep learning method that utilizes the rich vascular feature of OCTA to enhance PAT images. Trained on unpaired OCTA and PAT images, OCPA-Net incorporates a vessel-aware attention module to enhance deep-seated vessel details captured from OCTA. It leverages a domain-adversarial loss function to enforce structural consistency and a novel identity invariant loss to mitigate excessive image content generation. We validate the structural fidelity of OCPA-Net on simulation experiments, and then demonstrate its vascular enhancement performance on in vivo imaging experiments of tumor-bearing mice and contrast-enhanced pregnant mice. The results show the promise of our method for comprehensive vessel-related image analysis in preclinical research applications.
Keyphrases
- deep learning
- contrast enhanced
- high resolution
- machine learning
- optical coherence tomography
- convolutional neural network
- magnetic resonance
- neural network
- magnetic resonance imaging
- artificial intelligence
- fluorescence imaging
- diffusion weighted
- computed tomography
- pregnant women
- big data
- high fat diet induced
- diffusion weighted imaging
- high intensity
- bone marrow
- type diabetes
- insulin resistance
- photodynamic therapy
- working memory
- weight loss
- weight gain
- body composition
- mesenchymal stem cells