SOUP-GAN: Super-Resolution MRI Using Generative Adversarial Networks.
Kuan ZhangHaoji HuKenneth PhilbrickGian Marco ConteJoseph D SobekPouria RouzrokhBradley J EricksonPublished in: Tomography (Ann Arbor, Mich.) (2022)
There is a growing demand for high-resolution (HR) medical images for both clinical and research applications. Image quality is inevitably traded off with acquisition time, which in turn impacts patient comfort, examination costs, dose, and motion-induced artifacts. For many image-based tasks, increasing the apparent spatial resolution in the perpendicular plane to produce multi-planar reformats or 3D images is commonly used. Single-image super-resolution (SR) is a promising technique to provide HR images based on deep learning to increase the resolution of a 2D image, but there are few reports on 3D SR. Further, perceptual loss is proposed in the literature to better capture the textural details and edges versus pixel-wise loss functions, by comparing the semantic distances in the high-dimensional feature space of a pre-trained 2D network (e.g., VGG). However, it is not clear how one should generalize it to 3D medical images, and the attendant implications are unclear. In this paper, we propose a framework called SOUP-GAN: S uper-resolution O ptimized U sing P erceptual-tuned G enerative A dversarial N etwork (GAN), in order to produce thinner slices (e.g., higher resolution in the 'Z' plane) with anti-aliasing and deblurring. The proposed method outperforms other conventional resolution-enhancement methods and previous SR work on medical images based on both qualitative and quantitative comparisons. Moreover, we examine the model in terms of its generalization for arbitrarily user-selected SR ratios and imaging modalities. Our model shows promise as a novel 3D SR interpolation technique, providing potential applications for both clinical and research applications.
Keyphrases
- deep learning
- convolutional neural network
- high resolution
- artificial intelligence
- image quality
- single molecule
- healthcare
- machine learning
- systematic review
- big data
- magnetic resonance imaging
- mass spectrometry
- working memory
- computed tomography
- emergency department
- diffusion weighted imaging
- case report
- optical coherence tomography
- diabetic rats
- fluorescence imaging
- risk assessment
- high speed
- oxidative stress
- photodynamic therapy
- living cells
- high glucose
- contrast enhanced
- tandem mass spectrometry
- human health
- liquid chromatography
- electronic health record