Non-contrast CT synthesis using patch-based cycle-consistent generative adversarial network (Cycle-GAN) for radiomics and deep learning in the era of COVID-19.
Reza KalantarSumeet HindochaBenjamin HunterBhupinder SharmaNasir KhanDow-Mu KohMerina AhmedEric O AboagyeRichard W LeeMatthew D BlackledgePublished in: Scientific reports (2023)
Handcrafted and deep learning (DL) radiomics are popular techniques used to develop computed tomography (CT) imaging-based artificial intelligence models for COVID-19 research. However, contrast heterogeneity from real-world datasets may impair model performance. Contrast-homogenous datasets present a potential solution. We developed a 3D patch-based cycle-consistent generative adversarial network (cycle-GAN) to synthesize non-contrast images from contrast CTs, as a data homogenization tool. We used a multi-centre dataset of 2078 scans from 1,650 patients with COVID-19. Few studies have previously evaluated GAN-generated images with handcrafted radiomics, DL and human assessment tasks. We evaluated the performance of our cycle-GAN with these three approaches. In a modified Turing-test, human experts identified synthetic vs acquired images, with a false positive rate of 67% and Fleiss' Kappa 0.06, attesting to the photorealism of the synthetic images. However, on testing performance of machine learning classifiers with radiomic features, performance decreased with use of synthetic images. Marked percentage difference was noted in feature values between pre- and post-GAN non-contrast images. With DL classification, deterioration in performance was observed with synthetic images. Our results show that whilst GANs can produce images sufficient to pass human assessment, caution is advised before GAN-synthesized images are used in medical imaging applications.
Keyphrases
- deep learning
- artificial intelligence
- contrast enhanced
- convolutional neural network
- machine learning
- computed tomography
- magnetic resonance
- big data
- endothelial cells
- magnetic resonance imaging
- coronavirus disease
- optical coherence tomography
- dual energy
- high resolution
- positron emission tomography
- sars cov
- healthcare
- squamous cell carcinoma
- light emitting
- lymph node metastasis
- inflammatory response
- working memory
- immune response
- data analysis
- network analysis