Advanced image generation for cancer using diffusion models.
Benjamin L KidderPublished in: Biology methods & protocols (2024)
Deep neural networks have significantly advanced the field of medical image analysis, yet their full potential is often limited by relatively small dataset sizes. Generative modeling, particularly through diffusion models, has unlocked remarkable capabilities in synthesizing photorealistic images, thereby broadening the scope of their application in medical imaging. This study specifically investigates the use of diffusion models to generate high-quality brain MRI scans, including those depicting low-grade gliomas, as well as contrast-enhanced spectral mammography (CESM) and chest and lung X-ray images. By leveraging the DreamBooth platform, we have successfully trained stable diffusion models utilizing text prompts alongside class and instance images to generate diverse medical images. This approach not only preserves patient anonymity but also substantially mitigates the risk of patient re-identification during data exchange for research purposes. To evaluate the quality of our synthesized images, we used the Fréchet inception distance metric, demonstrating high fidelity between the synthesized and real images. Our application of diffusion models effectively captures oncology-specific attributes across different imaging modalities, establishing a robust framework that integrates artificial intelligence in the generation of oncological medical imagery.
Keyphrases
- deep learning
- contrast enhanced
- artificial intelligence
- convolutional neural network
- optical coherence tomography
- low grade
- magnetic resonance imaging
- healthcare
- computed tomography
- high resolution
- high grade
- diffusion weighted
- machine learning
- big data
- magnetic resonance
- palliative care
- dual energy
- neural network
- case report
- high throughput
- diffusion weighted imaging
- radiation therapy
- prostate cancer
- papillary thyroid
- squamous cell carcinoma
- electronic health record
- resting state
- mass spectrometry
- radical prostatectomy
- white matter
- rectal cancer
- functional connectivity
- smoking cessation
- photodynamic therapy
- lymph node metastasis
- childhood cancer