Incorporating the image formation process into deep learning improves network performance.
Yue LiYijun SuMin GuoXiaofei HanJiamin LiuHarshad D VishwasraoXuesong LiRyan ChristensenTitas SenguptaMark W MoyleIvan Rey-SuarezJiji ChenArpita UpadhyayaTed B UsdinDaniel Alfonso Colón-RamosHuafeng LiuYicong WuHari ShroffPublished in: Nature methods (2022)
We present Richardson-Lucy network (RLN), a fast and lightweight deep learning method for three-dimensional fluorescence microscopy deconvolution. RLN combines the traditional Richardson-Lucy iteration with a fully convolutional network structure, establishing a connection to the image formation process and thereby improving network performance. Containing only roughly 16,000 parameters, RLN enables four- to 50-fold faster processing than purely data-driven networks with many more parameters. By visual and quantitative analysis, we show that RLN provides better deconvolution, better generalizability and fewer artifacts than other networks, especially along the axial dimension. RLN outperforms classic Richardson-Lucy deconvolution on volumes contaminated with severe out of focus fluorescence or noise and provides four- to sixfold faster reconstructions of large, cleared-tissue datasets than classic multi-view pipelines. We demonstrate RLN's performance on cells, tissues and embryos imaged with widefield-, light-sheet-, confocal- and super-resolution microscopy.
Keyphrases
- deep learning
- single molecule
- optical coherence tomography
- artificial intelligence
- high resolution
- convolutional neural network
- induced apoptosis
- machine learning
- high speed
- heavy metals
- gene expression
- high throughput
- oxidative stress
- air pollution
- magnetic resonance imaging
- label free
- risk assessment
- cell cycle arrest
- drinking water
- rna seq
- pi k akt
- raman spectroscopy