Spatial redundancy transformer for self-supervised fluorescence image denoising.
Xinyang LiXiaowan HuXingye ChenJiaqi FanZhifeng ZhaoJiamin WuHaoqian WangQionghai DaiPublished in: Nature computational science (2023)
Fluorescence imaging with high signal-to-noise ratios has become the foundation of accurate visualization and analysis of biological phenomena. However, the inevitable noise poses a formidable challenge to imaging sensitivity. Here we provide the spatial redundancy denoising transformer (SRDTrans) to remove noise from fluorescence images in a self-supervised manner. First, a sampling strategy based on spatial redundancy is proposed to extract adjacent orthogonal training pairs, which eliminates the dependence on high imaging speed. Second, we designed a lightweight spatiotemporal transformer architecture to capture long-range dependencies and high-resolution features at low computational cost. SRDTrans can restore high-frequency information without producing oversmoothed structures and distorted fluorescence traces. Finally, we demonstrate the state-of-the-art denoising performance of SRDTrans on single-molecule localization microscopy and two-photon volumetric calcium imaging. SRDTrans does not contain any assumptions about the imaging process and the sample, thus can be easily extended to various imaging modalities and biological applications.
Keyphrases
- high resolution
- single molecule
- fluorescence imaging
- high frequency
- convolutional neural network
- machine learning
- living cells
- mass spectrometry
- deep learning
- photodynamic therapy
- transcranial magnetic stimulation
- healthcare
- atomic force microscopy
- oxidative stress
- high speed
- energy transfer
- tandem mass spectrometry