Single-shot self-supervised object detection in microscopy.
Benjamin MidtvedtJesús PinedaFredrik SkärbergErik OlsénHarshith BachimanchiEmelie WesénElin K EsbjörnerErik SelanderFredrik HöökDaniel MidtvedtGiovanni VolpePublished in: Nature communications (2022)
Object detection is a fundamental task in digital microscopy, where machine learning has made great strides in overcoming the limitations of classical approaches. The training of state-of-the-art machine-learning methods almost universally relies on vast amounts of labeled experimental data or the ability to numerically simulate realistic datasets. However, experimental data are often challenging to label and cannot be easily reproduced numerically. Here, we propose a deep-learning method, named LodeSTAR (Localization and detection from Symmetries, Translations And Rotations), that learns to detect microscopic objects with sub-pixel accuracy from a single unlabeled experimental image by exploiting the inherent roto-translational symmetries of this task. We demonstrate that LodeSTAR outperforms traditional methods in terms of accuracy, also when analyzing challenging experimental data containing densely packed cells or noisy backgrounds. Furthermore, by exploiting additional symmetries we show that LodeSTAR can measure other properties, e.g., vertical position and polarizability in holographic microscopy.
Keyphrases
- machine learning
- label free
- deep learning
- big data
- single molecule
- electronic health record
- high resolution
- loop mediated isothermal amplification
- artificial intelligence
- high throughput
- high speed
- optical coherence tomography
- working memory
- induced apoptosis
- cell cycle arrest
- computed tomography
- data analysis
- mass spectrometry
- cell death
- rna seq
- pet imaging