Login / Signup

Fast and accurate annotation of acoustic signals with deep neural networks.

Elsa SteinfathAdrian Palacios-MuñozJulian R RottschäferDeniz YuezakJan Clemens
Published in: eLife (2021)
We here introduce DeepAudioSegmenter (DAS), a method that annotates acoustic signals across species based on a deep-learning derived hierarchical presentation of sound. We demonstrate the accuracy, robustness, and speed of DAS using acoustic signals with diverse characteristics from insects, birds, and mammals. DAS comes with a graphical user interface for annotating song, training the network, and for generating and proofreading annotations. The method can be trained to annotate signals from new species with little manual annotation and can be combined with unsupervised methods to discover novel signal types. DAS annotates song with high throughput and low latency for experimental interventions in realtime. Overall, DAS is a universal, versatile, and accessible tool for annotating acoustic communication signals.
Keyphrases
  • disease activity
  • high throughput
  • deep learning
  • rheumatoid arthritis
  • neural network
  • machine learning
  • physical activity
  • high resolution
  • artificial intelligence