Login / Signup

Backpropagation-free training of deep physical neural networks.

Ali MomeniBabak RahmaniMatthieu MalléjacPhilipp Del HougneRomain Fleury
Published in: Science (New York, N.Y.) (2023)
Recent successes in deep learning for vision and natural language processing are attributed to larger models but come with energy consumption and scalability issues. Current training of digital deep learning models primarily relies on backpropagation that is unsuitable for physical implementation. Here, we proposed a simple deep neural network architecture augmented by a physical local learning (PhyLL) algorithm, enabling supervised and unsupervised training of deep physical neural networks, without detailed knowledge of the nonlinear physical layer's properties. We trained diverse wave-based physical neural networks in vowel and image classification experiments, showcasing our approach's universality. Our method shows advantages over other hardware-aware training schemes by improving training speed, enhancing robustness, and reducing power consumption by eliminating the need for system modelling and thus decreasing digital computation.
Keyphrases
  • neural network
  • deep learning
  • physical activity
  • mental health
  • machine learning
  • virtual reality
  • healthcare
  • primary care
  • convolutional neural network
  • autism spectrum disorder
  • resistance training
  • body composition