Login / Signup

Physical deep learning with biologically inspired training method: gradient-free approach for physical hardware.

Mitsumasa NakajimaKatsuma InoueKenji TanakaYasuo KuniyoshiToshikazu HashimotoKohei Nakajima
Published in: Nature communications (2022)
Ever-growing demand for artificial intelligence has motivated research on unconventional computation based on physical devices. While such computation devices mimic brain-inspired analog information processing, the learning procedures still rely on methods optimized for digital processing such as backpropagation, which is not suitable for physical implementation. Here, we present physical deep learning by extending a biologically inspired training algorithm called direct feedback alignment. Unlike the original algorithm, the proposed method is based on random projection with alternative nonlinear activation. Thus, we can train a physical neural network without knowledge about the physical system and its gradient. In addition, we can emulate the computation for this training on scalable physical hardware. We demonstrate the proof-of-concept using an optoelectronic recurrent neural network called deep reservoir computer. We confirmed the potential for accelerated computation with competitive performance on benchmarks. Our results provide practical solutions for the training and acceleration of neuromorphic computation.
Keyphrases
  • deep learning
  • neural network
  • physical activity
  • artificial intelligence
  • mental health
  • machine learning
  • convolutional neural network
  • multiple sclerosis
  • risk assessment
  • white matter
  • brain injury