Login / Signup

Recall tempo of Hebbian sequences depends on the interplay of Hebbian kernel with tutor signal timing.

Matthew FarrellCengiz Pehlevan
Published in: Proceedings of the National Academy of Sciences of the United States of America (2024)
Understanding how neural circuits generate sequential activity is a longstanding challenge. While foundational theoretical models have shown how sequences can be stored as memories in neural networks with Hebbian plasticity rules, these models considered only a narrow range of Hebbian rules. Here, we introduce a model for arbitrary Hebbian plasticity rules, capturing the diversity of spike-timing-dependent synaptic plasticity seen in experiments, and show how the choice of these rules and of neural activity patterns influences sequence memory formation and retrieval. In particular, we derive a general theory that predicts the tempo of sequence replay. This theory lays a foundation for explaining how cortical tutor signals might give rise to motor actions that eventually become "automatic." Our theory also captures the impact of changing the tempo of the tutor signal. Beyond shedding light on biological circuits, this theory has relevance in artificial intelligence by laying a foundation for frameworks whereby slow and computationally expensive deliberation can be stored as memories and eventually replaced by inexpensive recall.
Keyphrases
  • artificial intelligence
  • neural network
  • machine learning
  • deep learning
  • working memory
  • amino acid
  • ionic liquid