Hippocampal pattern separation supports reinforcement learning.
Ian C BallardAnthony D WagnerSamuel M McClurePublished in: Nature communications (2019)
Animals rely on learned associations to make decisions. Associations can be based on relationships between object features (e.g., the three leaflets of poison ivy leaves) and outcomes (e.g., rash). More often, outcomes are linked to multidimensional states (e.g., poison ivy is green in summer but red in spring). Feature-based reinforcement learning fails when the values of individual features depend on the other features present. One solution is to assign value to multi-featural conjunctive representations. Here, we test if the hippocampus forms separable conjunctive representations that enables the learning of response contingencies for stimuli of the form: AB+, B-, AC-, C+. Pattern analyses on functional MRI data show the hippocampus forms conjunctive representations that are dissociable from feature components and that these representations, along with those of cortex, influence striatal prediction errors. Our results establish a novel role for hippocampal pattern separation and conjunctive representation in reinforcement learning.
Keyphrases
- working memory
- cerebral ischemia
- machine learning
- magnetic resonance imaging
- liquid chromatography
- functional connectivity
- magnetic resonance
- computed tomography
- electronic health record
- cognitive impairment
- heat stress
- skeletal muscle
- metabolic syndrome
- brain injury
- prefrontal cortex
- blood brain barrier
- subarachnoid hemorrhage
- insulin resistance
- quality improvement
- drug induced