BiologybioRxiv
Ranked by formulaVerdict: NotableA Mechanistic Theory Unifying Value and Schema in the Prefrontal Cortex
Animals exhibit behavioural flexibility by making reward-optimal decisions in unfamiliar situations.
Caveats
- Preprint; not yet peer reviewed.
VerdictWorth a reader's time today.
Abstract
Animals exhibit behavioural flexibility by making reward-optimal decisions in unfamiliar situations. Computing value from minimal reward feedback requires leveraging known structure in the world. The Prefrontal Cortex (PFC) plays a pivotal role in both value computation and learning world structure, however mechanistic explanations for each---within the frameworks of Reinforcement Learning and Cognitive Maps---are largely distinct. We develop a mechanistic model of PFC that unifies value and structure through behavioural flexibility. In this model, value acts as a control signal that gates structured working memory representations of the current context in order to ultimately control behaviour. This is a significant departure from the conventional perspective of value, in which it is used for action readout. Critically, this model generalises to novel contexts without the need for additional synaptic plasticity. We demonstrate that recurrent neural networks (RNNs) meta-trained with either reinforcement learning or supervised learning recapitulate this exact model on various value-based tasks. These results not only provide a parsimonious explanation of both the value and schema frameworks of PFC function, but also propose a new mechanistic interpretation of the role of PFC in flexible decision making.
The editor's rubric
- Leverage3 / 5
- A method or resource many groups across the field will adopt within a year.
- Magnitude2 / 5
- Solid incremental gain on a meaningful problem.
- Evidence3 / 5
- Solid: multiple benchmarks or cohorts, ablations, fair baselines, released code or data.
- Novelty3 / 5
- A genuinely new approach to an open problem.
- Trajectory2 / 5
- Some room to improve with obvious engineering.
- Stakes2 / 5
- Benefits a professional community (practitioners, clinicians, engineers).
Editor’s rationale
Heuristic triage from title and abstract text only, not a reading of the paper. Cues found: method (we propose, we report); breadth (generalizes); novelty (alternative to status quo); design (phase 3).
How the score was computed
Desks place stronger verdicts first, then use this score to order work within the same verdict.
- Merit
- 5.3 / 10
- Adjusted merit
- 4.5 / 10
- Attention
- 0%
- Freshness
- 88%