Integration of reinforcement learning and optimal decision - making theories of the basal ganglia

Rafal Bogacz, Tobias Larsen

Research output: Contribution to journalArticle (Academic Journal)

44 Citations (Scopus)

Abstract

This paper seeks to integrate two sets of theories describing action selection in the basal ganglia: reinforcement learning theories describing learning which actions to select to maximize reward, and decision making theories proposing that the basal ganglia selects actions on the basis of sensory evidence accumulated in the cortex. In particular, we present a model that integrates the actor-critic model of reinforcement learning and a model assuming that the cortico-basal-ganglia circuit implements a statistically optimal decision making procedure. The values of corico-striatal weights required for optimal decision making in our model differ from that provided by standard reinforcement learning models. Nevertheless, we show that an actor-critic model converges to the weights required for optimal decision making, when biologically realistic limits on synaptic weights are introduced. We also describe the model’s predictions concerning reaction times and neural responses during learning, and discuss directions required for further integration of reinforcement learning and optimal decision making theories.
Translated title of the contributionIntegration of reinforcement learning and optimal decision making theories of the basal ganglia
Original languageEnglish
Article number-
Pages (from-to)817 - 851
JournalNeural Computation
Volume23
Issue number4
DOIs
Publication statusPublished - Mar 2011

Bibliographical note

Other identifier: 2001251

Fingerprint Dive into the research topics of 'Integration of reinforcement learning and optimal decision - making theories of the basal ganglia'. Together they form a unique fingerprint.

  • Cite this