Simple neural networks that optimize decisions

E Brown, J Gao, P Holmes, Rafal Bogacz, M Gilzenrat, JD Cohen

Research output: Contribution to journalArticle (Academic Journal)peer-review

75 Citations (Scopus)

Abstract

We review simple connectionist and firing rate models for mutually inhibiting pools of neurons that discriminate between pairs of stimuli. Both are two-dimensional nonlinear stochastic ordinary differential equations, and although they differ in how inputs and stimuli enter, we show that they are equivalent under state variable and parameter coordinate changes. A key parameter is gain: the maximum slope of the sigmoidal activation function. We develop piecewise-linear and purely linear models, and one-dimensional reductions to Ornstein Uhlenbeck processes that can be viewed as linear filters, and show that reaction time and error rate statistics are well approximated by these simpler models. We then pose and solve the optimal gain problem for the Ornstein Uhlenbeck processes, finding explicit gain schedules that minimize error rates for time-varying stimuli. We relate these to time courses of norepinephrine release in cortical areas, and argue that transient firing rate changes in the brainstem nucleus locus coeruleus may be responsible for approximate gain optimization.
Translated title of the contributionSimple neural networks that optimize decisions
Original languageEnglish
Pages (from-to)803 - 826
Number of pages23
JournalInternational Journal of Bifurcation and Chaos
Volume15(3)
Publication statusPublished - Jun 2005

Fingerprint Dive into the research topics of 'Simple neural networks that optimize decisions'. Together they form a unique fingerprint.

Cite this