Abstract

Previous models of neuromodulation in cortical circuits have used either physiologically based networks of spiking neurons or simplified gain adjustments in low-dimensional connectionist models. Here we reduce a high-dimensional spiking neuronal network model, first to a four-population mean-field model and then to a two-population model. This provides a realistic implementation of neuromodulation in low-dimensional decision-making models, speeds up simulations by three orders of magnitude, and allows bifurcation and phase-plane analyses of the reduced models that illuminate neuromodulatory mechanisms. As modulation of excitation-inhibition varies, the network can move from unaroused states, through optimal performance to impulsive states, and eventually lose inhibition-driven winner-take-all behavior: all are clear outcomes of the bifurcation structure. We illustrate the value of reduced models by a study of the speed-accuracy tradeoff in decision making. The ability of such models to recreate neuromodulatory dynamics of the spiking network will accelerate the pace of future experiments linking behavioral data to cellular neurophysiology.

MSC codes

  1. 34C23
  2. 34C29
  3. 37G10
  4. 37G35
  5. 60H10

Keywords

  1. attractor neural networks
  2. averaging
  3. bifurcation
  4. decision making
  5. dimension reduction
  6. integrate-and-fire neuronal model
  7. mean field theory
  8. neuromodulation
  9. optimal reward rate
  10. stochastic ODEs

Get full access to this article

View all available purchase options and get full access to this article.

References

1.
L. F. Abbott and E. S. Chance, Drivers and modulators from push-pull and balanced synaptic input, Prog. Brain Res., 149 (2005), pp. 147–155.
2.
D. J. Amit and N. Brunel, Dynamics of a recurrent network of spiking neurons before and following learning, Netw. Comput. Neural Syst., 8 (1997), pp. 373–404.
3.
D. J. Amit and N. Brunel, Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex, Cereb. Cortex, 7 (1997), pp. 237–274.
4.
D. J. Amit and M. V. Tsodyks, Quantitative study of attractor neural network retrieving at low spike rates I: Substrate-spikes, rates and neuronal gain, Network, 2 (1991), pp. 259–274.
5.
G. Aston-Jones and J. D. Cohen, An integrative theory of locus coeruleus-norepinephrine function: Adaptive gain and optimal performance, Annu. Rev. Neurosci., 28 (2005), pp. 403–450.
6.
C. W. Berridge and E. D. Abercrombie, Relationship between locus coeruleus discharge rates and rates of norepinephrine release within neocortex as assessed by in vivo microdialysis, Neuroscience, 93 (1999), pp. 1263–1270.
7.
C. W. Berridge and B. D. Waterhouse, The locus coeruleus-noradrenergic system: Modulation of behavioral state and state-dependent cognitive processes, Brain Res. Rev., 42 (2003), pp. 33–84.
8.
R. Bogacz, E. Brown, J. Moehlis, P. Holmes, and J. D. Cohen, The physics of optimal decision making: A formal analysis of models of performance in two alternative forced choice tasks, Psychological Review, 113 (2006), pp. 700–765.
9.
S. Bouret and S. J. Sara, Network reset: A simplified overarching theory of locus coeruleus noradrenaline function, Trends Neurosci., 28 (2005), pp. 574–582.
10.
K. H. Britten, M. N. Shadlen, W. T. Newsome, and J. A. Movshon, The analysis of visual motion: A comparison of neuronal and psychophysical performance, J. Neurosci., 12 (1992), pp. 4745–4765.
11.
K. H. Britten, M. N. Shadlen, W. T. Newsome, and J. A. Movshon, Response of neurons in macaque MT to stochastic motion signals, Vis. Neurosci., 10 (1993), pp. 1157–1169.
12.
N. Brunel, F. S. Chance, N. Fourcaud, and L. F. Abbott, Effects of synaptic noise and filtering on the frequency response of spiking neurons, Phys. Rev. Lett., 86 (2001), pp. 2186–2189.
13.
N. Brunel and X.-J. Wang, Effects of neurmodulation in a cortical network model of object working memory dominated by recurrent inhibition, J. Comput. Neurosci., 11 (2001), pp. 63–85.
14.
P. Dayan and L. F. Abbott, Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems, MIT Press, Cambridge, MA, 2001.
15.
G. Deco and E. T. Rolls, Decision-making and Weber's law: A neurophysiological model, Eur. J. Neurosci., 24 (2006), pp. 901–906.
16.
D. M. Devilbiss and B. D. Waterhouse, The effects of tonic locus ceruleus output on sensory-evoked responses of ventral posterior medial thalamic and barrel field cortical neurons in the awake rat, J. Neurosci., 24 (2004), pp. 10773–10785.
17.
K. Doya, Modulators of decision making, Nat. Neurosci., 11 (2008), pp. 410–416.
18.
P. Eckhoff, P. Holmes, C. Law, P. M. Connolly, and J. I. Gold, On diffusion processes with variable drift rates as models for decision making during learning, New J. Phys., 10 (2008), 015006.
19.
P. Eckhoff, K.-F. Wong, and P. Holmes, Optimality and robustness of a biophysical decision-making model under norepinephrine modulation, J. Neurosci., 29 (2009), pp. 4301–4311.
20.
B. Ermentrout, Simulating, Analyzing, and Animating Dynamical Systems: A Guide to XPPAUT for Researchers and Students, Software Environ. Tools 14, SIAM, Philadelphia, 2002.
21.
B. Ermentrout, Phase-plane analysis of neural nets, in The Handbook of Brain Theory and Neural Networks, M. A. Arbib, ed., MIT Press, Cambridge, MA, 2003, pp. 881–885.
22.
W. Feller, An Introduction to Probability Theory and Its Applications, 2nd ed., Wiley, New York, 1957.
23.
C. W. Gardiner, Handbook of Stochastic Methods, 2nd ed., Springer, New York, 1985.
24.
M. G. Gilzenrat, B. D. Holmes, J. Rajkowski, G. Aston-Jones, and J. D. Cohen, Simplified dynamics in a model of noradrenergic modulation of cognitive performance, Neural Networks, 15 (2002), pp. 647–663.
25.
J. I. Gold and M. N. Shadlen, Neural computations that underlie decisions about sensory stimuli, Trends in Cognitive Science, 5 (2001), pp. 10–16.
26.
J. I. Gold and M. N. Shadlen, Banburismus and the brain: Decoding the relationship between sensory stimuli, decisions, and reward, Neuron, 36 (2002), pp. 299–308.
27.
J. Guckenheimer and P. J. Holmes, Nonlinear Oscillations, Dynamical Systems and Bifurcations of Vector Fields, Springer-Verlag, New York, 1983.
28.
G. D. Horwitz and W. T. Newsome, Separate signals for target selection and movement specification in the superior colliculus, Science, 284 (1999), pp. 1158–1161.
29.
G. D. Horwitz and W. T. Newsome, Target selection for saccadic eye movements: Prelude activity in the superior colliculus during a direction-discrimination task, J. Neurophysiol., 86 (2001), pp. 2543–2558.
30.
C. K. R. T. Jones, Geometric singular perturbation theory, in Dynamical Systems (Montecatini Terme, 1994), Lecture Notes in Math. 1609, Springer, Berlin, 1995, pp. 44–118.
31.
J. N. Kim and M. N. Shadlen, Neural correlates of a decision in the dorsolateral prefrontal cortex, Nat. Neurosci., 2 (1999), pp. 176–185.
32.
D. Marti, G. Deco, M. Mattia, G. Gigante, and P. Del Giudice, A fluctuation-driven mechanism for slow decision processes in reverberant networks, PLoS ONE, 3 (2008), e2534.
33.
J. Palmer, A. C. Huk, and M. N. Shadlen, The effect of stimulus strength on the speed and accuracy of a perceptual decision, J. Vis., 5 (2005), pp. 376–404.
34.
J. Rajkowski, H. Majczynski, E. Clayton, and G. Aston-Jones, Activation of monkey locus coeruleus neurons varies with difficulty and performance in a target detection task, J. Neurophysiol., 92 (2004), pp. 361–371.
35.
A. Renart, N. Brunel, and X.-J. Wang, Mean-field theory of irregularly spiking neuronal populations and working memory in recurrent cortical networks, in Computational Neuroscience: A Comprehensive Approach, J. Feng, ed., Chapman and Hall/CRC, Boca Raton, FL, 2004, pp. 431–490.
36.
L. M. Ricciardi, Diffusion Processes and Related Topics in Biology, Springer, Berlin, 1977.
37.
J. Roitman and M. Shadlen, Response of neurons in the lateral intraparietal area during a combined visual discrimination reaction time task, J. Neurosci., 22 (2002), pp. 9475–9489.
38.
S. J. Sara, The locus coeruleus and noradrenergic modulation of cognition, Nat. Rev. Neuro., 10 (2009), pp. 211–223.
39.
D. Servan-Schreiber, H. Printz, and J. D. Cohen, A network model of catecholamine effects: Gain, signal-to-noise ratio, and behavior, Science, 249 (1990), pp. 892–895.
40.
M. N. Shadlen and W. T. Newsome, Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey, J. Neurophysiol., 86 (2001), pp. 1916–1936.
41.
E. Shea-Brown, J. Gao, P. Holmes, R. Bogacz, M. S. Gilzenrat, and J. D. Cohen, Simple neural networks that optimize decisions, Internat. J. Bifur. Chaos Appl. Sci. Engrg., 15 (2005), pp. 803–826.
42.
E. Shea-Brown, M. Gilzenrat, and J. D. Cohen, Optimization of decision making in multilayer networks: The role of locus coeruleus, Neural Comput., 20 (2008), pp. 2863–2894.
43.
E. Shea-Brown, J. Moehlis, P. Holmes, E. Clayton, J. Rajkowski, and G. Aston-Jones, The influence of spike rate and stimulus duration on noradrenergic neurons, J. Comput. Neurosci., 17 (2004), pp. 13–29.
44.
P. Simen, J. D. Cohen, and P. Holmes, Rapid decision threshold modulation by reward rate in a neural network, Neural Networks, 19 (2006), pp. 1013–1026.
45.
M. Usher, J. D. Cohen, D. Servan-Schreiber, J. Rajkowski, and G. Aston-Jones, The role of locus coeruleus in the regulation of cognitive performance, Science, 283 (1999), pp. 549–554.
46.
M. Usher and J. L. McClelland, On the time course of perceptual choice: The leaky competing accumulator model, Psych. Rev., 108 (2001), pp. 550–592.
47.
X.-J. Wang, Probabilistic decision making by slow reverberation in cortical circuits, Neuron, 36 (2002), pp. 955–968.
48.
B. D. Waterhouse, D. Devilbiss, D. Fleischer, F. M. Sessler, and K. L. Simpson, New perspectives on the functional organization and postsynaptic influences of the locus ceruleus efferent projection system, Adv. Pharmacol., 42 (1998), pp. 749–754.
49.
K. F. Wong and X.-J. Wang, A recurrent network mechanism of time integration in perceptual decisions, J. Neurosci., 26 (2006), pp. 1314–1328.

Information & Authors

Information

Published In

cover image SIAM Journal on Applied Dynamical Systems
SIAM Journal on Applied Dynamical Systems
Pages: 148 - 188
ISSN (online): 1536-0040

History

Submitted: 3 September 2009
Accepted: 11 November 2010
Published online: 22 February 2011

MSC codes

  1. 34C23
  2. 34C29
  3. 37G10
  4. 37G35
  5. 60H10

Keywords

  1. attractor neural networks
  2. averaging
  3. bifurcation
  4. decision making
  5. dimension reduction
  6. integrate-and-fire neuronal model
  7. mean field theory
  8. neuromodulation
  9. optimal reward rate
  10. stochastic ODEs

Authors

Affiliations

Metrics & Citations

Metrics

Citations

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

Cited By

Media

Figures

Other

Tables

Share

Share

Copy the content Link

Share with email

Email a colleague

Share on social media

The SIAM Publications Library now uses SIAM Single Sign-On for individuals. If you do not have existing SIAM credentials, create your SIAM account https://my.siam.org.