Abstract
Recently, reservoir network was used for simulating the sequential stimuli discrimination process of monkeys. To deal with the inefficient memory problem of a randomly connected network, a winner-take-all subnetwork was used. In this study, we show that a network with the small-world property makes the WTA subnetwork unnecessary. Using the reinforcement learning in the output layer only, the proposed network successfully learns to accomplish the same discrimination task. In addition, the model neurons exhibit heterogeneous firing properties, which is consistent with the physiological data.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Baddeley, A.D.: Working Memory. Oxfoid Psychology Series, vol. 11. Oxford University Press, New York (1986)
Barak, O., Sussillo, D., Romo, R., Tsodyks, M., Abbott, L.: From fixed points to chaos: three models of delayed discrimination. Prog. Neurobiol. 103, 214–222 (2013)
Cheng, Z., Deng, Z., Hu, X., Zhang, B., Yang, T.: Efficient reinforcement learning of a reservoir network model of parametric working memory achieved with a cluster population winner-take-all readout mechanism. J. Neurophysiol. 114(6), 3296–3305 (2015)
Draper, N.R., Smith, H.: Applied Regression Analysis. Wiley, Hoboken (2014)
Jaeger, H.: The “echo state” approach to analysing and training recurrent neural networks-with an erratum note. Bonn Ger.: Ger. Natl. Res. Center Inf. Technol. GMD Tech. Rep. 148, 34 (2001)
Jun, J.K., Miller, P., Hernández, A., Zainos, A., Lemus, L., Brody, C.D., Romo, R.: Heterogenous population coding of a short-term memory and decision task. J. Neurosci. 30(3), 916–929 (2010)
Loewenstein, Y., Seung, H.S.: Operant matching is a generic outcome of synaptic plasticity based on the covariance between reward and neural activity. Proc. Natl. Acad. Sci. 103(41), 15224–15229 (2006)
Maass, W., Natschläger, T., Markram, H.: Real-time computing without stable states: a new framework for neural computation based on perturbations. Neural Comput. 14(11), 2531–2560 (2002)
Machens, C.K., Romo, R., Brody, C.D.: Flexible control of mutual inhibition: a neural model of two-interval discrimination. Science 307(5712), 1121–1124 (2005)
Machens, C.K., Romo, R., Brody, C.D.: Functional, but not anatomical, separation of “what” and “when” in prefrontal cortex. J. Neurosci. 30(1), 350–360 (2010)
Miller, P., Wang, X.J.: Inhibitory control by an integral feedback signal in prefrontal cortex: a model of discrimination between sequential stimuli. Proc. Natl. Acad. Sci. Unit. States Am. 103(1), 201–206 (2006)
Romo, R., Hernández, A., Zainos, A., Lemus, L., Brody, C.D.: Neuronal correlates of decision-making in secondary somatosensory cortex. Nat. Neurosci. 5(11), 1217–1225 (2002)
Romo, R., Salinas, E.: Flutter discrimination: neural codes, perception, memory and decision making. Nat. Rev. Neurosci. 4(3), 203–218 (2003)
Sompolinsky, H., Crisanti, A., Sommers, H.J.: Chaos in random neural networks. Phys. Rev. Lett. 61(3), 259–262 (1988)
Acknowledgments
This work was supported in part by the National Basic Research Program (973 Program) of China under Grant 2013CB329403, in part by the National Natural Science Foundation of China under Grant 91420201, Grant 61332007, and Grant 61621136008, and in part by the German Research Foundation (DFG) under Grant TRR-169.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Bai, K., Liao, F., Hu, X. (2017). Reservoir Computing with a Small-World Network for Discriminating Two Sequential Stimuli. In: Cong, F., Leung, A., Wei, Q. (eds) Advances in Neural Networks - ISNN 2017. ISNN 2017. Lecture Notes in Computer Science(), vol 10261. Springer, Cham. https://doi.org/10.1007/978-3-319-59072-1_33
Download citation
DOI: https://doi.org/10.1007/978-3-319-59072-1_33
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-59071-4
Online ISBN: 978-3-319-59072-1
eBook Packages: Computer ScienceComputer Science (R0)