Abstract
Hardware implementations of Artificial Neural Networks (ANNs) allow to exploit the inherent parallelism of these architectures. Nevertheless, ANN hardware implementation requires a large amount of hardware resources. Recently, Reservoir computing (RC) has arisen as an advantageous technique to implement Recurrent Neural Networks RNNs). In this work, we present an efficient approach to implement RC systems. The proposed methodology employs probabilistic logic to reduce the hardware area required to implement the arithmetic operations present in neural networks and conventional binary logic for the nonlinear activation function. We show the functionality and low hardware resources used by the proposed methodology.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Jaeger, H.: The ‘ echo state ’ approach to analysing and training recurrent neural networks – with an Erratum note. In: GMD Report 148, German National Research Center for Information Technology (2010)
Lukoševičius, M., Jaeger, H., Schrauwen, B.: Reservoir computing trends. KI - Künstliche Intelligenz 26(4), 365–371 (2012)
Maass, W., Natschläger, T., Markram, H.: Real-time computing without stable states: a new framework for neural computation based on perturbations. Neural Comput. 14(11), 2531–2560 (2002)
Jaeger, H., Haas, H.: Harnessing nonlinearity: predicting chaotic systems and saving energy in wireless communication. Science 304(5667), 78–80 (2004)
Verstraeten, D., Schrauwen, B., D’Haene, M., Stroobandt, D.: An experimental unification of reservoir computing methods. Neural Networks 20, 391–403 (2007)
Rodan, A., Tiňo, P.: Minimum complexity echo state network. IEEE Trans. Neural Networks 22(1), 131–144 (2011)
Larger, L., Soriano, M.C., Brunner, D., Appeltant, L., Gutierrez, J.M., Pesquera, L., Mirasso, C.R., Fischer, I.: Photonic information processing beyond turing: an optoelectronic implementation of reservoir computing. Opt. Express 20(3), 3241–3249 (2012)
Paquot, Y., Duport, F., Smerieri, A., Dambre, J., Schrauwen, B., Haelterman, M., Massar, S.: Optoelectronic reservoir computing. Sci. Rep. 2, 1–6 (2012)
Vandoorne, K., Dierckx, W., Schrauwen, B., Verstraeten, D., Baets, R., Bienstman, P., Van Campenhout, J.: Toward optical signal processing using photonic reservoir computing. Opt. Express 16(15), 11182–11192 (2008)
Schrauwen, B., 'Haene, M.D., Verstraeten, D., Van Campenhout, J.: Compact hardware liquid state machines on FPGA for real-time speech recognition. Neural Networks 21, 511–523 (2008)
Gaines, B.R.: R68-18 random pulse machines. IEEE Trans. Comput. C–17(4), 410 (1968)
Toral, S.L., Quero, J.M., Franquelo, L.G.: Stochastic pluse coded arithmetic. In: International Symposium on Circuits and Systems, pp. I–599–I–602 (2000)
Kondo, Y., Sawada, Y.: Functional abilities of a stochastic logic neural network. IEEE Trans. Neural Networks 3(3), 434–443 (1992)
Bade, S.L., Hutchings, B.L.: FPGA-based stochastic neural networks-implementation. In: IEEE Workshop on FPGAs for Custom Computing Machines (1994)
Brown, B.D., Card, H.C.: Stochastic neural computation I: Computational elements. IEEE Trans. Comput. 50(9), 891–905 (2001)
Rosselló, J.L., Canals, V., Morro, A.: Hardware implementation of stochastic-based neural networks. In: Proceedings of the International Joint Conference on Neural Networks (2010)
Verstraeten, D.: Stochastic bitstream-based reservoir computing with feedback. In: Fifth FirW Ph.D. Symposium (2005)
Verstraeten, D., Schrauwen, B., Stroobandt, D.: Reservoir computing with stochastic bitstream neurons. In: Proceedings of the 16th Annual ProRISC Workshop, pp. 454–459 (2005)
Alomar, M.L., Canals, V., Martinez-Moll, V., Rossello, J.L.: Low-cost hardware implementation of reservoir computers. In: 2014 24th International Workshop on Power and Timing Modeling, Optimization and Simulation (PATMOS), pp. 1–5 (2014)
Tommiska, M.T.: Efficient digital implementation of the sigmoid function for reprogrammable logic. IEE Proceedings - Computers and Digital Techniques 150(6), 403–411 (2003)
Himavathi, S., Anitha, D., Muthuramalingam, A.: Feedforward neural network implementation in FPGA using layer multiplexing for effective resource utilization. IEEE Trans. Neural Networks 18(3), 880–888 (2007)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Alomar, M.L., Canals, V., Martínez-Moll, V., Rosselló, J.L. (2015). Stochastic-Based Implementation of Reservoir Computers. In: Rojas, I., Joya, G., Catala, A. (eds) Advances in Computational Intelligence. IWANN 2015. Lecture Notes in Computer Science(), vol 9095. Springer, Cham. https://doi.org/10.1007/978-3-319-19222-2_16
Download citation
DOI: https://doi.org/10.1007/978-3-319-19222-2_16
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-19221-5
Online ISBN: 978-3-319-19222-2
eBook Packages: Computer ScienceComputer Science (R0)