Abstract
Recent advances in FPGA technology have permitted the implementation of neurocomputational models, making them an interesting alternative to standard PCs in order to speed up the computations involved taking advantage of the intrinsic FPGA parallelism. In this work, we analyse and compare the FPGA implementation of two neural network learning algorithms: the standard Back-Propagation algorithm and C-Mantec, a constructive neural network algorithm that generates compact one hidden layer architectures. One of the main differences between both algorithms is the fact that while Back-Propagation needs a predefined architecture, C-Mantec constructs its network while learning the input patterns. Several aspects of the FPGA implementation of both algorithms are analysed, focusing in features like logic and memory resources needed, transfer function implementation, computation time, etc. Advantages and disadvantages of both methods are discussed in the context of their application to benchmark problems.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Haykin, S.: Neural networks: a comprehensive foundation. Prentice Hall (1994)
Kilts, S.: Advanced FPGA Design: Architecture, Implementation, and Optimization. Wiley-IEEE Press (2007)
Monmasson, E., Idkhajine, L., Cirstea, M., Bahri, I., Tisan, A., Naouar, M.W.: Fpgas in industrial control applications. IEEE Transactions on Industrial Informatics 7(2), 224–243 (2011)
Bacon, D., Rabbah, R., Shukla, S.: Fpga programming for the masses. Queue 11, 40–52 (2013)
Conmy, P., Bate, I.: Component-based safety analysis of fpgas. IEEE Transactions on Industrial Informatics 6(2), 195–205 (2010)
Zhu, J., Sutton, P.: Fpga implementations of neural networks - a survey of a decade of progress. In: Cheung, P.Y.K., Constantinides, G.A. (eds.) FPL 2003. LNCS, vol. 2778, pp. 1062–1066. Springer, Heidelberg (2003)
Gomperts, A., Ukil, A., Zurfluh, F.: Development and implementation of parameterized fpga-based general purpose neural networks for online applications. IEEE Trans. Industrial Informatics 7(1), 78–89 (2011)
Le, Q., Jeon, J.: Neural-network-based low-speed-damping controller for stepper motor with an fpga. IEEE Transactions on Industrial Applications 57, 3167–3180 (2010)
Ortega-Zamorano, F., Jerez, J., Urda, D., Luque-Baena, R., Franco., L.: Efficient implementation of the backpropagation algorithm in fpgas and microcontrollers. IEEE Transactions on Neural Networks and Learning Systems (2015) (in press)
Ortega-Zamorano, F., Jerez, J., Franco, L.: Fpga implementation of the c-mantec neural network constructive algorithm. IEEE Transactions on Industrial Informatics 10(2), 1154–1161 (2014)
Werbos, P.J.: Beyond Regression: New Tools for Prediction and Analysis in the Behavioral Sciences. PhD thesis, Harvard University (1974)
Rumelhart, D., Hinton, G., Williams, R.: Learning representations by back-propagating errors. Nature 323(6088), 533–536 (1986)
Subirats, J.L., Franco, L., Jerez, J.M.: C-mantec: A novel constructive neural network algorithm incorporating competition between neurons. Neural Netw. 26, 130–140 (2012)
Frean, M.: The upstart algorithm: a method for constructing and training feedforward neural networks. Neural Computation 2(2), 198–209 (1990)
Savich, A., Moussa, M., Areibi, S.: The impact of arithmetic representation on implementing mlp-bp on fpgas: A study. IEEE Transactions on Neural Networks 18(1), 240–252 (2007)
Ortega-Zamorano, F., Jerez, J., Juarez, G., Perez, J., Franco, L.: High precision fpga implementation of neural network activation functions. In: 2014 IEEE Symposium on Intelligent Embedded Systems (IES), pp. 55–60, December 2014
Chu, P.P.: FPGA Prototyping by VHDL Examples: Xilinx Spartan-3 Version. John Wiley & Sons (2008)
Ashenden, P.: The Designer’s Guide to VHDL (Systems on Silicon), vol. 3, 3rd edn. Morgan Kaufmann Publishers Inc., San Francisco (2008)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Ortega-Zamorano, F., Jerez, J.M., Juárez, G., Franco, L. (2015). FPGA Implementation Comparison Between C-Mantec and Back-Propagation Neural Network Algorithms. In: Rojas, I., Joya, G., Catala, A. (eds) Advances in Computational Intelligence. IWANN 2015. Lecture Notes in Computer Science(), vol 9095. Springer, Cham. https://doi.org/10.1007/978-3-319-19222-2_17
Download citation
DOI: https://doi.org/10.1007/978-3-319-19222-2_17
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-19221-5
Online ISBN: 978-3-319-19222-2
eBook Packages: Computer ScienceComputer Science (R0)