Abstract
A cellular neural network is proposed as the main processing core in a novel FPGA-based augmented reality system. The described application is focused on visually impaired people aid. The aim is to enhance the user’s knowledge of the environment with useful information extracted by image processing. A CNN architecture oriented to hardware implementation on FPGA is presented, and used as the image processor in a fully FPGA-based system. So, CNNs and FPGAs are combined in a system which makes the most of their characteristics to achieve high performance and versatility.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Tessier, R., Burleson, W.: Reconfigurable computing for digital signal processing: a survey. Journal of VLSI Signal Processing 28(1), 7–27 (2001)
Goslin, G.R.: Using FPGA in digital signal processing application. In: Intern. Conf. on Signal Processing Applications and Technology, Boston, USA, pp. 145–149 (1995)
Kessal, L., Abel, N., Demigny, D.: Real time image processing with dynamically reconfigurable architecture. Real Time Imaging 9(5), 297–313 (2003)
Draper, B., Beveridge, J.R., Böhm, W., Ross, C., Chawathe, M.: Accelerated image processing on FPGAs. IEEE Trans. on Image Processing 12(12), 1543–1551 (2003)
Nagy, Z., Szolgay, P.: Configurable multi-layer CNN-UM emulator on FPGA. In: Proc. IEEE Int. Workshop on Cellular Neural Networks and Their Applications, Frankfurt, Germany, pp. 164–171 (2002)
Malki, S., Spaanenburg, L.: CNN image processing on a Xilinx Virtex–II 6000. In: Proc. European Conference on Circuit Theory and Design, Krakow, Poland, pp. 261–264 (2003)
Martínez, J.J., Toledo, F.J., Ferrández, J.M.: New emulated discrete model of CNN architecture for FPGA and DSP applications. In: Mira, J., Álvarez, J.R. (eds.) IWANN 2003. LNCS, vol. 2687, pp. 33–40. Springer, Heidelberg (2003)
Head mounted display survey. Real Time Graphics 10(2), 6–10 (2001)
Azuma, R.T.: A survey of augmented reality. Presence: Teleoperators and virtual environments 6(4), 355–385 (1997)
Vargas Martín, F., Peli, E.: Augmented view for tunnel vision: device testing by patients in real environments. In: Digest of Technical Papers, Society for Information Display International Symposium, San Jose, USA, pp. 602–605 (2001)
Vargas Martín, F., Peli, E.: Augmented-view for restricted visual field: multiple device implementations. Optometry and Vision Science 79(11), 715–723 (2002)
Toledo, F.J., Martínez, J.J., Garrigós, F.J., Ferrández, J.M.: Augmented reality system for visually impaired people based on FPGA. In: Proc. 4th IASTED Int. Conf. on Visualization, Imaging and Image Processing, Marbella, Spain, pp. 715–723 (2004)
Martínez, J.J., Toledo, J., Ferrández, J.M.: Implementation of a discrete cellular neuron model (DT-CNN) architecture on FPGA. In: 2nd SPIE Int. Symposium on Microtechnologies for the New Millennium, Conf. on bioengineered and bioinspired systems (2005) (to appear)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Toledo, F.J., Martínez, J.J., Garrigós, F.J., Ferrández, J.M. (2005). Image Processing with CNN in a FPGA-Based Augmented Reality System for Visually Impaired People. In: Cabestany, J., Prieto, A., Sandoval, F. (eds) Computational Intelligence and Bioinspired Systems. IWANN 2005. Lecture Notes in Computer Science, vol 3512. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11494669_111
Download citation
DOI: https://doi.org/10.1007/11494669_111
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-26208-4
Online ISBN: 978-3-540-32106-4
eBook Packages: Computer ScienceComputer Science (R0)