Skip to main content
SpringerLink
Log in

A Model of Horizontal 360° Object Localization Based on Binaural Hearing and Monocular Vision

  • Conference paper
  • First Online:
Artificial Neural Networks — ICANN 2001 (ICANN 2001)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2130))

Included in the following conference series:

  • 4046 Accesses

Abstract

We introduce a biologically inspired localization system, based on a “two-microphone and one camera” configuration. Our aim is to perform a robust, multimodal 360° detection of objects, in particular humans, in the horizontal plane. In our approach, we consider neurophysiological findings to discuss the biological plausibility of the coding and extraction of spatial features, but also meet the demands and constraints of a practical application in the field of human-robot interaction. Presently we are able to demonstrate a model of binaural sound localization using Interaural Time Differences for the left/right detection and spectrum-based features to discriminate between in front and behind. The objective of the current work is the multimodal integration of different types of vision systems. In this paper, we summmarize the experiences with the design and use of the auditory model and suggest a new model concept for the audio-visual integration of spatial localization hypotheses.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 149.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 189.00
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Jens Blauert. Spatial Hearing: The Psychophysics of Human Sound Localization. MIT Press, 1996.

    Google Scholar 

  2. G. Ehret and R. Romand The Central Auditory System. Oxford University Press, New York 1997.

    Google Scholar 

  3. Gross, H.-M., Boehme, H.-J. PERSES-a Vision-based Interactive Mobile Shopping Assistant. in: Proc. IEEE SMC 2000, pp. 80–85.

    Google Scholar 

  4. L.A. Jeffress. A place theory of sound localization. J. Physiol. Psychol., 41:35–39, 1948.

    Article  Google Scholar 

  5. John Lazzaro and Carver Mead. A silicon model of auditory localization. Neural Computation, 1(1):41–70, 1989.

    Article  Google Scholar 

  6. Schauer, C., Zahn, Th., Paschke, P., Gross, H.-M. Binaural Sound Localization in an Artificial Neural Network. in: Proc. IEEE ICASSP 2000, pp. II 865–868.

    Google Scholar 

  7. P.H. Schiller A model for the generation of visually guided saccadic eye movements. in: Models of the visual cortex, D. Rose, V.G. Dobson (Eds). Wiley, 1985, pp 62–70

    Google Scholar 

  8. Stein, B.E. and Meredith, M.A. The Merging of the Senses. The MIT Press, Cambridge, Massachusetts

    Google Scholar 

  9. M. T. Wallace, L. K. Wilkinson, B. E. Stein. Representation and Integration of multisensory Inputs in Primate Superior Colliculus. Journal of Neurophysiology. Vol. 76, No. 2: 1246–1266, 1996

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Dept. of Neuroinformatics, Ilmenau Technical University, D-98684, Ilmenau, Germany

    Carsten Schauer & Horst-Michael Gross

Authors
  1. Carsten Schauer
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Horst-Michael Gross
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Dept. of Mecidal Cybernetics and Artificial Intelligence, University of Vienna, Freyung 6/2, 1010, Vienna, Austria

    Georg Dorffner

  2. Institute for Computer Aided Automation Pattern Recognition and Image Processing Group, Technical University of Vienna, Favoritenstr. 9/1832, 1040, Vienna, Austria

    Horst Bischof

  3. Institut für Statistik, Wirtschaftsuniversität Wien, Augasse 2-6, 1090, Wien, Austria

    Kurt Hornik

Rights and permissions

Reprints and permissions

Copyright information

© 2001 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Schauer, C., Gross, HM. (2001). A Model of Horizontal 360° Object Localization Based on Binaural Hearing and Monocular Vision. In: Dorffner, G., Bischof, H., Hornik, K. (eds) Artificial Neural Networks — ICANN 2001. ICANN 2001. Lecture Notes in Computer Science, vol 2130. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44668-0_159

Download citation

  • DOI: https://doi.org/10.1007/3-540-44668-0_159

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-42486-4

  • Online ISBN: 978-3-540-44668-2

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation