extended-abstract

Towards the Neuromorphic Implementation of the Auditory Perception in the iCub Robotic Platform

Authors:

Daniel Gutierrez-Galan,

Chiara Bartolozzi,

Juan Pedro Dominguez-Morales,

Angel Jimenez-Fernandez,

Alejandro Linares-BarrancoAuthors Info & Claims

NICE '22: Proceedings of the 2022 Annual Neuro-Inspired Computational Elements Conference

Pages 11 - 12

https://doi.org/10.1145/3517343.3517347

Published: 03 May 2022 Publication History

Get Access

Abstract

Hearing can be considered as one of the most important senses since it plays a key role in the audiovisual learning process. While a lot of effort has been made for achieving good results from the traditional approach of auditory perception, new trends such as neuromorphic computing are showing promising achievements in the implementation of brain structures for sensory perception. In this work, the design and integration of a neuromorphic event-based digital model of the auditory ascending pathway within the iCub robotic platform is proposed. This model, which comprises from the cochlea up to the inferior colliculus, replaces the traditional approach for sound processing already implemented on iCub and is able to perform sound recognition and spatial localization in real-time, allowing the implementation of auditory attention models in complex scenarios, like the cocktail party problem.

References

[1]

Jorge Dávila-Chacón 2018. Enhanced robot speech recognition using biomimetic binaural sound source localization. IEEE transactions on neural networks and learning systems 30, 1(2018), 138–150.

Google Scholar

[2]

Arren Glover 2018. The event-driven software library for YARP—With algorithms and iCub applications. Frontiers in Robotics and AI 4 (2018), 73.

Crossref

Google Scholar

[3]

Daniel Gutierrez-Galan 2019. A neuromorphic approach of the sound source localization task in real-time embedded systems: work-in-progress. In Proceedings of the International Conference on Embedded Software Companion. 1–2.

Digital Library

Google Scholar

[4]

Dillon A Hambrook 2017. A Bayesian computational basis for auditory selective attention using head rotation and the interaural time-difference cue. PloS one 12, 10 (2017).

Google Scholar

[5]

Bertrand Higy, Alessio Mereta, Giorgio Metta, and Leonardo Badino. 2018. Speech recognition for the icub platform. Frontiers in Robotics and AI 5 (2018), 10.

Crossref

Google Scholar

[6]

Angel Jiménez-Fernández 2017. A Binaural Neuromorphic Auditory Sensor for FPGA: A Spike Signal Processing Approach.IEEE Trans. Neural Netw. Learning Syst. 28, 4 (2017), 804–818.

Crossref

Google Scholar

[7]

Lorenzo Natale 2017. icub: The not-yet-finished story of building a robot child. Science Robotics 2, 13 (2017).

Google Scholar

[8]

Eustace Painkras 2013. SpiNNaker: A 1-W 18-core system-on-chip for massively-parallel neural network simulation. IEEE Journal of Solid-State Circuits 48, 8 (2013), 1943–1953.

Crossref

Google Scholar

[9]

Giulia Pasquale, Carlo Ciliberto, Francesca Odone, Lorenzo Rosasco, and Lorenzo Natale. 2019. Are we done with object recognition? The iCub robot’s perspective. Robotics and Autonomous Systems 112 (2019), 260–281.

Crossref

Google Scholar

[10]

Vadim Tikhanoff 2010. Integration of speech and action in humanoid robots: iCub simulation experiments. IEEE Transactions on Autonomous Mental Development 3, 1(2010), 17–29.

Digital Library

Google Scholar

Cited By

View all

Johny SVed KDurstewitz SIvanov TZiegler MLenk C(2024)Bio-Inspired Sensor-Based Sound Pre-Processing for Speech Recognition in Noisy Conditions2024 IEEE Biomedical Circuits and Systems Conference (BioCAS)10.1109/BioCAS61083.2024.10798207(1-5)Online publication date: 24-Oct-2024
https://doi.org/10.1109/BioCAS61083.2024.10798207
Deng BFan YWang JYang S(2023)Auditory perception architecture with spiking neural network and implementation on FPGANeural Networks10.1016/j.neunet.2023.05.026165:C(31-42)Online publication date: 1-Aug-2023
https://dl.acm.org/doi/10.1016/j.neunet.2023.05.026
Yang YBartolozzi CZhang HNawrocki R(2023)Neuromorphic electronics for robotic perception, navigation and controlEngineering Applications of Artificial Intelligence10.1016/j.engappai.2023.106838126:PAOnline publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1016/j.engappai.2023.106838

Recommendations

Real-time neuro-inspired sound source localization and tracking architecture applied to a robotic platform
Abstract
This paper proposes a real-time sound source localization and tracking architecture based on the ability of the mammalian auditory system using the interaural intensity difference. We used an innovative binaural Neuromorphic Auditory ...
Confirming the perception of virtual source elevation effects created using 5.1 channel surround sound playback
VRCAI '10: Proceedings of the 9th ACM SIGGRAPH Conference on Virtual-Reality Continuum and its Applications in Industry

Employing an array of nine speakers, five of which were at the listener's ear level, and four of which were elevated well above the listener's ear level, an experimental investigation of virtual sound source elevation was completed in each of three ...
Azimuthal source localization using interaural coherence in a robotic dog: Modeling and application

In nature, sounds from multiple sources, as well as reflections from the surfaces of the physical surroundings, arrive concurrently from different directions at the ears of a listener. Despite the fact that all of these waveforms sum at the eardrums, ...

Comments

Information & Contributors

Information

Published In

NICE '22: Proceedings of the 2022 Annual Neuro-Inspired Computational Elements Conference

March 2022

122 pages

ISBN:9781450395595

DOI:10.1145/3517343

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 May 2022

Check for updates

Author Tags

Qualifiers

Extended-abstract
Research
Refereed limited

Funding Sources

Ministerio de Ciencia, Innovación y Universidades

Conference

NICE 2022

NICE 2022: Neuro-Inspired Computational Elements Conference

March 28 - April 1, 2022

Virtual Event, USA

Acceptance Rates

Overall Acceptance Rate 25 of 40 submissions, 63%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
91
Total Downloads

Downloads (Last 12 months)21
Downloads (Last 6 weeks)4

Reflects downloads up to 27 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Johny SVed KDurstewitz SIvanov TZiegler MLenk C(2024)Bio-Inspired Sensor-Based Sound Pre-Processing for Speech Recognition in Noisy Conditions2024 IEEE Biomedical Circuits and Systems Conference (BioCAS)10.1109/BioCAS61083.2024.10798207(1-5)Online publication date: 24-Oct-2024
https://doi.org/10.1109/BioCAS61083.2024.10798207
Deng BFan YWang JYang S(2023)Auditory perception architecture with spiking neural network and implementation on FPGANeural Networks10.1016/j.neunet.2023.05.026165:C(31-42)Online publication date: 1-Aug-2023
https://dl.acm.org/doi/10.1016/j.neunet.2023.05.026
Yang YBartolozzi CZhang HNawrocki R(2023)Neuromorphic electronics for robotic perception, navigation and controlEngineering Applications of Artificial Intelligence10.1016/j.engappai.2023.106838126:PAOnline publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1016/j.engappai.2023.106838

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Abstract

References

Cited By

Recommendations

Real-time neuro-inspired sound source localization and tracking architecture applied to a robotic platform

Confirming the perception of virtual source elevation effects created using 5.1 channel surround sound playback

Azimuthal source localization using interaural coherence in a robotic dog: Modeling and application

Comments

Information

Published In

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Funding Sources

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

HTML Format

Share

Share this Publication link

Share on social media

Affiliations