loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Authors: Beauclair Dongmo Ngnintedem 1 ; Eric Mense 1 ; Johannes Rückert 1 and Christoph M. Friedrich 1 ; 2

Affiliations: 1 Department of Computer Science, University of Applied Sciences and Arts Dortmund (FHDO), Dortmund, Germany ; 2 Institute for Medical Informatics, Biometry and Epidemiology (IMIBE), University Hospital Essen, Essen, Germany

Keyword(s): Sensor Substitution, Hearing Loss, Ambient Sound Classification, Sound Source Localization, Mixed Reality.

Abstract: Hearing-impaired people are exposed to greater dangers in everyday life, due to the fact that they are not able to perceive danger and warning signals. This paper addresses this problem by developing an application, that could help by classifying and detecting the direction of ambient sounds using Microsoft HoloLens 2 devices. The developed application implements a client-server architecture. The server-side REST-API supports not only the classification of sounds from audio files via deep-learning methods, but also allows the results of the sound source localization to be saved and read. The sound source localization is performed by a Maix Bit microcontroller with a 6-channel microphone array. For the user integration and interaction with the application, a 3D scene has been designed using Unity and the Mixed Reality Toolkit (MRTK). The implemented application showcases how classification and direction detection of ambient sounds could be done on the Microsoft HoloLens to support hea ring-impaired people. (More)

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 18.191.240.243

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Ngnintedem, B.; Mense, E.; Rückert, J. and Friedrich, C. (2022). Classification and Direction Detection of Ambient Sounds on Microsoft HoloLens to Support Hearing-impaired People. In Proceedings of the 15th International Joint Conference on Biomedical Engineering Systems and Technologies - WHC; ISBN 978-989-758-552-4; ISSN 2184-4305, SciTePress, pages 857-863. DOI: 10.5220/0010973500003123

@conference{whc22,
author={Beauclair Dongmo Ngnintedem. and Eric Mense. and Johannes Rückert. and Christoph M. Friedrich.},
title={Classification and Direction Detection of Ambient Sounds on Microsoft HoloLens to Support Hearing-impaired People},
booktitle={Proceedings of the 15th International Joint Conference on Biomedical Engineering Systems and Technologies - WHC},
year={2022},
pages={857-863},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010973500003123},
isbn={978-989-758-552-4},
issn={2184-4305},
}

TY - CONF

JO - Proceedings of the 15th International Joint Conference on Biomedical Engineering Systems and Technologies - WHC
TI - Classification and Direction Detection of Ambient Sounds on Microsoft HoloLens to Support Hearing-impaired People
SN - 978-989-758-552-4
IS - 2184-4305
AU - Ngnintedem, B.
AU - Mense, E.
AU - Rückert, J.
AU - Friedrich, C.
PY - 2022
SP - 857
EP - 863
DO - 10.5220/0010973500003123
PB - SciTePress

- Science and Technology Publications, Lda.
RESOURCES

Proceedings

Papers

Authors

Ontology

CONTACTS

Science and Technology Publications, Lda
Avenida de S. Francisco Xavier, Lote 7 Cv. C,
2900-616 Setúbal, Portugal.

Phone: +351 265 520 185 (National fixed network call)
Fax: +351 265 520 186
Email: info@scitepress.org

EXTERNAL LINKS

PRIMORIS

INSTICC

SCITEVENTS

CROSSREF

PROCEEDINGS SUBMITTED FOR INDEXATION BY:

dblp

Ei Compendex

SCOPUS

Semantic Scholar

Google Scholar

Microsoft Academic