Loading [a11y]/accessibility-menu.js
Overcoming The Impact of Different Materials on Optical Microphones For Speech Capture Using Deep Learning | IEEE Conference Publication | IEEE Xplore

Overcoming The Impact of Different Materials on Optical Microphones For Speech Capture Using Deep Learning


Abstract:

This study analyzes changes in vibration characteristics produced by different materials for the same audio signal through acoustic analysis. A deep learning model combin...Show More

Abstract:

This study analyzes changes in vibration characteristics produced by different materials for the same audio signal through acoustic analysis. A deep learning model combined with training data is employed to mitigate problems and reduce the impact of spectral differences in speech signals recorded using laser Doppler vibrometer on different materials and convert them into high-quality speech output. Results demonstrate that (1) different materials cause variability in the vibration signals produced by the same audio signal and (2) deep learning models can address the challenges posed by material variability through appropriate training data. Furthermore, integrating deep learning with suitable training data helps overcome these challenges. This study suggests that the speech signal variability caused by materials in optical microphones is analogous to the channeleffect problem in traditional microphone signal processing. Future studies should reference methods for addressing channel effects in microphones to enhance the efficiency of speech-capture technology in optical microphones.
Date of Conference: 17-19 October 2024
Date Added to IEEE Xplore: 20 December 2024
ISBN Information:

ISSN Information:

Conference Location: Hsinchu City, Taiwan

Funding Agency:


Contact IEEE to Subscribe

References

References is not available for this document.