Abstract
In sensors fusion, “Context Dependent” fusion operators represent a very powerful approach. Most often, context is related to the reliability of the sensors. This approach is efficient if the estimation of the sensors reliability is itself reliable. We show how this has been done thanks to an optimal non-linear data transformation by ANN. An application in audio-visual speech recognition will illustrate this implementation.
This is a preview of subscription content, log in via an institution.
Preview
Unable to display preview. Download preview PDF.
References
A. Adjoudani, C. Benoit, “On the integration of auditory andvisual parameters in an HMM-based ASR,” in D.G. Stork & M.E. Hennecke (Eds.) Speechreading by Man and Machine: Models, Systems and Applications (pp. 461–472). NATO ASI Series, Springer, 1996
I. Bloch, “Information Combination Operators for Data Fusion: A Comparative review with Classification”, IEEE Trans on SMC, Part A, vol 26, n∘1, pp.52–67, january 1996.
Calliope, “La parole et son traitement automatique”. J.P. Tubach (Ed.). Paris: Masson, 1989.
P. Demartines, J. Hérault, “Curvilinear Component Analysis: A Self-Organizing Neural Network for Non Linear Mapping of Data Sets”, IEEE Trans on Neural Networks, January 1997.
A. Guérin-Dugué, P. Teissier, J.L. Schwartz, J. Hérault, « Non-linear representation for audio-visual fusion in a noisy-vowel recognition task », submitted to Neurap'97.
J. Robert-Ribes, J.L. Schwartz, P. Escudier, “A comparison of models for fusion of the auditory and visual sensors in speech perception”, Artificial Intelligence Review Journal, vol 9, pp. 323–346, 1995.
P. Teissier, “Fusion audiovisuelle avec prise en compte de l'environnement”, Rapport de DEA SIP, INPG, septembre 1995.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1997 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Guérin-Dugué, A., Teissier, P., Schwartz, JL., Hérault, J. (1997). Constrained neural network for estimating sensor reliability in sensors fusion. In: Mira, J., Moreno-Díaz, R., Cabestany, J. (eds) Biological and Artificial Computation: From Neuroscience to Technology. IWANN 1997. Lecture Notes in Computer Science, vol 1240. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0032547
Download citation
DOI: https://doi.org/10.1007/BFb0032547
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-63047-0
Online ISBN: 978-3-540-69074-0
eBook Packages: Springer Book Archive