Abstract
The appearance of unknown words often disturbs communication. Most work on unknown words in spoken dialog systems deals with words that are uttered by the user, but which are not covered by the system’s vocabulary. In this paper, we focus on detecting unknown words from the user side, in the case where the system utterance is unknown to the user. In particular, we develop a classifier based on Electroencephalography (EEG) signal from the user’s brain waves, including the use of absolute power and Event-Related Desynchronization (ERD) features. The results show that we could detect the characteristics of brain waves at the time of unknown word perception significantly better than the chance rate.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Hiruma N, Sagara K, Tanaka Y, Takeichi H, Yamashita O, Hasegawa R, Okabe T, Maeda T (2011) Brain communication: theory and application. IEICE Soc Conf 94(10):926
Kai A, Hirose Y, Nakagawa S (1998) Dealing with out-of-vocabulary words and speech disfluencies in an n-gram based speech understanding system. In: International conference on spoken language processing (ICSLP), vol 2, pp II–21
Klimesch W (1999) Eeg alpha and theta oscillations reflect cognitive and memory performance: a review and analysis. Brain Res Rev 29(2):169–195
Kondo T, Amano S, Sakamoto S, Suzuki Y (2008) Development of familiarity-controlled word-lists (fw07). IEICE Soc Conf Res Rep 107(432):43–48
Otake T, Hatano G, Cutler A, Mehler J (1993) Mora or syllable? speech segmentation in Japanese. J Mem Lang 32(2):258–278
Pfurtscheller G, Aranibar A (1977) Event-related cortical desynchronization detected by power measurements of scalp {EEG}. Electroencephalogr Clin Neurophysiol 42(6):817–826 doi:http://dx.doi.org/10.1016/0013-4694(77)90235-8. http://www.sciencedirect.com/science/article/pii/0013469477902358
Regel S (2009) The comprehension of figurative language: electrophysiological evidence on the processing of irony. Ph.D. thesis, Universitätsbibliothek
Sauseng P, Klimesch W, Gruber WR, Birbaumer N (2008) Cross-frequency phase synchronization: a brain mechanism of memory matching and attention. Neuroimage 40(1):308–317
Sederberg PB, Kahana MJ, Howard MW, Donner EJ, Madsen JR (2003) Theta and gamma oscillations during encoding predict subsequent recall. J Neurosci 23(34):10809–10814
Sridharan S, Chen YN, Chang KM, Rudnicky AI (2012) Neurodialog: an eeg-enabled spoken dialog interface. In: Proceedings of the 14th ACM international conference on multimodal interaction (ICMI ’12), pp 65–66
Young SR (1994) Detecting misrecognitions and out-of-vocabulary words. In: IEEE international conference on acoustics, speech, and signal processing (ICASSP), vol 2, pp II–21
Acknowledgements
Part of this work was supported by the Commissioned Research of National Institute of Information and Communications Technology (NICT) Japan, Microsoft CORE 10 Project, and JSPS KAKENHI Grant Number 26870371.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Sasakura, T., Sakti, S., Neubig, G., Toda, T., Nakamura, S. (2015). Unknown Word Detection Based on Event-Related Brain Desynchronization Responses. In: Lee, G., Kim, H., Jeong, M., Kim, JH. (eds) Natural Language Dialog Systems and Intelligent Assistants. Springer, Cham. https://doi.org/10.1007/978-3-319-19291-8_16
Download citation
DOI: https://doi.org/10.1007/978-3-319-19291-8_16
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-19290-1
Online ISBN: 978-3-319-19291-8
eBook Packages: Computer ScienceComputer Science (R0)