skip to main content
10.1145/2388676.2388695acmconferencesArticle/Chapter ViewAbstractPublication Pagesicmi-mlmiConference Proceedingsconference-collections
demonstration

NeuroDialog: an EEG-enabled spoken dialog interface

Published: 22 October 2012 Publication History

Abstract

Understanding user intent is a difficult problem in Dialog Systems, as they often need to make decisions under uncertainty. Using an inexpensive, consumer grade EEG sensor and a Wizard-of-Oz dialog system, we show that it is possible to detect system misunderstanding even before the user reacts vocally. We also present the design and implementation details of NeuroDialog, a proof-of-concept dialog system that uses an EEG based predictive model to detect system misrecognitions during live interaction.

References

[1]
A. Nijholt and et al., Brain-Computer Interaction: Can Multimodality Help? In ICMI, 2011.
[2]
I. Bulykoa and et al., Error-correction detection and response generation in a spoken dialog system. In Speech Communication, 2005.
[3]
B. Dan and et al., Olympus: An Open sourse framework for converational spoken language research. In Dialog Technology workshop at HLT/NAACL, 2007.
[4]
NeuroSky, Brain Wave Signal (EEG): NeuroSky. Inc Neurosky, 2009.
[5]
D. L. Donoho, De-noising by soft-thresholding. IEEE Trans. on Infomation Theory, 1995.

Cited By

View all
  • (2017)Synthesizing Stroke Gestures Across User PopulationsProceedings of the 2017 CHI Conference on Human Factors in Computing Systems10.1145/3025453.3025906(4182-4193)Online publication date: 2-May-2017
  • (2015)Unknown Word Detection Based on Event-Related Brain Desynchronization ResponsesNatural Language Dialog Systems and Intelligent Assistants10.1007/978-3-319-19291-8_16(169-175)Online publication date: 2015

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
ICMI '12: Proceedings of the 14th ACM international conference on Multimodal interaction
October 2012
636 pages
ISBN:9781450314671
DOI:10.1145/2388676

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 October 2012

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. brain-computer interaction (bci)
  2. electroencephalogram (eeg)

Qualifiers

  • Demonstration

Conference

ICMI '12
Sponsor:
ICMI '12: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
October 22 - 26, 2012
California, Santa Monica, USA

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)1
  • Downloads (Last 6 weeks)0
Reflects downloads up to 16 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2017)Synthesizing Stroke Gestures Across User PopulationsProceedings of the 2017 CHI Conference on Human Factors in Computing Systems10.1145/3025453.3025906(4182-4193)Online publication date: 2-May-2017
  • (2015)Unknown Word Detection Based on Event-Related Brain Desynchronization ResponsesNatural Language Dialog Systems and Intelligent Assistants10.1007/978-3-319-19291-8_16(169-175)Online publication date: 2015

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media