research-article

An approach towards human-robot-human interaction using a hybrid brain-computer interface

Authors:

Nils Hachmeister,

Hannes Riechmann,

Helge Ritter,

Andrea FinkeAuthors Info & Claims

ICMI '11: Proceedings of the 13th international conference on multimodal interfaces

Pages 49 - 52

https://doi.org/10.1145/2070481.2070492

Published: 14 November 2011 Publication History

Get Access

Abstract

We propose the concept of a brain-computer interface interaction system that allows patients to virtually use non-verbal interaction affordances, in particular gestures and facial expressions, by means of a humanoid robot. Here, we present a pilot study on controlling such a robot via a hybrid BCI. The results indicate that users can intuitively address interaction partners by looking in their direction and employ gestures and facial expressions in every-day interaction situations.

References

[1]

C.J. Bell, P. Shenoy, R. Chalodhorn, and R.P.N. Rao. Control of a humanoid robot by a noninvasive brain-computer interface in humans. Journal of Neural Engineering, 5(2):214--220, 2008.

Crossref

Google Scholar

[2]

A. Bernardino, R. Nunes, L. Vargas, R. Beira, M. Lopes, and J. Santos-Victor. Facial expressions: Design and integration. Technical report, Universidade Técnica de Lisboa, Instituto Superior Técnico (IST), March 2007.

Google Scholar

[3]

A. Chapanis, R.N. Parrish, R.B. Ochsman, and G.D. Weeks. Studies in interactive communication: II. The effects of four communication modes on the linguistic performance of teams during cooperative problem solving. Human Factors: The Journal of the Human Factors and Ergonomics Society, 19(2):101--126, 1977.

Crossref

Google Scholar

[4]

S.R. Hiltz, K. Johnson, and M. Turoff. Experiments in group decision making communication process and outcome in face-to-face versus computerized conferences. Human Communication Research, 13(2):225--252, 1986.

Crossref

Google Scholar

[5]

A. Kübler, B. Kotchoubey, J. Kaiser, J. Perelmouter, J. Wolpaw, and N. Birbaumer. Brain-computer interface: Unlocking the locked-in. Psychological Bulletin, 127(3):358--375, 2001.

Crossref

Google Scholar

[6]

G. Metta, G. Sandini, D. Vernon, L. Natale, and F. Nori. The iCub humanoid robot: an open platform for research in embodied cognition. In Proceedings of the 8th Workshop on Performance Metrics for Intelligent Systems, PerMIS '08, pages 50--56, New York, NY, USA, 2008. ACM.

Digital Library

Google Scholar

[7]

E. Paulos and J. Canny. PRoP: personal roving presence. In Proceedings of the SIGCHI conference on Human factors in computing systems, pages 296--303. ACM Press/Addison-Wesley Publishing Co., 1998.

Digital Library

Google Scholar

[8]

H. Riechmann, N. Hachmeister, H. Ritter, and A. Finke. Asynchronous, parallel on-line classification of P300 and ERD for an efficient hybrid BCI. In Proceedings of the 5th International IEEE EMBS Conference on Neural Engineering, in press.

Google Scholar

[9]

S. Whittaker. Theories and methods in mediated communication. The handbook of discourse processes, pages 243--286, 2003.

Google Scholar

Cited By

View all

Putze FPutze SSagehorn MMicek CSolovey E(2022)Understanding HCI Practices and Challenges of Experiment Reporting with Brain Signals: Towards Reproducibility and ReuseACM Transactions on Computer-Human Interaction10.1145/349055429:4(1-43)Online publication date: 31-Mar-2022
https://dl.acm.org/doi/10.1145/3490554
Riechmann HFinke ARitter H(2016)Using a cVEP-Based Brain-Computer Interface to Control a Virtual AgentIEEE Transactions on Neural Systems and Rehabilitation Engineering10.1109/TNSRE.2015.249062124:6(692-699)Online publication date: Jun-2016
https://doi.org/10.1109/TNSRE.2015.2490621
Kosmyna NTarpin-Bernard FCouture NBastien CDorta T(2014)A combination of brain-computer interaction and eye tracking paradigmes for multimodal interactionProceedings of the 2014 Ergonomie et Informatique Avancée Conference - Design, Ergonomie et IHM: quelle articulation pour la co-conception de l'interaction10.1145/2671470.2671486(110-113)Online publication date: 15-Oct-2014
https://dl.acm.org/doi/10.1145/2671470.2671486
Show More Cited By

Index Terms

An approach towards human-robot-human interaction using a hybrid brain-computer interface

Recommendations

Brain-Computer Interface Humanoid Pre-trained for Interaction with People
HRI '18: Companion of the 2018 ACM/IEEE International Conference on Human-Robot Interaction

This study presents a Brain-Computer Interface (BCI) based remotepresence system for humanoid NAO robot. The system would beuseful for partially or fully paralyzed patients to interact with peo-ple and live active social life. A P300 based BCI is used ...
Towards the detection of error-related potentials and its integration in the context of a P300 speller brain-computer interface

A P300 Speller is a brain-computer interface (BCI) that enables subjects to spell text on a computer screen by detecting P300 Event-Related Potentials in their electroencephalograms (EEG). This BCI application is of particular interest to disabled ...
Towards ambulatory brain-computer interfaces: a pilot study with P300 signals
ACE '09: Proceedings of the International Conference on Advances in Computer Entertainment Technology

Brain-Computer Interfaces (BCI) are communication systems that enable users to interact with computers using only brain activity. This activity is generally measured by ElectroEncephaloGraphy (EEG). A major limitation of BCI is the electrical ...

Comments

Information & Contributors

Information

Published In

ICMI '11: Proceedings of the 13th international conference on multimodal interfaces

November 2011

432 pages

ISBN:9781450306416

DOI:10.1145/2070481

General Chairs:
Hervé Bourlard
Idiap Research Institute, Switzerland
,
Thomas S. Huang
University of Illinois, USA
,
Enrique Vidal
Universitat Politécnica Valéncia, Spain
,
Program Chairs:
Daniel Gatica-Perez
Idiap Research Institute, Switzerland
,
Louis-Philippe Morency
University of Southern California, USA
,
Nicu Sebe
University of Trento, Italy

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 November 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICMI'11

Sponsor:

SIGCHI

ICMI'11: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION

November 14 - 18, 2011

Alicante, Spain

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
285
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)1

Reflects downloads up to 25 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Putze FPutze SSagehorn MMicek CSolovey E(2022)Understanding HCI Practices and Challenges of Experiment Reporting with Brain Signals: Towards Reproducibility and ReuseACM Transactions on Computer-Human Interaction10.1145/349055429:4(1-43)Online publication date: 31-Mar-2022
https://dl.acm.org/doi/10.1145/3490554
Riechmann HFinke ARitter H(2016)Using a cVEP-Based Brain-Computer Interface to Control a Virtual AgentIEEE Transactions on Neural Systems and Rehabilitation Engineering10.1109/TNSRE.2015.249062124:6(692-699)Online publication date: Jun-2016
https://doi.org/10.1109/TNSRE.2015.2490621
Kosmyna NTarpin-Bernard FCouture NBastien CDorta T(2014)A combination of brain-computer interaction and eye tracking paradigmes for multimodal interactionProceedings of the 2014 Ergonomie et Informatique Avancée Conference - Design, Ergonomie et IHM: quelle articulation pour la co-conception de l'interaction10.1145/2671470.2671486(110-113)Online publication date: 15-Oct-2014
https://dl.acm.org/doi/10.1145/2671470.2671486
Hachmeister NFinke ARitter H(2014)Does machine-mediated interaction induce inter-brain synchrony? — A hyperscanning study2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society10.1109/EMBC.2014.6943766(1018-1021)Online publication date: Aug-2014
https://doi.org/10.1109/EMBC.2014.6943766
Kos'myna NTarpin-Bernard F(2013)Evaluation and Comparison of a Multimodal Combination of BCI Paradigms and Eye Tracking With Affordable Consumer-Grade Hardware in a Gaming ContextIEEE Transactions on Computational Intelligence and AI in Games10.1109/TCIAIG.2012.22300035:2(150-154)Online publication date: Jun-2013
https://doi.org/10.1109/TCIAIG.2012.2230003
Finke AHachmeister NRiechmann HRitter H(2013)Thought-controlled robots - Systems, studies and future challenges2013 IEEE International Conference on Robotics and Automation10.1109/ICRA.2013.6631052(3403-3408)Online publication date: May-2013
https://doi.org/10.1109/ICRA.2013.6631052
Finke ARudgalwis BJakusch HRitter H(2012)Towards multi-user brain-robot interfaces for humanoid robot control2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012)10.1109/HUMANOIDS.2012.6651571(532-537)Online publication date: Nov-2012
https://doi.org/10.1109/HUMANOIDS.2012.6651571

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Brain-Computer Interface Humanoid Pre-trained for Interaction with People

Towards the detection of error-related potentials and its integration in the context of a P300 speller brain-computer interface

Towards ambulatory brain-computer interfaces: a pilot study with P300 signals

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations