Skip to main content

High Performance BCI in Controlling an Avatar Using the Missing Hand Representation in Long Term Amputees

  • Chapter
  • First Online:
Brain-Computer Interface Research

Part of the book series: SpringerBriefs in Electrical and Computer Engineering ((BRIEFSELECTRIC))

Abstract

Brain-computer interfaces (BCIs) have been employed to provide different patient groups with communication and control that does not require the use of limbs that have been damaged. In this study, we explored BCI-based navigation in three long term amputees. Each participant attempted motor execution with the affected limb, and performed motor execution with the intact limb, while fMRI activity was recorded. Participants attempted, and executed, one of four tasks to direct the movement of an avatar on a monitor. Classification accuracy was very high across both cue-based and free-choice conditions. Results support the use of this fMRI BCI approach for virtual navigation, which could improve BCIs based on fMRI as well as other approaches such as EEG.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. J. Wolpaw, E.W. Wolpaw (eds.), Brain-Computer Interfaces: Principles and Practice (OUP, USA, 2012)

    Google Scholar 

  2. C.S. Nam, A. Nijholt, F. Lotte (eds.), Brain–Computer Interfaces Handbook: Technological and Theoretical Advances (CRC Press, 2018)

    Google Scholar 

  3. O. Cohen, M. Koppel, R. Malach, D. Friedman, Controlling an avatar by thought using real-time fMRI. J. Neural Eng. 11(3), 035006 (2014)

    Article  Google Scholar 

  4. P. Andersson, J.P. Pluim, M.A. Viergever, N.F. Ramsey, Navigation of a telepresence robot via covert visuospatial attention and real-time fMRI. Brain Topogr. 26(1), 177–85 (2013). https://doi.org/10.1007/s10548-012-0252-z

    Article  Google Scholar 

  5. O. Cohen, S. Druon, S. Lengagne, A. Mendelsohn, R. Malach, A. Kheddar, D. Friedman, fMRI-based robotic embodiment: controlling a humanoid robot by thought using real-time fMRI. Presence: Teleoperators and Virtual Environ. 23 (3), 229–241 (2014)

    Google Scholar 

  6. O. Cohen, M. Ramot, R. Malach, M. Koppel, D. Friedman, A generic machine-learning tool for online whole brain classification from fMRI, in The 6th International Brain-Computer Interface Conference, Graz, Austria (2014)

    Google Scholar 

  7. O. Cohen, R. Malach, M. Koppel, D. Friedman, Can amputees control a brain-computer interface with their missing hand? in Proceedings of the Sixth International Brain-Computer Interface Meeting: BCI Past, Present, and Future (Asilomar, California, 2016), p. 107

    Google Scholar 

  8. O. Cohen, D. Doron, M. Koppel, R. Malach, D. Friedman, High performance in brain-computer interface control of an avatar using the missing hand representation in long term amputees, in The 8th International IEEE EMBS Conference On Neural Engineering (NER17), Shanghai, China (2017)

    Google Scholar 

  9. D.C. Irimia, W. Cho, R. Ortner, B.Z. Allison, B.E. Ignat, G. Edlinger, C. Guger, Brain-computer interfaces with multi-sensory feedback for stroke rehabilitation: a case study. Artif. Organs 41(11), E178–E184 (2017). https://doi.org/10.1111/aor.13054

    Article  Google Scholar 

  10. L. Acqualagna, L. Botrel, C. Vidaurre, A. Kübler, B. Blankertz, Large-scale assessment of a fully automatic co-adaptive motor imagery-based brain computer interface. PLoS ONE 11(2), e0148886 (2016). https://doi.org/10.1371/journal.pone.0148886

    Article  Google Scholar 

  11. C. Neuper, R. Scherer, M. Reiner, G. Pfurtscheller, Imagery of motor actions: differential effects of kinesthetic and visual-motor mode of imagery in single-trial EEG. Brain Res. Cogn. Brain Res. 25(3), 668–77 (2005)

    Article  Google Scholar 

Download references

Acknowledgements

This research was supported by the European Union FP7 Integrated Project VERE (No. 657295), http://www.vereproject.eu. We would like to thank the subjects for their participation, and the Weizmann Institute fMRI scanner staff Edna Furman-Haran, Nachum Stern and Fanny Attar for their help in this experiment.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Doron Friedman .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 The Author(s), under exclusive licence to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Cohen, O., Doron, D., Koppel, M., Malach, R., Friedman, D. (2019). High Performance BCI in Controlling an Avatar Using the Missing Hand Representation in Long Term Amputees. In: Guger, C., Mrachacz-Kersting, N., Allison, B. (eds) Brain-Computer Interface Research. SpringerBriefs in Electrical and Computer Engineering. Springer, Cham. https://doi.org/10.1007/978-3-030-05668-1_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-05668-1_9

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-05667-4

  • Online ISBN: 978-3-030-05668-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics