skip to main content
10.1145/1180639.1180804acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
Article

The design of a real-time, multimodal biofeedback system for stroke patient rehabilitation

Published: 23 October 2006 Publication History

Abstract

This paper presents a novel real-time, multi-modal biofeedback system for stroke patient therapy. The problem is important as traditional mechanisms of rehabilitation are monotonous, and do not incorporate detailed quantitative assessment of recovery in addition to traditional clinical schemes. We have been working on developing an experiential media system that integrates task dependent physical therapy and cognitive stimuli within an interactive, multimodal environment. The environment provides a purposeful, engaging, visual and auditory scene in which patients can practice functional therapeutic reaching tasks, while receiving different types of simultaneous feedback indicating measures of both performance and results. There are three contributions of this paper - (a) identification of features and goals for the functional task (b) The development of sophisticated feedback (auditory and visual) mechanisms that match the semantics of action of the task. We additionally develop novel action-feedback coupling mechanisms. (c) New metrics to validate the ability of the system to promote learnability, stylization and engagement. We have validated the system for nine subjects with excellent results.

References

[1]
Motion Analysis Corporation http://www.motionanalysis.com.
[2]
M.C. CIRSTEA, A.B. MITNITSKI, A.G. FELDMAN and M.F. LEVIN (2003). Interjoint coordination dynamics during reaching in stroke. Exp Brain Res 151(3): 289--300.
[3]
S. COREN, L.M. WARD and J.T. ENNS (2003). Sensation and perception. John Wiley Hoboken, NJ.
[4]
C. GHEZ, T. RIKAKIS, R.L. DUBOIS and P. COOK (2000). An Auditory display system for aiding interjoint coordination, Proc. International Conference on Auditory Display, Apr. 2000, Atlanta, GA.
[5]
G.E. GRESHAM, P.W. DUNCAN and W.B.E.A. STASON (1996). Post-Stroke Rehabilitation/Clinical Practive Guideline. Aspen Publishers, Inc. Gaithersburg, Maryland.
[6]
D.J. GROUT and C.V. PALISCA (2001). A history of western music. Norton New York.
[7]
E.R. HILGARD and G.H. BOWER (1975). Recent developments. Theories of learning(eds). Englewood Cliffs, N.J., Prentice-Hall: 550--605.
[8]
M. HOLDEN and T. DYAR (2002). Virtual environment traing: a new tool for neurorehabilitation. Neurology Report 26(2): 62--72.
[9]
M. HOLDEN, E. TODOROV, J. CALLAHAN and E. BIZZI (1999). Virtual environment training imporves motor performance in two patients with stroke: case report. Neurology Report 23(2): 57--67.
[10]
H. HUANG, T. INGALLS, L. OLSON, K. GANLEY, T. RIKAKIS and J. HE (2005). Interactive Multimodal Biofeedback for Task-Oriented Neural Rehabilitation, 27th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, IEEE, Sep. 1st~4th, Shanghai, China.
[11]
A.S. MERIANS, D. JACK, R. BOIAN, M. TREMAINE, G.C. BURDEA, S.V. ADAMOVICH, M. RECCE and H. POIZNER (2002). Virtual reality-augmented rehabilitation for patients following stroke. Phys Ther 82(9): 898--915.

Cited By

View all
  • (2024)Surface Electromyography Biofeedback as an Adjuvant to Dysphagia Management: What It Is, What It Is Not, Why You Need It, and How to Get ItPerspectives of the ASHA Special Interest Groups10.1044/2023_PERSP-23-000769:6(1725-1736)Online publication date: 4-Dec-2024
  • (2023)Intercorporeal Biofeedback for Movement LearningACM Transactions on Computer-Human Interaction10.1145/358242830:3(1-40)Online publication date: 10-Jun-2023
  • (2023)A Mapping Review of Real-Time Movement Sonification Systems for Movement RehabilitationIEEE Reviews in Biomedical Engineering10.1109/RBME.2022.318784016(672-686)Online publication date: 2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MM '06: Proceedings of the 14th ACM international conference on Multimedia
October 2006
1072 pages
ISBN:1595934472
DOI:10.1145/1180639
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 October 2006

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. action-feedback coupling
  2. analysis
  3. biofeedback
  4. validation

Qualifiers

  • Article

Conference

MM06
MM06: The 14th ACM International Conference on Multimedia 2006
October 23 - 27, 2006
CA, Santa Barbara, USA

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)30
  • Downloads (Last 6 weeks)4
Reflects downloads up to 17 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Surface Electromyography Biofeedback as an Adjuvant to Dysphagia Management: What It Is, What It Is Not, Why You Need It, and How to Get ItPerspectives of the ASHA Special Interest Groups10.1044/2023_PERSP-23-000769:6(1725-1736)Online publication date: 4-Dec-2024
  • (2023)Intercorporeal Biofeedback for Movement LearningACM Transactions on Computer-Human Interaction10.1145/358242830:3(1-40)Online publication date: 10-Jun-2023
  • (2023)A Mapping Review of Real-Time Movement Sonification Systems for Movement RehabilitationIEEE Reviews in Biomedical Engineering10.1109/RBME.2022.318784016(672-686)Online publication date: 2023
  • (2022)The Occluded Prosthetic Hand can be Perceived based on Augmented Reality Technology2022 IEEE International Conference on Robotics and Biomimetics (ROBIO)10.1109/ROBIO55434.2022.10011661(1668-1672)Online publication date: 5-Dec-2022
  • (2022)Development of a biofeedback system using harmonic musical intervals to control heart rate variability with a generative adversarial networkBiomedical Signal Processing and Control10.1016/j.bspc.2021.10309571(103095)Online publication date: Jan-2022
  • (2021)Converging Robotic Technologies in Targeted Neural Rehabilitation: A Review of Emerging Solutions and ChallengesSensors10.3390/s2106208421:6(2084)Online publication date: 16-Mar-2021
  • (2019)Feedback Design in Targeted Exercise Digital Biofeedback Systems for Home Rehabilitation: A Scoping ReviewSensors10.3390/s2001018120:1(181)Online publication date: 28-Dec-2019
  • (2019)A Review on the Relationship Between Sound and Movement in Sports and RehabilitationFrontiers in Psychology10.3389/fpsyg.2019.0024410Online publication date: 12-Feb-2019
  • (2019)AUFLIP - An Auditory Feedback System Towards Implicit Learning of Advanced Motor SkillsExtended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290607.3312804(1-6)Online publication date: 2-May-2019
  • (2018)Embedding Mixed Reality in Humanitarian Logistics Gaming2018 IEEE International Conference on Teaching, Assessment, and Learning for Engineering (TALE)10.1109/TALE.2018.8615265(710-715)Online publication date: Dec-2018
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media