skip to main content
10.1145/1291233.1291248acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
Article

Media adaptation framework in biofeedback system for stroke patient rehabilitation

Published:29 September 2007Publication History

ABSTRACT

In this paper, we present a media adaptation framework for an immersive biofeedback system for stroke patient rehabilitation. In our biofeedback system, media adaptation refers to changes in audio/visual feedback as well as changes in physical environment. Effective media adaptation frameworks help patients recover generative plans for arm movement with potential for significantly shortened therapeutic time. The media adaptation problem has significant challenges - (a) high dimensionality of adaptation parameter space (b) variability in the patient performance across and within sessions(c) the actual rehabilitation plan is typically a non first-order Markov process, making the learning task hard.

Our key insight is to understand media adaptation as a real-time feedback control problem. We use a mixture-of-experts based Dynamic Decision Network (DDN) for online media adaptation. We train DDN mixtures per patient, per session. The mixture models address two basic questions - (a) given a specific adaptation suggested by the domain expert, predict patient performance and (b) given an expected performance, determine optimal adaptation decision. The questions are answered through an optimality criterion based search on DDN models trained in previous sessions. We have also developed new validation metrics and have very good results for both questions on actual stroke rehabilitation data.

Skip Supplemental Material Section

Supplemental Material

p37-47_150k.mp4

mp4

83 MB

p37-47_768k.mp4

mp4

257.3 MB

References

  1. Y. CHEN, H. HUANG, W. XU, et al. (2006). The Design Of A Real-Time, Multimodal Biofeedback System For Stroke Patient Rehabilitation, SIG ACM Multimedia, Santa Barbara, CA, Oct. 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. A. DEMPSTER, N. LAIRD and D. RUBIN (1977). Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society 39(1): 1--38.Google ScholarGoogle Scholar
  3. R. O. DUDA, P. E. HART and D. G. STORK (2000). Pattern Classification, Wiley. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. D. J. GROUT and C. V. PALISCA (2001). A history of western music. New York, Norton: xvi, 843, 816 of plates.Google ScholarGoogle Scholar
  5. M. HOLDEN, E. TODOROV, J. CALLAHAN, et al. (1999). Virtual environment training improves motor performance in two patients with stroke: case report. Neurology Report. 23: 57--67.Google ScholarGoogle ScholarCross RefCross Ref
  6. P. J. HUBER (1981). Robust Statistics, Wiley.Google ScholarGoogle Scholar
  7. D. JACK, R. BOIAN, A. S. MERIANS, et al. (2001). Virtual reality-enhanced stroke rehabilitation. IEEE Trans. Neural Syst Rehabil Eng 9: 308--318.Google ScholarGoogle ScholarCross RefCross Ref
  8. L. P. KAELBLING, M. L. LITTMAN and A. R. CASSANDRA (1998). Planning and acting in partiallly observable stochastic domains. Artificial Intelligence 101: 99--134. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. K. MURPHY, A. TORRALBA and W. FREEMAN (2003). Using the Forest to See the Trees: A Graphical Model Relating Features, Objects and Scenes. Proc. NIPS'03 (Neural Info. Processing Systems). Whistler, Canada.Google ScholarGoogle Scholar
  10. S. RUSSELL and P. NORVIG (2003). Artificial Intelligence, A Modern Approach, Pearson Education, Inc. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. G. THEOCHAROUS, K. MURPHY and L. P. KAELBLING (2004). Representing hierarchical POMDPs as DBNs for multi-scale robot localization, International Conference on Robotics and Automation, 2004.Google ScholarGoogle ScholarCross RefCross Ref
  12. L. XIE, S.-F. CHANG, A. DIVAKARAN, et al. (2003). Unsupervised Discovery of Multilevel Statistical Video Structures Using Hierarchical Hidden Markov Models. Proc. IEEE Conference on Multimedia and Expo 2003. Baltomore MD, USA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. W. XU, Y. CHEN, H. SUNDARAM, et al. (2006). Multimodal archiving, real-time collaborative annotation and information visualization in a biofeedback system for stroke patient rehabilitation, 3rd Workshop on Capture Archival, Retrieval of Personal Experiences, in Conjunction with ACMMM 06, Santa Barbara, CA, Oct. 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Media adaptation framework in biofeedback system for stroke patient rehabilitation

            Recommendations

            Comments

            Login options

            Check if you have access through your login credentials or your institution to get full access on this article.

            Sign in
            • Published in

              cover image ACM Conferences
              MM '07: Proceedings of the 15th ACM international conference on Multimedia
              September 2007
              1115 pages
              ISBN:9781595937025
              DOI:10.1145/1291233

              Copyright © 2007 ACM

              Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

              Publisher

              Association for Computing Machinery

              New York, NY, United States

              Publication History

              • Published: 29 September 2007

              Permissions

              Request permissions about this article.

              Request Permissions

              Check for updates

              Qualifiers

              • Article

              Acceptance Rates

              Overall Acceptance Rate995of4,171submissions,24%

              Upcoming Conference

              MM '24
              MM '24: The 32nd ACM International Conference on Multimedia
              October 28 - November 1, 2024
              Melbourne , VIC , Australia

            PDF Format

            View or Download as a PDF file.

            PDF

            eReader

            View online with eReader.

            eReader