ABSTRACT
In this paper, we present a media adaptation framework for an immersive biofeedback system for stroke patient rehabilitation. In our biofeedback system, media adaptation refers to changes in audio/visual feedback as well as changes in physical environment. Effective media adaptation frameworks help patients recover generative plans for arm movement with potential for significantly shortened therapeutic time. The media adaptation problem has significant challenges - (a) high dimensionality of adaptation parameter space (b) variability in the patient performance across and within sessions(c) the actual rehabilitation plan is typically a non first-order Markov process, making the learning task hard.
Our key insight is to understand media adaptation as a real-time feedback control problem. We use a mixture-of-experts based Dynamic Decision Network (DDN) for online media adaptation. We train DDN mixtures per patient, per session. The mixture models address two basic questions - (a) given a specific adaptation suggested by the domain expert, predict patient performance and (b) given an expected performance, determine optimal adaptation decision. The questions are answered through an optimality criterion based search on DDN models trained in previous sessions. We have also developed new validation metrics and have very good results for both questions on actual stroke rehabilitation data.
Supplemental Material
- Y. CHEN, H. HUANG, W. XU, et al. (2006). The Design Of A Real-Time, Multimodal Biofeedback System For Stroke Patient Rehabilitation, SIG ACM Multimedia, Santa Barbara, CA, Oct. 2006. Google ScholarDigital Library
- A. DEMPSTER, N. LAIRD and D. RUBIN (1977). Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society 39(1): 1--38.Google Scholar
- R. O. DUDA, P. E. HART and D. G. STORK (2000). Pattern Classification, Wiley. Google ScholarDigital Library
- D. J. GROUT and C. V. PALISCA (2001). A history of western music. New York, Norton: xvi, 843, 816 of plates.Google Scholar
- M. HOLDEN, E. TODOROV, J. CALLAHAN, et al. (1999). Virtual environment training improves motor performance in two patients with stroke: case report. Neurology Report. 23: 57--67.Google ScholarCross Ref
- P. J. HUBER (1981). Robust Statistics, Wiley.Google Scholar
- D. JACK, R. BOIAN, A. S. MERIANS, et al. (2001). Virtual reality-enhanced stroke rehabilitation. IEEE Trans. Neural Syst Rehabil Eng 9: 308--318.Google ScholarCross Ref
- L. P. KAELBLING, M. L. LITTMAN and A. R. CASSANDRA (1998). Planning and acting in partiallly observable stochastic domains. Artificial Intelligence 101: 99--134. Google ScholarDigital Library
- K. MURPHY, A. TORRALBA and W. FREEMAN (2003). Using the Forest to See the Trees: A Graphical Model Relating Features, Objects and Scenes. Proc. NIPS'03 (Neural Info. Processing Systems). Whistler, Canada.Google Scholar
- S. RUSSELL and P. NORVIG (2003). Artificial Intelligence, A Modern Approach, Pearson Education, Inc. Google ScholarDigital Library
- G. THEOCHAROUS, K. MURPHY and L. P. KAELBLING (2004). Representing hierarchical POMDPs as DBNs for multi-scale robot localization, International Conference on Robotics and Automation, 2004.Google ScholarCross Ref
- L. XIE, S.-F. CHANG, A. DIVAKARAN, et al. (2003). Unsupervised Discovery of Multilevel Statistical Video Structures Using Hierarchical Hidden Markov Models. Proc. IEEE Conference on Multimedia and Expo 2003. Baltomore MD, USA. Google ScholarDigital Library
- W. XU, Y. CHEN, H. SUNDARAM, et al. (2006). Multimodal archiving, real-time collaborative annotation and information visualization in a biofeedback system for stroke patient rehabilitation, 3rd Workshop on Capture Archival, Retrieval of Personal Experiences, in Conjunction with ACMMM 06, Santa Barbara, CA, Oct. 2006. Google ScholarDigital Library
Index Terms
- Media adaptation framework in biofeedback system for stroke patient rehabilitation
Recommendations
A dynamic decision network framework for online media adaptation in stroke rehabilitation
In this article, we present a media adaptation framework for an immersive biofeedback system for stroke patient rehabilitation. In our biofeedback system, media adaptation refers to changes in audio/visual feedback as well as changes in physical ...
Evaluating rehabilitation exercise performance using a single inertial measurement unit
PervasiveHealth '13: Proceedings of the 7th International Conference on Pervasive Computing Technologies for HealthcareInertial measurement units (IMUs) may be used during exercise to provide feedback on exercise technique. However the number of IMUs that are required to deliver effective feedback during lower limb exercises has not yet been established. This ...
The impact of vibrotactile biofeedback on the excessive walking sway and the postural control in elderly
WH '13: Proceedings of the 4th Conference on Wireless HealthGait and postural control are important aspects of human movement and balance. Normal movement control in human is subject to change with aging when the nervous system, comprising somatosensory, visual senses, spatial orientation senses, and ...
Comments