skip to main content
10.1145/2702123.2702399acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Measuring Photoplethysmogram-Based Stress-Induced Vascular Response Index to Assess Cognitive Load and Stress

Published:18 April 2015Publication History

ABSTRACT

Quantitative assessment for cognitive load and mental stress is very important in optimizing human-computer system designs to improve performance and efficiency. Traditional physiological measures, such as heart rate variation (HRV), blood pressure and electrodermal activity (EDA), are widely used but still have limitations in sensitivity, reliability and usability. In this study, we propose a novel photoplethysmogram-based stress induced vascular index (sVRI) to measure cognitive load and stress. We also provide the basic methodology and detailed algorithm framework. We employed a classic experiment with three levels of task difficulty and three stages of testing period to verify the new measure. Compared with the blood pressure, heart rate and HRV components recorded simultaneously, the sVRI reached the same level of significance on the effect of task difficulty/period as the most significant other measure. Our findings showed sVRI's potential as a sensitive, reliable and usable parameter.

References

  1. Paas, F., Tuovinen, J.E., Tabbers, H., et al. Cognitive Load Measurement as a Means to Advance Cognitive Load Theory. Educ. Psychol. 38, 1 (2003), 63--71.Google ScholarGoogle ScholarCross RefCross Ref
  2. Oviatt, S. Human-centered design meets cognitive load theory: designing interfaces that help people think. In Proc. 14th ACM Multimedia, ACM (2006), 871--880. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Brouwer, A.-M., Hogervorst, M.A., Holewijn, M., et al. Evidence for effects of task difficulty but not learning on neurophysiological variables associated with effort. Int. J. Psychophysiol. 93, 2 (2014), 242--252.Google ScholarGoogle ScholarCross RefCross Ref
  4. Brunken, R., Plass, J.L., and Leutner, D. Direct Measurement of Cognitive Load in Multimedia Learning. Educ. Psychol. 38, 1 (2003), 53--61.Google ScholarGoogle Scholar
  5. Hernandez, J., Paredes, P., Roseway, A., et al. Under pressure: sensing stress of computer users. In Proc. CHI 2014, ACM (2014), 51--60. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Sun, D., Paredes, P., and Canny, J. MouStress: detecting stress from mouse motion. In Proc. CHI 2014, ACM (2014), 61--70. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Tan, C.S.S., Schning, J., Luyten, K., et al. Investigating the effects of using biofeedback as visual stress indicator during video-mediated collaboration. In Proc. CHI 2014, ACM (2014), 71--80. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Lazarus, R.S. Psychological stress and the coping process. McGraw-Hill (1966), New York.Google ScholarGoogle Scholar
  9. Hart, S.G. and Staveland, L.E. Development of NASATLX (Task Load Index): Results of Empirical and Theoretical Research. In Advances in Psychology, North-Holland (1988), 139--183.Google ScholarGoogle Scholar
  10. Verwey, W.B. and Veltman, H.A. Detecting short periods of elevated workload: A comparison of nine workload assessment techniques. J. Exp. Psychol. Appl. 2, 3 (1996), 270--285.Google ScholarGoogle ScholarCross RefCross Ref
  11. Matthews, G., Campbell, S.E., Falconer, S., et al. Fundamental dimensions of subjective state in performance settings: Task engagement, distress, and worry. Emotion 2, 4 (2002), 315--340.Google ScholarGoogle ScholarCross RefCross Ref
  12. Gao, Y., Bianchi-Berthouze, N., and Meng, H. What Does Touch Tell Us about Emotions in TouchscreenBased Gameplay? ACM Trans. Comput.-Hum. Interact. 19, 4 (2012), 1--30. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Dennerlein, J., Becker, T., Johnson, P., et al. Frustrating computer users increases exposure to physical factors. In Proceedings of the International Ergonomics Association, Seoul, Korea(2003).Google ScholarGoogle Scholar
  14. Kreibig, S.D. Autonomic nervous system activity in emotion: A review. Biol. Psychol. 84, 3 (2010), 394--421.Google ScholarGoogle ScholarCross RefCross Ref
  15. Berntson, G.G., Cacioppo, J.T., and Quigley, K.S. Autonomic determinism: The modes of autonomic control, the doctrine of autonomic space, and the laws of autonomic constraint. Psychological. Review 98, 4 (1991), 459--487.Google ScholarGoogle ScholarCross RefCross Ref
  16. Iani, C., Gopher, D., and Lavie, P. Effects of task difficulty and invested mental effort on peripheral vasoconstriction. Psychophysiology 41, 5 (2004), 789798.Google ScholarGoogle ScholarCross RefCross Ref
  17. Mulder, G. The concept and measurement of mental effort. In Energetics and human information processing, Springer (1986), 175--198.Google ScholarGoogle ScholarCross RefCross Ref
  18. Brouwer, A.-M., Hogervorst, M.A., Van Erp, J.B., et al. Estimating workload using EEG spectral power and ERPs in the n-back task. Journal of neural engineering 9, 4 (2012), 045008.Google ScholarGoogle Scholar
  19. Luo, L., Xiao, L., Miao, D., et al. The Relationship between Mental Stress Induced Changes in Cortisol Levels and Vascular Responses Quantified by Waveform Analysis: Investigating Stress-Dependent Indices of Vascular Changes. In ICBEB 2012, IEEE (2012), 929--933. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Hjortskov, N., Rissén, D., Blangsted, A.K., et al. The effect of mental stress on heart rate variability and blood pressure during computer work. Eur. J. Appl. Physiol. 92, 1--2 (2004), 84--89.Google ScholarGoogle ScholarCross RefCross Ref
  21. Bousefsaf, F., Maaoui, C., and Pruski, A. Remote detection of mental workload changes using cardiac parameters assessed with a low-cost webcam. Comput. Biol. Med. 53(2014), 154--163. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Yoo, K.-S. and Lee, W.-H. Mental stress assessment based on pulse photoplethysmography. In Proc. ISCE 2011, IEEE (2011), 323--326.Google ScholarGoogle ScholarCross RefCross Ref
  23. Chigira, H., Maeda, A., and Kobayashi, M. Area-based photo-plethysmographic sensing method for the surfaces of handheld devices. In Proc. UIST 2011, ACM (2011), 499--508. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Schäfer, A. and Vagedes, J. How accurate is pulse rate variability as an estimate of heart rate variability?: A review on studies comparing photoplethysmographic technology with an electrocardiogram. Int. J. Cardiol. 166, 1 (2013), 15--29.Google ScholarGoogle ScholarCross RefCross Ref
  25. Wijshoff, R.W.C.G.R., Veen, J., Van Der Lee, A.M., et al. PPG motion artifact handling using a self-mixing interferometric sensor. In SPIE2011, SPIE(2011), 78940F-78940F-78913.Google ScholarGoogle ScholarCross RefCross Ref
  26. Wijshoff, R.W.C.G.R., Mischi, M., Veen, J., et al. Reducing motion artifacts in photoplethysmograms by using relative sensor motion: phantom study. Journal of Biomedical Optics 17, 11 (2012), 117007--117007.Google ScholarGoogle ScholarCross RefCross Ref
  27. Chen, C.-C., Lin, S.-C., Young, M.-S., et al. Accumulated Mental Stress Study Using the Meridians of Traditional Chinese Medicine with Photoplethysmography. The Journal of Alternative and Complementary Medicine 20, 11 (2014), 860--867.Google ScholarGoogle ScholarCross RefCross Ref
  28. Ritter, F.E., Reifers, A.L., Klein, L.C., et al. Lessons from defining theories of stress for cognitive architectures. Integrated models of cognitive systems(2007), 254--262.Google ScholarGoogle Scholar

Index Terms

  1. Measuring Photoplethysmogram-Based Stress-Induced Vascular Response Index to Assess Cognitive Load and Stress

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems
      April 2015
      4290 pages
      ISBN:9781450331456
      DOI:10.1145/2702123

      Copyright © 2015 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 18 April 2015

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      CHI '15 Paper Acceptance Rate486of2,120submissions,23%Overall Acceptance Rate6,199of26,314submissions,24%

      Upcoming Conference

      CHI '24
      CHI Conference on Human Factors in Computing Systems
      May 11 - 16, 2024
      Honolulu , HI , USA

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader