Skip to main content

Experimental Evaluation of Heart-Based Workload Measures as Related to Their Suitability for Real-Time Applications

  • Conference paper
  • First Online:
Adaptive Instructional Systems (HCII 2020)

Abstract

We conducted an experiment to evaluate the viability of using heart rate parameters for real-time adaptation of applications to the mental state of human operators. The experiment consisted of a fast-jet flying task with secondary tasks in our simulator. We created five mission segments to induce differing levels of workload. During the experiment, heart rate data and subjective workload ratings were collected. The subjective workload ratings show different workload levels for each mission segment. However, from the considered heart rate parameters, we were only able to reproduce two of the known correlations from the literature; namely, average heart rate and high frequency activity of the heart rate variability. Additionally, we encountered the opposite of the expected relationships for the RMSSD of the heart rate as well as the standard deviation across the principal axis of the Poincaré plot. We suppose that the short time-frame, which we deemed necessary for real-time applications, is a possible explanation for our surprising results. Finally, we conclude that heart rate variability parameters may not be robust enough for real-time applications, especially as each measured parameter had participants who showed converse reactions to the average.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Young, M.S., Brookhuis, K.A., Wickens, C.D., Peter, A.: State of science: mental workload in ergonomics. Ergonomics 58(1), 1–17 (2015)

    Article  Google Scholar 

  2. Acker, C.E.: Higher mental workload is associated with poorer laparoscopic performance as measured by the NASA-TLX tool. Simul. Healthc. 5(5), 267–271 (2010)

    Article  Google Scholar 

  3. Svensson, E., Sjöberg, L., Olsson, S.: Information complexity-mental workload and performance in combat aircraft. Ergonomics 40, 0139 (2010)

    Google Scholar 

  4. Lyu, N., Xie, L., Wu, C., Fu, Q., Deng, C.: Driver’s cognitive workload and driving performance under traffic sign information exposure in complex environments: a case study of the highways in China, pp. 1–25 (2017)

    Google Scholar 

  5. Sarter, N.B., Woods, D.D., Billings, C.E.: “Automation Surprises”, Human Factors. Cognitive Systems Engineering Laboratory The Ohio State University, pp. 1–25 (1997)

    Google Scholar 

  6. Bainbridget, L.: Ironies of automation, vol. 19, no. 6 (1983)

    Google Scholar 

  7. Parasuraman, R., Riley, V.: Humans and automation: use, misuse, disuse, abuse. Hum. Fact. 39(2), 230–253 (1997)

    Article  Google Scholar 

  8. Brand, Y., Schulte, A.: Design and evaluation of a workload-adaptive associate system for cockpit crews task-based operationalization of the mental state as precursor of adaptive assistance (2018)

    Google Scholar 

  9. Mund, D., Pavlidis, E., Masters, M., Schulte, A.: A Conceptual augmentation of a pilot assistant system with physiological measures existing workload-estimation through task determination (2020)

    Google Scholar 

  10. Vuksanović, V., Gal, V.: Heart rate variability in mental stress aloud. Med. Eng. Phys. 29(3), 344–349 (2007)

    Article  Google Scholar 

  11. Roscoe, A.H.: Heart rate as a psychophysiological measure for in-flight workload assessment. Ergonomics 36(9), 1055–1062 (1993)

    Article  Google Scholar 

  12. Mehler, B., Reimer, B., Wang, Y.: A comparison of heart rate and heart rate variability indices in distinguishing single-task driving and driving under secondary cognitive workload, pp. 590–597 (2011)

    Google Scholar 

  13. Sereke, F.: Research Collection: Theses (2012)

    Google Scholar 

  14. Cinaz, B., La Marca, R., Arnrich, B., Tröster, G.: Monitoring of mental workload levels monitoring of mental workload levels, pp. 189–193 (2010)

    Google Scholar 

  15. Mukherjee, S., Yadav, R., Yung, I., Zajdel, D.P., Oken, B.S.: Sensitivity to mental effort and test-retest reliability of heart rate variability measures in healthy seniors. Clin. Neurophysiol. 122(10), 2059–2066 (2011)

    Google Scholar 

  16. Li, K., Rüdiger, H., Ziemssen, T.: Spectral analysis of heart rate variability: time window matters. Front. Neurol. 10(MAY), 1–12 (2019)

    Google Scholar 

  17. Hart, S.G.: NASA-task load index (NASA-TLX); 20 years later. In: Proceedings of Human Factors on Ergonomics Soceity, pp. 904–908 (2006)

    Google Scholar 

  18. “Biopac.” www.biopac.com

  19. Pan, J., Tompkins, W.J.: A real-time QRS detection algorithm. IEEE Trans. Biomed. Eng. 1(3), 230–236 (1985)

    Article  Google Scholar 

  20. Tarvainen, M.P., Niskanen, J.-P., Lipponen, J.A., Ranta-Aho, P.O., Karjalainen, P.A.: Kubios HRV–heart rate variability analysis software. Comput. Methods Programs Biomed. 113(1), 210–220 (2014)

    Article  Google Scholar 

  21. Baevsky, R.M., Chernikova, A.G.: Heart rate variability analysis: physiological foundations and main methods (2017)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Dennis Mund .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Mund, D., Schulte, A. (2020). Experimental Evaluation of Heart-Based Workload Measures as Related to Their Suitability for Real-Time Applications. In: Sottilare, R.A., Schwarz, J. (eds) Adaptive Instructional Systems. HCII 2020. Lecture Notes in Computer Science(), vol 12214. Springer, Cham. https://doi.org/10.1007/978-3-030-50788-6_27

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-50788-6_27

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-50787-9

  • Online ISBN: 978-3-030-50788-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics