Skip to main content
SpringerLink
Log in

Review of the Evaluation Methods of Mental Workload

  • Conference paper
  • First Online:
Advances in Physical Ergonomics and Human Factors (AHFE 2019)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 967))

Included in the following conference series:

  • 1335 Accesses

Abstract

The research of mental workload evaluation methods is a hotspot nowadays. At present, there are three main types of mental workload evaluation methods: subjective evaluation method, work performance evaluation method and physiological evaluation method. This paper introduces the three methods, summarizes their application, compares the three methods, summarizes their three advantages and disadvantages, and concludes that the future evaluation of mental workload will develop in the direction of combining various methods, make up for their shortcomings, give full play to their advantages, and better evaluate mental workload.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Dong, M., Yufeng, K., Feng, H.: Research on brain load detection and adaptive automation system based on physiological signals: 40 years review and RECENT progress. J. Electron. Meas. Instrum. 29(1), 1–13 (2015)

    Google Scholar 

  2. Jianqiao, L.: Brain load and its measurement. J. Syst. Eng. 3, 119–123 (1993)

    Google Scholar 

  3. Wilson, G.F.: Operator functional state assessment for adaptive automation implementation, 5797 (2005)

    Google Scholar 

  4. Knowles, W.B.: Operator loading tasks. Hum. Factors 5, 155–161 (1963)

    Article  Google Scholar 

  5. Cooper, G., Harper, R.: The use of pilot ratings in evaluation of aircraft hand ling qualities. NASA Ames Technical Report, NASA TN-D-5153. NASA Ames Research Center, Moffett Field, CA (1969)

    Google Scholar 

  6. Zhongqi, L., Xiuqian, Y., Tao, L.: Brain load measurement technology in aviation ergonomics. Ergonomics 9(2), 19–22 (2003)

    Google Scholar 

  7. Ishida, M.: Effect of all ocating attention to aversive events on cardiovascular responses and event-related potentials in dual-task paradigm. Int. J. Psychophysiol. 62, 93–102 (2006)

    Article  Google Scholar 

  8. DiDomenico, A., Nussbaum, M.A.: Interactive effects of mental and postural demands on subjective assessment of mental workload and postural stability. Saf. Sci. 43, 485–495 (2005)

    Article  Google Scholar 

  9. Tong, J.P.C., Duffy, V.G., Cross, G.W.: Evaluating the industrial ergonomics of service quality for on line recruitment websites. Int. J. Ind. Ergon. 35, 697–711 (2005)

    Article  Google Scholar 

  10. Matthews, R., Legg, S., Charlton, S.: The effect of cellphone type on drivers’ subjective workload during concurrent driving and conversing. Accid. Anal. Prev. 35, 451–457 (2003)

    Article  Google Scholar 

  11. Gawron, V.J.: Human Performance Measures Hand Book, pp. 13–53. Lawrence Erlbaum Associates, Mahwah, NJ (2000)

    Google Scholar 

  12. Baoshan, L., Jianqiao, L., Yuhong, W.: Research on the brain load assessment model for fighter pilots. Chin. J. Aerosp. Med. 11(1), 24–28 (2000)

    Google Scholar 

  13. Zhijun, Z., Zuxiang, Z.: Sensitivity of sub-mission tracking load. Chin. J. Aerosp. Med. 8(3), 154–157 (1997)

    Google Scholar 

  14. Recarte, M.A., Nunes, L.M.: Effects of verbal and spatial-imagery task on eye fixations while driving. J. Appl. Exp. Psychol. 6, 31–43 (2000)

    Article  Google Scholar 

  15. Recarte, M.A., Nunes, L.M.: Mental load and loss of control over speed in real driving. Towards a theory of attentional speed control. Transp. Res. 5, 111–112 (2005)

    Article  Google Scholar 

  16. Dingyu, L.: The development of mental workload measurement in flexible manufacturing systems. Hum. Factors Ergon. Manuf. 8(1), 41–62 (1998)

    Article  Google Scholar 

  17. Sauer, J.: Prospective memory: a secondary task with promise. Appl. Ergon. 31, 131–137 (2000)

    Article  Google Scholar 

  18. Spyker, D.A., Stackhouses, S.P., Khalafalla, A.S.: Development of techniques for measuring pilot workload. Citeseer (1971)

    Google Scholar 

  19. Ursin H., Ursin R.: Physiological Indicators of mental workload. In: Moray, N. (eds) Mental Workload. NATO Conference Series, vol. 8, pp. 349-365. Springer, Boston (1979)

    Chapter  Google Scholar 

  20. Shorst, R.L.: An overview of current approaches and future challenges in physiological monitoring (1987)

    Google Scholar 

  21. Zhao, L., Dong, Y.L., Guo, X.: Hybrid brain-computer interface system based on α wave and motor imagery. J. Electron. Meas. Instrum. 28(6), 625–629 (2014)

    Google Scholar 

  22. Gale, A.: Psychophysiology and the Electronic Workplace. Wiley, Hoboken (1987)

    Google Scholar 

  23. Sterman, M.B., Schummers, G.J.: Electroencephalographic correlates of pilot performance: Simulation and in-flight studies. DTIC Document (1988)

    Google Scholar 

  24. Wang, F., Wang, S.H.N., Wang, X.H.: Driving fatigue detection based on EEG recognition and vehicle handling characteristics. Chin. J. Sci. Instrum. 35(2), 398–404 (2015)

    Google Scholar 

  25. Wang, F.W., Wang, H.: EEG characteristic analysis of coach bus drivers in fatigue state. Chin. J. Sci. Instrum. 34(5), 1146–1152 (2013)

    Google Scholar 

  26. Ullsperger, P., Metz, A.M., Gille, H.G.: The P300 component of the event-related brain potential and mental effort. Ergonomics 31(8), 1127–1137 (1988)

    Article  Google Scholar 

  27. Strayer, D.L., Kramer, A.F.: Attentional requirements of automatic and controlled processing. J. Exp. Psychol.: Learn., Mem., Cogn. 16(1), 67 (1990)

    Google Scholar 

  28. Lu, H., Hong. W.: Classification of single-lead electroencephalogram signal P300. J. Instrum. 35(4), 814–819 (2014)

    Google Scholar 

  29. Wanyan, X., Zhuang, D., Zhang, H.: Improving pilot mental workload evaluation with combined measures. Bio-Med. Mater. Eng. 24(6), 2283–2290 (2014)

    Google Scholar 

  30. Zhang, H., Wanyan, X., Zhuang, D.: Study on comprehensive evaluation method of pilot mental workload. In: 6th International Conference on Intelligent Human-Machine Systems and Cybernetics (IHMSC 2014), vol. 1, pp. 110–113. IEEE, Hangzhou, China (2014)

    Google Scholar 

  31. Hankins, T.C., Wilson, G.F.: A comparison of heart rate, eye activity, EEG and subjective measures of pilot mental workload during flight. Aviat. Space Environ. Med. 69(4), 360–367 (1998)

    Google Scholar 

  32. Veltman, J.A.: A comparative study of psychophysiological reactions during simulator and real flight. Int. J. Aviat. Psychol. 12(1), 33–48 (2002)

    Article  Google Scholar 

  33. Beatty, J.: Task-evoked pupillary responses, processing load, and the structure of processing resources. Psychol. Bull. 91(2), 276 (1982)

    Article  Google Scholar 

  34. Fournier, L.R., Wilson, G.F., Swain, C.R.: Electrophysiological, behavioral and subjective indexes of workload when performing multiple tasks: manipulations of task difficulty and training. Int. J. Psychophysiol. 31(2), 129–145 (1999)

    Article  Google Scholar 

  35. Veltman, J.A., Gaillard, A.: Physiological workload reactions to increasing levels of task difficulty. Ergonomics 41(5), 656–669 (1998)

    Article  Google Scholar 

  36. Tattersall, A.J., Hockey, G.R.J.: Level of operator control and changes in heart rate variability during simulated flight maintenance. Hum. Factors: J. Hum. Factors Ergon. Soc. 37(4), 682–698 (1995)

    Article  Google Scholar 

  37. Backs, R.W., Lenneman, J.K., Sicard, J.L.: The use of autonomic components to improve Cardiovascular assessment of mental workload in flight. Int. J. Aviat. Psychol. 9(1), 33–47 (1999)

    Article  Google Scholar 

  38. Cui, K., Sun, L.Y., Sun, L.H.: The validity of heart rate variability of measuring mental workload. Ind. Eng. Manag. 3, 56–58 (2008)

    Google Scholar 

  39. Yao, Z.H., Wang, M.: The application of heart rate variability in the evaluation of mental workload during manual controlled rendezvous and docking. Chin. J. Ergon. 3, 1–5 (2013)

    Google Scholar 

  40. Hicks, T.G., Wierwille, W.W.: Comparison of five mental workload assessment procedures in a moving base driving simulator. Hum. Factors: J. Hum. Factors Ergon. Soc. 21(2), 129–143 (1979)

    Article  Google Scholar 

Download references

Acknowledgments

This research was supported by 2017NQI project (2017YFF0206603), General Administration of Quality Supervision, Inspection and Quarantine of the People’s Republic of China (AQSIQ) science and technology planning project (2016QK177) and Project of the President’s Fund for China National Institute of Standardization (522018Y-5984; 522016Y-4488).

Author information

Authors and Affiliations

  1. SAMR Key Laboratory of Human Factors and Ergonomics, Beijing, 102200, China

    Xiaoli Fan, Chaoyi Zhao & Huimin Hu

  2. China National Institute of Standardization, Beijing, 100191, China

    Xiaoli Fan, Chaoyi Zhao & Huimin Hu

  3. China Mobile Communications Corporation Government and Enterprise Service Company, Beijing, 100191, China

    Yuwei Jiang

Authors
  1. Xiaoli Fan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chaoyi Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Huimin Hu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yuwei Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chaoyi Zhao .

Editor information

Editors and Affiliations

  1. Department of IELM, Hong Kong University of Science and Technology, Kowloon, Hong Kong

    Ravindra S. Goonetilleke

  2. University of Central Florida, Winter Park, FL, USA

    Waldemar Karwowski

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Fan, X., Zhao, C., Hu, H., Jiang, Y. (2020). Review of the Evaluation Methods of Mental Workload. In: Goonetilleke, R., Karwowski, W. (eds) Advances in Physical Ergonomics and Human Factors. AHFE 2019. Advances in Intelligent Systems and Computing, vol 967. Springer, Cham. https://doi.org/10.1007/978-3-030-20142-5_17

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-20142-5_17

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-20141-8

  • Online ISBN: 978-3-030-20142-5

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation