Skip to main content
SpringerLink
Log in

Towards Automatic Cognitive Load Measurement from Speech Analysis

  • Conference paper
Book cover Human-Computer Interaction. Interaction Design and Usability (HCI 2007)

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 4550))

Included in the following conference series:

Abstract

Cognitive Load, as an indicator of pressure on working memory during task performing, attracts more and more research interests in recent years. By correctly measuring cognitive load levels, the system can adjust task procedure to maintain the cognitive load in an acceptable range; therefore, the subject can execute tasks more accurately and efficiently. Among many different cognitive load measuring approaches, speech-based measurement is effective due to its non-intrusive nature and possibility of online measurement. Most existing research on speech-based cognitive load measurement is based on manually extracted features, which prevent practical use. In this paper, some potential speech features, such as rate of pauses and rate of pitch peaks are investigated and proved to be effective. All feature extraction is based on automatic algorithm.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Mousavi, S.Y., Low, R., Sweller, J.: Reducing Cognitive Load by Mixing Auditory and Visual Presentation Modes. Journal of Educational Psychology 87(2), 319–334 (1995)

    Article  Google Scholar 

  2. Sweller, J., Merrienboer, J.J.G.v., Paas, F.G.W.C.: Cognitive Architecture and Instructional Design. Educational Psychology Review, 10(3) (1998)

    Google Scholar 

  3. Paas, F., Merrinboer, J.J.G.v.: Instructional Control of Cognitive Load in the Training of Complex Cognitive Tasks. Educational Psychology Review 6, 5171 (1994)

    Article  Google Scholar 

  4. Kahneman, D.: Attention and Effort. Prentice Hall, New Jersey (1973)

    Google Scholar 

  5. Gevins, A., Smith, M.E.: Neurophysiological Measures of Working Memory and Individual Differences. In: Cognitive Ability and Cognitive Style Cerebral Cortex, vol. 10(9), pp. 829–839 (2000)

    Google Scholar 

  6. Scerbo, M.S., et al.: The Efficacy of Psychophysiological Measures for Implementing Adaptive Technology. NASA Langley Research Center, Hampton (2001)

    Google Scholar 

  7. Roscoe, A.H.: Assessing Pilot Workload. Why measure heart rate, HRV and respiration? Biological Psychology (34), 259–287 (1992)

    Article  Google Scholar 

  8. O’Donnell, R.D., Eggemeier, F.T.: Workload Assessment Methodology. In: Cognitive processes and performance, vol. 42, pp. 1–49. Wiley, New York (1986)

    Google Scholar 

  9. Zijlstra, F.R.H., Doorn, L.v.: The construction of a scale to measure perceived effort. Department of Philosophy and Social Sciences. Delft University of Technology, Delft, Netherland (1985)

    Google Scholar 

  10. Hart, S.G., Staveland, L.E.: Development of NASA-TLX (Task Load Index): results of empirical and theoretical research. Human Mental Workload, pp. 139–183. North-holland, Amsterdam (1988)

    Google Scholar 

  11. Kettebekov, S.: Exploiting Prosodic Structuring of Coverbal Gesticulation. In: ICMI 2004, State College, PA, USA (2004)

    Google Scholar 

  12. Berthold, A., Jameson, A.: Interpreting Symptoms of Cognitive Load in Speech Input. In: UM 1999 (1999)

    Google Scholar 

  13. Müller, C., et al.: Recognizing Time Pressure and Cognitive Load on the Basis of Speech: An Experimental Study. In: UM 2001 (2001)

    Google Scholar 

  14. Jameson, A., et al.: Assessment of a User’s Time Pressure and Cognitive Load on the Basis of Features of Speech. Journal of Computer Science and Technology (2006)

    Google Scholar 

  15. Oviatt, S., Coulston, R., Lunsford, R.: When Do We Interact Multimodally? Cognitive Load and Multimodal Communication Patterns. In: ICMI 2004, State College, Pennsylvania, USA (2004)

    Google Scholar 

  16. SPSS Inc. http://www.spss.com

Download references

Author information

Authors and Affiliations

  1. School of Electrical Engineering and Telecommunications, The University of New South Wales, Sydney, NSW 2052, Australia

    Bo Yin & Fang Chen

  2. National ICT Australia (NICTA), Australian Technology Park, Eveleigh 1430, Australia

    Fang Chen

Authors
  1. Bo Yin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Fang Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Julie A. Jacko

Rights and permissions

Reprints and permissions

Copyright information

© 2007 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Yin, B., Chen, F. (2007). Towards Automatic Cognitive Load Measurement from Speech Analysis. In: Jacko, J.A. (eds) Human-Computer Interaction. Interaction Design and Usability. HCI 2007. Lecture Notes in Computer Science, vol 4550. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73105-4_111

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-73105-4_111

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-73104-7

  • Online ISBN: 978-3-540-73105-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation