Skip to main content
SpringerLink
Log in
Book cover

International Conference on Neural Information Processing

ICONIP 2012: Neural Information Processing pp 210–217Cite as

Neural and Speech Indicators of Cognitive Load for Sudoku Game Interfaces

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 7663))

Abstract

In the evaluation of human-computer interfaces, numerous active measures, such as EEGs and eye tracking analysis, have been frequently deployed to help determine the cognitive loads of system operators. However, less is known about the less-intrusive passive impact of, or interference by, speaker variations and speech characteristics in situations of diminishing mental resource availability within the context of interface evaluation. In this paper, we discuss the results of a Sudoku game experiment and the impact of interface variants on the vocal intensity and pitch frequency of players from diverse linguistic backgrounds. We demonstrate a strong relationship between brain activities, speech features and the user interface.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Kahneman, D.: Attention and effort. Prentice-Hall, Englewood Cliffs (1973)

    Google Scholar 

  2. Wickens, C.D.: Multiple Resource Time Sharing Model. In: Stanton, N.A., Salas, E., Hendrick, H.W., Hedge, A., Brookhuis, K. (eds.) Handbook of Human Factors and Ergonomics, pp. 40-1– 40-7. Taylor and Francis, London (2005)

    Google Scholar 

  3. Trimmel, M., Poelzl, G.: Impact of background noise on reaction time and brain DC potential changes of VDT-based spatial attention. Ergonomics 49(2) (2006)

    Google Scholar 

  4. Helton, W., Russell, P.: Working memory load and the vigilance decrement. Experimental Brain Research 212(3), 429–437 (2011)

    Article  Google Scholar 

  5. Abutalebi, J., Green, D.: Bilingual language production: The neurocognition of language representation and control. Journal of Neurolinguistics 20(3), 242–275 (2007)

    Article  Google Scholar 

  6. Abutalebi, J., Green, D.: Control mechanisms in bilingual language production: Neural evidence from language switching studies. Language and Cognitive Processes. 23(4) (2008)

    Google Scholar 

  7. Hernandez, A.E.: Language switching in the bilingual brain: What’s next? Brain and Language 109(2-3), 133–140 (2009)

    Article  Google Scholar 

  8. Blank, S.C., Scott, S.K., Murphy, K., Warburton, E., Wise, R.J.S.: Speech production: Wernicke, Broca and beyond. Brain 125(8), 1829–1838 (2002)

    Article  Google Scholar 

  9. Levelt, W.J.M.: Speaking: From Intention to Articulation. MIT Press (1989)

    Google Scholar 

  10. Costa, A., Hernández, M., Costa-Faidella, J., Sebastián-Gallés, N.: On the bilingual advantage in conflict processing: Now you see it, now you don’t. Cognition 113(2), 135–149 (2009)

    Article  Google Scholar 

  11. Kerns, J.G., Cohen, J.D., Stenger, V.A., Carter, C.S.: Prefrontal Cortex Guides Context-Appropriate Responding during Language Production. Neuron. 43(2), 283–291 (2004)

    Article  Google Scholar 

  12. Khawaja, A., Chen, F., Owen, C., Hickey, G.: Cognitive Load Measurement from User’s Linguistic Speech Features for Adaptive Interaction Design. In: Gross, T., Gulliksen, J., Kotzé, P., Oestreicher, L., Palanque, P., Prates, R.O., Winckler, M. (eds.) INTERACT 2009. LNCS, vol. 5726, pp. 485–489. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  13. Power, M.J.: A technique for measuring processing load during speech production. Journal of Psycholinguistic Research 15(5), 371–382 (1986)

    Article  Google Scholar 

  14. Oviatt, S.: Predicting spoken disfluencies during human–computer interaction. Computer Speech and Language 9(1), 19–35 (1995)

    Article  Google Scholar 

  15. Le, P.N., Ambikairajah, E., Epps, J., Sethu, V., Choi, E.C.H.: Investigation of spectral centroid features for cognitive load classification. Speech Communication 53(4), 540–551 (2011)

    Article  Google Scholar 

  16. Müller, C., Großmann-Hutter, B., Jameson, A., Rummer, R., Wittig, F.: Recognizing Time Pressure and Cognitive Load on the Basis of Speech: An Experimental Study. In: Bauer, M., Gmytrasiewicz, P.J., Vassileva, J. (eds.) UM 2001. LNCS (LNAI), vol. 2109, pp. 24–33. Springer, Heidelberg (2001)

    Chapter  Google Scholar 

  17. Baddeley, A.: The concept of working memory: A view of its current state and probable future development. Cognition 10, 17–23 (1981)

    Article  Google Scholar 

  18. Daneman, M., Green, I.: Individual differences in comprehending and producing words in context. Journal of Memory and Language 25, 1 (1986)

    Article  Google Scholar 

  19. Miller, G.A.: The magical number seven, plus or minus two: Some limits on our capacity for processing information. Psychological Review 63(2), 81–97 (1956)

    Article  Google Scholar 

  20. Daneman, M., Green, I.: Individual differences in comprehending and producing words in context. Journal of Memory and Language 25, 1 (1986)

    Article  Google Scholar 

  21. Lorist, M.M., Klein, M., Nieuwenhuis, S., de Jong, R., Mulder, G., Meijman, T.F.: Mental fatigue and task control: Planning and preparation. Psychophysiology 37, 614–625 (2000)

    Article  Google Scholar 

  22. Krajewski, J., Trutschel, U., Golz, M., Sommer, D., Edawrds, D.: Estimating Fatigue from Predetermined Speech Samples Transmitted by Operator Communication Systems. In: Driving Assessment Conference, Montana (2009)

    Google Scholar 

  23. Charlton, S.G.: Driving while conversing: Cell phones that distract and passengers who react. Accident Analysis & Prevention 41(1), 160–173 (2009)

    Article  Google Scholar 

  24. Huttunen, K., Keränen, H., Väyrynen, E., Pääkkönen, R., Leino, T.: Effect of cognitive load on speech prosody in aviation: Evidence from military simulator flights. Applied Ergonomics 42(2), 348–357 (2011)

    Article  Google Scholar 

  25. Luig, J., Sontacchi, A.: Workload monitoring through speech analysis: towards a system for air traffic control. In: ICAS 2010 – 27th International Congress of the Aeronautical Sciences, http://www.icas.org/icas_archive_cd1998-2010/icas2010/papers/669.pdf

  26. Stroop, J.R.: Studies of interference in serial verbal reactions. Journal of Experimental Psychology 12, 242–248 (1935)

    Google Scholar 

  27. Dyer, F.: The Stroop phenomenon and its use in the study of perceptual, cognitive, and response processes. Memory & Cognition 1(2), 106–120 (1973)

    Article  Google Scholar 

  28. Daneman, M.: Working Memory as a Predictor of Verbal Fluency. Journal of Psycholinguistic Research 20(6), 445–463 (1991)

    Article  Google Scholar 

  29. Wickens, C.D.: Multiple Resources and Mental Workload. Human Factors 50(3), 449–455 (2008)

    Article  Google Scholar 

  30. Boersma, P., Weenink, D.: Praat: doing phonetics by computer [Computer program]. Version 5.3.16, http://www.praat.org/ (retrieved May 23, 2012)

Download references

Author information

Authors and Affiliations

  1. School of Engineering and Information Technology, University of New South Wales, Canberra Campus, Australia

    Deborah C. Tuček, William M. Mount & Hussein A. Abbass

Authors
  1. Deborah C. Tuček
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. William M. Mount
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hussein A. Abbass
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Texas A&M University at Qatar, Education City, P.O. Box 23874, Doha, Qatar

    Tingwen Huang

  2. Department of Control Science and Engineering, Huazhong University of Science and Technology, 1037 Luoyu Road, 430074, Wuhan, Hubei, China

    Zhigang Zeng

  3. College of Computer Science, Chongqing University, 174 Shazhengjie Street, 400044, Chongqing, China

    Chuandong Li

  4. Department of Electronic Engineering, City University of Hong Kong, 83 Tat Chee Avenue, Kowloon, Hong Kong, China

    Chi Sing Leung

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Tuček, D.C., Mount, W.M., Abbass, H.A. (2012). Neural and Speech Indicators of Cognitive Load for Sudoku Game Interfaces. In: Huang, T., Zeng, Z., Li, C., Leung, C.S. (eds) Neural Information Processing. ICONIP 2012. Lecture Notes in Computer Science, vol 7663. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34475-6_26

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-34475-6_26

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-34474-9

  • Online ISBN: 978-3-642-34475-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation