Martin Gjoreski
Mitja Luštrek
ABSTRACT
To prevent undesirable effects of attention grabbing at times when a user is occupied with a difficult task, ubiquitous computing devices should be aware of the user's cognitive load. However, inferring cognitive load is extremely challenging, especially when performed without obtrusive, expensive, and purpose-built equipment. In this study we examine the potential for inferring one's cognitive load using merely cheap wearable sensing devices. We subject 25 volunteers to varying cognitive load using six different Primary tasks. In parallel, we collect physiological data with a cheap device, extract features, and then construct machine learning models for cognitive load prediction. As metrics for the load we use one subjective measure, the NASA Task Load Index (NASA-TLX), and two objective measures: task difficulty and reaction time. The leave-one-subject-out evaluation shows a significant influence of the task type and the chosen cognitive load metric on the prediction accuracy.
- M.C. Ashton, K. Lee, M Perugini, P Szarota, R.E. de Vries, L Di Blas, K Boies, and B. De Raad. 2004. A six-factor structure of personality-descriptive adjectives: Solutions from psycholexical studies in seven languages: Solutions from psycholexical studies in seven languages. Journal of Personality and Social Psychology 86, 2 (2004), 356--366. ArticleGoogle Scholar
Cross Ref
- Jelmer P. Borst, Niels A. Taatgen, and Hedderik van Rijn. 2010. The Problem State: A Cognitive Bottleneck in Multitasking. Journal of Experimental Psychology: Learning, Memory, and Cognition 36, 2 (2010), 363--382.Google ScholarCross Ref
- Jelmer P. Borst, Niels A. Taatgen, and Hedderik van Rijn. 2015. What Makes Interruptions Disruptive?: A Process-Model Account of the Effects of the Problem State Bottleneck on Task Interruption and Resumption. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 2971--2980. Google ScholarDigital Library
- Krista E DeLeeuw and Richard E Mayer. 2008. A Comparison of Three Measures of Cognitive Load: Evidence for Separable Measures of Intrinsic, Extraneous, and Germane load. Journal of Educational Psychology 100, 1 (2008), 223--234.Google ScholarCross Ref
- Eija Haapalainen, SeungJun Kim, Jodi F. Forlizzi, and Anind K. Dey. 2010. Psycho-physiological Measures for Assessing Cognitive Load. In Proceedings of the 12th ACM International Conference on Ubiquitous Computing (UbiComp '10). ACM, New York, NY, USA, 301--310. Google ScholarDigital Library
- Sandra G. Hart and Lowell E. Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. Advances in Psychology 52 (1988), 139--183.Google ScholarCross Ref
- G. Jakus K. Novak, K. Stojmenova and J. Sodnik. 2017. Assessment of cognitive load through biometric monitoring. Society for Information Systems and Computer Networks, Ljubljana, Slovenia.Google Scholar
- Fred Paas, Juhani E Tuovinen, Huib Tabbers, and Pascal WM Van Gerven. 2003. Cognitive load measurement as a means to advance cognitive load theory. Educational psychologist 38, 1 (February 2003), 63--71.Google Scholar
- Rahul Rajan, Ted Selker, and Ian Lane. 2016. Task Load Estimation and Mediation Using Psycho-physiological Measures. In Proceedings of the 21st International Conference on Intelligent User Interfaces (IUI '16). ACM, New York, NY, USA, 48--59. Google ScholarDigital Library
- Dario D. Salvucci and Niels A. Taatgen. 2008. Threaded cognition: An integrated theory of concurrent multitasking. Psychological Review 115, 1 (January 2008), 101--130.Google ScholarCross Ref
- Florian Schaule, Jan Ole Johanssen, Bernd Bruegge, and Vivian Loftness. 2018. Employing Consumer Wearables to Detect Office Workers' Cognitive Load for Interruption Management. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2, 1, Article 32 (March 2018), 20 pages. Google ScholarDigital Library
- Florian Schmiedek, Martin Lövdén, and Ulman Lindenberger. 2014. A task is a task is a task: putting complex span, n-back, and other working memory indicators in psychometric context. Frontiers in psychology 5 (2014).Google Scholar
- Gašper Urh and Veljko Pejovic. 2016. TaskyApp: Inferring Task Engagement via Smartphone Sensing. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct (UbiComp '16). ACM, New York, NY, USA, 1548--1553. Google ScholarDigital Library
- Manuela Züger and Thomas Fritz. 2015. Interruptibility of Software Developers and Its Prediction Using Psycho-Physiological Sensors. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 2981--2990. Google ScholarDigital Library
Index Terms
- My Watch Says I'm Busy: Inferring Cognitive Load with Low-Cost Wearables
Recommendations
Leveraging smartwatches for unobtrusive mobile ambulatory mood assessment
UbiComp/ISWC'15 Adjunct: Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable ComputersIn ambulatory assessment, subjects are monitored in everyday life. Though, it is difficult to unobtrusively assess information -- e.g. about their context and affective state -- which results in an increased burden for the subjects. This burden is ...
Busy tone based coexistence algorithm for WRAN and WLAN systems in TV white space
TV White Space (TVWS) refers to frequency band reserved only for licensed terrestrial TV broadcasting and is opened to unlicensed use under regulatory conditions. While regulations protect licensed systems from interference, interference among unlicensed ...
Deep learning for cognitive load monitoring: a comparative evaluation
UbiComp/ISWC '20 Adjunct: Adjunct Proceedings of the 2020 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2020 ACM International Symposium on Wearable ComputersThe Cognitive Load Monitoring Challenge organized in the UbiTtention 2020 workshop tasked the research community with the problem of inferring a user's cognitive load from physiological measurements recorded by a low-cost wearable. This is challenging ...
Comments