research-article

Cognitive load assessment from facial temperature using smart eyewear

Authors:

Fangqing Zhengren,

George Chernyshov,

Dingding Zheng,

Kai KunzeAuthors Info & Claims

UbiComp/ISWC '19 Adjunct: Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers

Pages 657 - 660

https://doi.org/10.1145/3341162.3348391

Published: 09 September 2019 Publication History

Get Access

Abstract

In this paper we present an approach to detection and estimation of the cognitive load[8, 9] by measuring temperature changes of the forehead and the nose bridge using smart eyewear. The presented system consists of a pair of glasses with four temperature sensors attached. We have found signs of a correlation between the facial temperature changes and cognitive load using this approach, which makes it possible to develop a wearable device to quantitatively estimate cognitive engagement. Although are still working on investigating the effect on facial temperature from different types of cognitive tasks and different difficultly levels, we believe this approach could spark interesting discussions during the workshop.

References

[1]

Marc Germain, Michel Jobin, and Michel Cabanac. 1987. The effect of face fanning during recovery from exercise hyperthermia. Canadian journal of physiology and pharmacology 65, 1 (1987), 87--91.

Google Scholar

[2]

Curtis S Ikehara and Martha E Crosby. 2005. Assessing cognitive load with physiological sensors. In Proceedings of the 38th annual hawaii international conference on system sciences. IEEE, 295a--295a.

Digital Library

Google Scholar

[3]

Hiroo Iwata. 1988. Quantitative evaluation of mental work by thermography. Transactions of the Society of Instrument and Control Engineers 24, 2 (1988), 107--111.

Crossref

Google Scholar

[4]

Wayne K Kirchner. 1958. Age differences in short-term retention of rapidly changing information. Journal of experimental psychology 55, 4 (1958), 352.

Crossref

Google Scholar

[5]

Martijn JM Lamers, Ardi Roelofs, and Inge M Rabeling-Keus. 2010. Selective attention and response set in the Stroop task. Memory & Cognition 38, 7 (2010), 893--904.

Crossref

Google Scholar

[6]

Thomas V McCaffrey, RD McCook, and Robert D Wurster. 1975. Effect of head skin temperature on tympanic and oral temperature in man. Journal of Applied Physiology 39, 1 (1975), 114--118.

Crossref

Google Scholar

[7]

Tota Mizuno and Yuichiro Kume. 2015. Development of a Glasses-Like Wearable Device to Measure Nasal Skin Temperature. In International Conference on Human-Computer Interaction. Springer, 727--732.

Crossref

Google Scholar

[8]

John Sweller. 1988. Cognitive load during problem solving: Effects on learning. Cognitive science 12, 2 (1988), 257--285.

Google Scholar

[9]

John Sweller. 1989. Cognitive technology: Some procedures for facilitating learning and problem solving in mathematics and science. Journal of educational psychology 81, 4 (1989), 457.

Crossref

Google Scholar

[10]

Benjamin Tag, Ryan Mannschreck, Kazunori Sugiura, George Chernyshov, Naohisa Ohta, and Kai Kunze. 2017. Facial thermography for attention tracking on smart eyewear: An initial study. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 2959--2966.

Digital Library

Google Scholar

[11]

Huan Wang, Bonnie Wang, Kieran P Normoyle, Kevin Jackson, Kevin Spitler, Matthew F Sharrock, Claire M Miller, Catherine Best, Daniel Llano, and Rose Du. 2014. Brain temperature and its fundamental properties: a review for clinical neuroscientists. Frontiers in neuroscience 8 (2014), 307.

Google Scholar

[12]

Robert B Zajonc, Sheila T Murphy, and Marita Inglehart. 1989. Feeling and facial efference: Implications of the vascular theory of emotion. Psychological review 96, 3 (1989), 395.

Google Scholar

Cited By

View all

Zhu HMa LZhang FYang DUkai MHu S(2024)Mental Fatigue Under the Thermoneutral Environment in Buildings: Effects of the Constant and Altered Workload SequencesIndoor Air10.1155/2024/22109912024:1Online publication date: 24-Sep-2024
https://doi.org/10.1155/2024/2210991
Yan ZWu YZhang YChen X(2022)EmoGlass: an End-to-End AI-Enabled Wearable Platform for Enhancing Self-Awareness of Emotional HealthProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501925(1-19)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501925
Cesari VMarinari ELaurino MGemignani AMenicucci D(2021)Attention-Dependent Physiological Correlates in Sleep-Deprived Young Healthy HumansBehavioral Sciences10.3390/bs1102002211:2(22)Online publication date: 5-Feb-2021
https://doi.org/10.3390/bs11020022
Show More Cited By

Recommendations

Can Infrared Facial Thermography Disclose Mental Workload in Indoor Thermal Environments?
UrbSys'19: Proceedings of the 1st ACM International Workshop on Urban Building Energy Sensing, Controls, Big Data Analysis, and Visualization

Mental workload represents the mental resources an individual devotes to a task. In a building environment, understanding how ambient thermal conditions affect occupants' mental workload offers an opportunity to achieve optimal thermal settings for the ...
Indoor Temperature Fluctuation and Cooling Load Reduction Using Thermal Mass and Night Ventilation
CDCIEM '11: Proceedings of the 2011 International Conference on Computer Distributed Control and Intelligent Environmental Monitoring

The paper presents a qualitative effect of external thermal mass, night ventilation flow on cooling load reduction and indoor air temperature fluctuation at nighttime using thermal mass and night ventilation. A simple residential building model with air-...
Facial Gesture Classification with Few-shot Learning Using Limited Calibration Data from Photo-reflective Sensors on Smart Eyewear
MUM '24: Proceedings of the International Conference on Mobile and Ubiquitous Multimedia
This study investigates smart eyewear for facial gesture classification with low user calibration costs. The smart eyewear is equipped with low-cost, comfortable, energy-efficient photo-reflective sensors, which can detect changes in facial muscle ...

Comments

Information & Contributors

Information

Published In

September 2019

1234 pages

ISBN:9781450368698

DOI:10.1145/3341162

General Chairs:
Robert Harle
Cambridge University
,
Katayoun Farrahi
University Of Southampton
,
Nicholas Lane
University Of Oxford And Samsung Ai

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 September 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

UbiComp '19

Sponsor:

UbiComp '19: The 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing

September 9 - 13, 2019

London, United Kingdom

Acceptance Rates

Overall Acceptance Rate 764 of 2,912 submissions, 26%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
221
Total Downloads

Downloads (Last 12 months)16
Downloads (Last 6 weeks)1

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Zhu HMa LZhang FYang DUkai MHu S(2024)Mental Fatigue Under the Thermoneutral Environment in Buildings: Effects of the Constant and Altered Workload SequencesIndoor Air10.1155/2024/22109912024:1Online publication date: 24-Sep-2024
https://doi.org/10.1155/2024/2210991
Yan ZWu YZhang YChen X(2022)EmoGlass: an End-to-End AI-Enabled Wearable Platform for Enhancing Self-Awareness of Emotional HealthProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501925(1-19)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501925
Cesari VMarinari ELaurino MGemignani AMenicucci D(2021)Attention-Dependent Physiological Correlates in Sleep-Deprived Young Healthy HumansBehavioral Sciences10.3390/bs1102002211:2(22)Online publication date: 5-Feb-2021
https://doi.org/10.3390/bs11020022
Kim CHan JZheng DChernyshov GKunze K(2021)Using Smart Eyewear to Sense Electrodermal Activity While ReadingAdjunct Proceedings of the 2021 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2021 ACM International Symposium on Wearable Computers10.1145/3460418.3479356(472-475)Online publication date: 21-Sep-2021
https://dl.acm.org/doi/10.1145/3460418.3479356

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Recommendations

Can Infrared Facial Thermography Disclose Mental Workload in Indoor Thermal Environments?

Indoor Temperature Fluctuation and Cooling Load Reduction Using Thermal Mass and Night Ventilation

Facial Gesture Classification with Few-shot Learning Using Limited Calibration Data from Photo-reflective Sensors on Smart Eyewear

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Upcoming Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations