skip to main content
10.1145/3410530.3414443acmconferencesArticle/Chapter ViewAbstractPublication PagesubicompConference Proceedingsconference-collections
research-article

Facial expression based satisfaction index for empathic buildings

Published: 12 September 2020 Publication History

Abstract

In this work, we examine the suitability of automatic facial expression recognition to be used for satisfaction analysis in an Empathic Building environment. We use machine learning based facial expression recognition on the working stations to integrate an online satisfaction index into Empathic Building platform. To analyze the suitability of facial expression recognition to reflect longer-term satisfaction, we examine the changes and trends in the happiness curves of our test users. We also correlate the happiness curve with temperature, humidity, and light intensity of the test users' local city (Tampere Finland). The results indicate that the proposed analysis indeed shows some trends that may be used for long-term satisfaction analysis in different kinds of intelligent buildings.

References

[1]
Mihyang An, Stephen M Colarelli, Kimberly O'Brien, and Melanie E Boyajian. 2016. Why we need more nature at work: Effects of natural elements and sunlight on employee mental health and work attitudes. PloS one 11, 5 (2016), 1--17.
[2]
Metin Argan, Mehpare Tokay Argan, and Mehmet Tahir Dursun. 2018. Examining relationships among well-being, leisure satisfaction, life satisfaction, and happiness. International Journal of Medical Research & Health Sciences 7, 4 (2018), 49--59.
[3]
Octavio Arriaga, Matias Valdenegro-Toro, and Paul Plöger. 2017. Real-time convolutional neural networks for emotion and gender classification. (2017). arXiv:arXiv:1710.07557
[4]
Ling Cen, Zhu Liang Yu, and Wee Ser. 2015. Maximum a Posteriori Based Fusion Method for Speech Emotion Recognition. In Emotion Recognition: A Pattern Analysis Approach. John Wiley and Sons, Inc, New Jersey, USA.
[5]
T Derek and J Clements-Croome. 1997. What do we mean by intelligent buildings? Automation in construction 6, 5-6 (1997), 395--400.
[6]
Paul Ekman and Dacher Keltner. 1997. Universal facial expressions of emotion. Segerstrale U, P. Molnar P, eds. Nonverbal communication: Where nature meets culture (1997), 27--46.
[7]
Ian J Goodfellow, Dumitru Erhan, Pierre Luc Carrier, Aaron Courville, Mehdi Mirza, Ben Hamner, Will Cukierski, Yichuan Tang, David Thaler, Dong-Hyun Lee, et al. 2015. Challenges in representation learning: A report on three machine learning contests. Neural Networks 64 (2015), 59--63.
[8]
Eija Halkola, Lauri Lovén, Marta Cortes, Ekaterina Gilman, and Susanna Pirttikangas. 2019. Towards measuring well-being in smart environments. In Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers. Association for Computing Machinery, New York, United States, 1166--1169.
[9]
Carroll E. Izard and George Mandler. 1997. Emotions and facial expressions: A perspective from Differential Emotions Theory. Cambridge University Press, Cambridge, UK, 57--77.
[10]
Jin-Ding Lin, Pei-Ying Lin, and Chia-Ling Wu. 2010. Wellbeing perception of institutional caregivers working for people with disabilities: Use of Subjective Happiness Scale and Satisfaction with Life Scale analyses. Research in developmental disabilities 31, 5 (2010), 1083--1090.
[11]
Albert Mehrabian. 2008. Communication without words. Communication theory 6 (2008), 193--200.
[12]
Amado Peiro. 2006. Happiness, satisfaction and socio-economic conditions: Some international evidence. The Journal of Socio-Economics 35, 2 (2006), 348--365.
[13]
Anjali Rai and Deepak Tandon. 2018. Emotional Intelligence & Job Satisfaction in IT Industry Employee. Asian Journal of Research in Social Sciences and Humanities 8, 5 (2018), 139--147.
[14]
Matthew S Ratliff and Eric Patterson. 2008. Emotion recognition using facial expressions with active appearance models. In Proceeding Human Computer Interaction ACTA. Citeseer, Press, CA, United States, 138--143.
[15]
Ronald W Schafer. 2011. What is a Savitzky-Golay filter?[lecture notes]. IEEE Signal processing magazine 28, 4 (2011), 111--117.
[16]
Feryal Subaşı and Osman Hayran. 2005. Evaluation of life satisfaction index of the elderly people living in nursing homes. Archives of Gerontology and Geriatrics 41, 1 (2005), 23--29.
[17]
URSA. 2020. Tähtitieteellinen yhdistys Ursa. Ursa Astronomical Association. Retrieved June 22, 2020 from http://https://www.ursa.fi/
[18]
Paul Viola, Michael Jones, et al. 2001. Rapid object detection using a boosted cascade of simple features. CVPR (1) 1, 511--518 (2001), 3.
[19]
Shengwei Wang. 2009. Intelligent buildings and building automation. Routledge, London, UK.
[20]
Mingmin Zhao, Fadel Adib, and Dina Katabi. 2016. Emotion recognition using wireless signals. In Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking (New York City, New York). ACM, Association for Computing Machinery, New York, NY, USA, 95--108.

Cited By

View all
  • (2024)Research Contents, Methods and Prospects of Emotional Architecture Based on a Systematic Literature ReviewBuildings10.3390/buildings1404099714:4(997)Online publication date: 4-Apr-2024

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
UbiComp/ISWC '20 Adjunct: Adjunct Proceedings of the 2020 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2020 ACM International Symposium on Wearable Computers
September 2020
732 pages
ISBN:9781450380768
DOI:10.1145/3410530
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 September 2020

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. empathic building
  2. facial expressions
  3. machine learning
  4. satisfaction index

Qualifiers

  • Research-article

Conference

UbiComp/ISWC '20

Acceptance Rates

Overall Acceptance Rate 764 of 2,912 submissions, 26%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)17
  • Downloads (Last 6 weeks)0
Reflects downloads up to 28 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Research Contents, Methods and Prospects of Emotional Architecture Based on a Systematic Literature ReviewBuildings10.3390/buildings1404099714:4(997)Online publication date: 4-Apr-2024

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media