skip to main content
10.1145/3316782.3321543acmotherconferencesArticle/Chapter ViewAbstractPublication PagespetraConference Proceedingsconference-collections
short-paper

Survey of mood detection through various input modes

Published:05 June 2019Publication History

ABSTRACT

Mood has a large impact on people's behavior and even health. Thus, detecting and monitoring mood can potentially benefit users, researchers, clinicians, and content providers. In recent years, advancements in affective computing have enabled the development of various mood detection systems based on self-reported data, speech, facial expressions, mobile phone usage patterns, or physiological signals. This paper reviews each of those approaches and evaluates them in terms of usability and accuracy. Systems based on mobile phone usage and physiological data seem to be the most user friendly, but more research is needed to examine the positive and negative effects of mood monitoring.

References

  1. Mohsin Y Ahmed, Sean Kenkeremath, and John Stankovic. 2015. Socialsense: A collaborative mobile platform for speaker and mood identification. In European Conference on Wireless Sensor Networks. Springer, 68--83.Google ScholarGoogle ScholarCross RefCross Ref
  2. Shabab Bazrafkan, Tudor Nedelcu, Pawel Filipczuk, and Peter Corcoran. 2017. Deep learning for facial expression recognition: A step closer to a smartphone that knows your moods. In Consumer Electronics (ICCE), 2017 IEEE International Conference on. IEEE, 217--220.Google ScholarGoogle ScholarCross RefCross Ref
  3. Andrey Bogomolov, Bruno Lepri, Michela Ferron, Fabio Pianesi, and Alex Sandy Pentland. 2014. Daily stress recognition from mobile phone data, weather conditions and individual traits. In Proceedings of the 22nd ACM international conference on Multimedia. ACM, 477--486. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Gordon H. Bower. 1981. Mood and memory. The American psychologist 36 2 (1981), 129--48.Google ScholarGoogle Scholar
  5. Bokai Cao, Lei Zheng, Chenwei Zhang, Philip S Yu, Andrea Piscitello, John Zulueta, Olu Ajilore, Kelly Ryan, and Alex D Leow. 2017. Deepmood: modeling mobile phone typing dynamics for mood detection. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 747--755. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Stina Lyck Carstensen, Jens Madsen, and Jan Larsen. 2016. Predicting Changes in Affective States using Neural Networks. arXiv preprint arXiv:1612.00582 (2016).Google ScholarGoogle Scholar
  7. Lucio Ciabattoni, Francesco Ferracuti, Sauro Longhi, Lucia Pepa, Luca Romeo, and Federica Verdini. 2017. Real-time mental stress detection based on smartwatch. In Consumer Electronics (ICCE), 2017 IEEE International Conference on. IEEE, 110--111.Google ScholarGoogle ScholarCross RefCross Ref
  8. Pieter MA Desmet. 2015. Design for mood: Twenty activity-based opportunities to design for mood regulation. International Journal of Design, 9 (2), 2015 (2015).Google ScholarGoogle Scholar
  9. M Dubad, C Winsper, C Meyer, M Livanou, and S Marwaha. 2018. A systematic review of the psychometric properties, usability and clinical impacts of mobile mood-monitoring applications in young people. Psychological medicine 48, 2 (2018), 208--228.Google ScholarGoogle Scholar
  10. Meryl Paula Gardner. 1985. Mood states and consumer behavior: A critical review. Journal of Consumer research 12, 3 (1985), 281--300.Google ScholarGoogle ScholarCross RefCross Ref
  11. Karen Gasper and Gerald L Clore. 2002. Attending to the big picture: Mood and global versus local processing of visual information. Psychological science 13, 1 (2002), 34--40.Google ScholarGoogle Scholar
  12. James J Gross. 2013. Handbook of emotion regulation. Guilford publications.Google ScholarGoogle Scholar
  13. Kun-Yi Huang, Chung-Hsien Wu, Ming-Hsiang Su, and Hsiang-Chi Fu. 2017. Mood detection from daily conversational speech using denoising autoencoder and LSTM. In Acoustics, Speech and Signal Processing (ICASSP), 2017 IEEE International Conference on. IEEE, 5125--5129.Google ScholarGoogle ScholarCross RefCross Ref
  14. Zahi N Karam, Emily Mower Provost, Satinder Singh, Jennifer Montgomery, Christopher Archer, Gloria Harrington, and Melvin G Mcinnis. 2014. Ecologically valid long-term mood monitoring of individuals with bipolar disorder using speech. In Acoustics, Speech and Signal Processing (ICASSP), 2014 IEEE International Conference on. IEEE, 4858--4862.Google ScholarGoogle ScholarCross RefCross Ref
  15. Robert LiKamWa, Yunxin Liu, Nicholas D Lane, and Lin Zhong. 2013. Moodscope: Building a mood sensor from smartphone usage patterns. In Proceeding of the 11th annual international conference on Mobile systems, applications, and services. ACM, 389--402. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Elena Lozano-Monasor, María T López, Antonio Fernández-Caballero, and Francisco Vigo-Bustos. 2014. Facial expression recognition from webcam based on active shape models and support vector machines. In International Workshop on Ambient Assisted Living. Springer, 147--154.Google ScholarGoogle ScholarCross RefCross Ref
  17. Michael N. O'Malley and Lester Andrews. 1983. The effect of mood and incentives on helping: Are there some things money can't buy? Motivation and Emotion 7, 2 (01 Jun 1983), 179--189.Google ScholarGoogle Scholar
  18. Xiaobo Shi, Yixue Hao, Delu Zeng, Lu Wang, M Shamim Hossain, Sk Md Mizanur Rahman, and Abdulhameed Alelaiwi. 2016. Cloud-Assisted Mood Fatigue Detection System. Mobile Networks and Applications 21, 5 (2016), 744--752. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. L.D. Stafford and R. Collins. 2013. The interactive effects of mood and memory on food intake. Appetite 71 (2013), 486.Google ScholarGoogle ScholarCross RefCross Ref
  20. Yoshihiko Suhara, Yinzhan Xu, and Alex'Sandy' Pentland. 2017. Deepmood: Forecasting depressed mood based on self-reported histories via recurrent neural networks. In Proceedings of the 26th International Conference on World Wide Web. International World Wide Web Conferences Steering Committee, 715--724. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Saeed Turabzadeh, Hongying Meng, Rafiq M Swash, Matus Pleva, and Jozef Juhar. 2018. Facial Expression Emotion Detection for Real-Time Embedded Systems. Technologies 6, 1 (2018), 17.Google ScholarGoogle ScholarCross RefCross Ref
  22. Chung-Hsien Wu, Jen-Chun Lin, and Wen-Li Wei. 2014. Survey on audiovisual emotion recognition: databases, features, and data fusion strategies. APSIPA transactions on signal and information processing 3 (2014).Google ScholarGoogle Scholar
  23. Alexandros Zenonos, Aftab Khan, Georgios Kalogridis, Stefanos Vatsikas, Tim Lewis, and Mahesh Sooriyabandara. 2016. HealthyOffice: Mood recognition at work using smartphones and wearable sensors. (2016).Google ScholarGoogle Scholar
  24. Mingmin Zhao, Fadel Adib, and Dina Katabi. 2016. Emotion recognition using wireless signals. In Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking. ACM, 95--108. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Zack Zhu, Hector F Satizabal, Ulf Blanke, Andres Perez-Uribe, and Gerhard Tröster. 2016. Naturalistic recognition of activities and mood using wearable electronics. IEEE Transactions on Affective Computing 7, 3 (2016), 272--285. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Survey of mood detection through various input modes

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Other conferences
          PETRA '19: Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments
          June 2019
          655 pages
          ISBN:9781450362320
          DOI:10.1145/3316782

          Copyright © 2019 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 5 June 2019

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • short-paper

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader