ABSTRACT
Mood has a large impact on people's behavior and even health. Thus, detecting and monitoring mood can potentially benefit users, researchers, clinicians, and content providers. In recent years, advancements in affective computing have enabled the development of various mood detection systems based on self-reported data, speech, facial expressions, mobile phone usage patterns, or physiological signals. This paper reviews each of those approaches and evaluates them in terms of usability and accuracy. Systems based on mobile phone usage and physiological data seem to be the most user friendly, but more research is needed to examine the positive and negative effects of mood monitoring.
- Mohsin Y Ahmed, Sean Kenkeremath, and John Stankovic. 2015. Socialsense: A collaborative mobile platform for speaker and mood identification. In European Conference on Wireless Sensor Networks. Springer, 68--83.Google ScholarCross Ref
- Shabab Bazrafkan, Tudor Nedelcu, Pawel Filipczuk, and Peter Corcoran. 2017. Deep learning for facial expression recognition: A step closer to a smartphone that knows your moods. In Consumer Electronics (ICCE), 2017 IEEE International Conference on. IEEE, 217--220.Google ScholarCross Ref
- Andrey Bogomolov, Bruno Lepri, Michela Ferron, Fabio Pianesi, and Alex Sandy Pentland. 2014. Daily stress recognition from mobile phone data, weather conditions and individual traits. In Proceedings of the 22nd ACM international conference on Multimedia. ACM, 477--486. Google ScholarDigital Library
- Gordon H. Bower. 1981. Mood and memory. The American psychologist 36 2 (1981), 129--48.Google Scholar
- Bokai Cao, Lei Zheng, Chenwei Zhang, Philip S Yu, Andrea Piscitello, John Zulueta, Olu Ajilore, Kelly Ryan, and Alex D Leow. 2017. Deepmood: modeling mobile phone typing dynamics for mood detection. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 747--755. Google ScholarDigital Library
- Stina Lyck Carstensen, Jens Madsen, and Jan Larsen. 2016. Predicting Changes in Affective States using Neural Networks. arXiv preprint arXiv:1612.00582 (2016).Google Scholar
- Lucio Ciabattoni, Francesco Ferracuti, Sauro Longhi, Lucia Pepa, Luca Romeo, and Federica Verdini. 2017. Real-time mental stress detection based on smartwatch. In Consumer Electronics (ICCE), 2017 IEEE International Conference on. IEEE, 110--111.Google ScholarCross Ref
- Pieter MA Desmet. 2015. Design for mood: Twenty activity-based opportunities to design for mood regulation. International Journal of Design, 9 (2), 2015 (2015).Google Scholar
- M Dubad, C Winsper, C Meyer, M Livanou, and S Marwaha. 2018. A systematic review of the psychometric properties, usability and clinical impacts of mobile mood-monitoring applications in young people. Psychological medicine 48, 2 (2018), 208--228.Google Scholar
- Meryl Paula Gardner. 1985. Mood states and consumer behavior: A critical review. Journal of Consumer research 12, 3 (1985), 281--300.Google ScholarCross Ref
- Karen Gasper and Gerald L Clore. 2002. Attending to the big picture: Mood and global versus local processing of visual information. Psychological science 13, 1 (2002), 34--40.Google Scholar
- James J Gross. 2013. Handbook of emotion regulation. Guilford publications.Google Scholar
- Kun-Yi Huang, Chung-Hsien Wu, Ming-Hsiang Su, and Hsiang-Chi Fu. 2017. Mood detection from daily conversational speech using denoising autoencoder and LSTM. In Acoustics, Speech and Signal Processing (ICASSP), 2017 IEEE International Conference on. IEEE, 5125--5129.Google ScholarCross Ref
- Zahi N Karam, Emily Mower Provost, Satinder Singh, Jennifer Montgomery, Christopher Archer, Gloria Harrington, and Melvin G Mcinnis. 2014. Ecologically valid long-term mood monitoring of individuals with bipolar disorder using speech. In Acoustics, Speech and Signal Processing (ICASSP), 2014 IEEE International Conference on. IEEE, 4858--4862.Google ScholarCross Ref
- Robert LiKamWa, Yunxin Liu, Nicholas D Lane, and Lin Zhong. 2013. Moodscope: Building a mood sensor from smartphone usage patterns. In Proceeding of the 11th annual international conference on Mobile systems, applications, and services. ACM, 389--402. Google ScholarDigital Library
- Elena Lozano-Monasor, María T López, Antonio Fernández-Caballero, and Francisco Vigo-Bustos. 2014. Facial expression recognition from webcam based on active shape models and support vector machines. In International Workshop on Ambient Assisted Living. Springer, 147--154.Google ScholarCross Ref
- Michael N. O'Malley and Lester Andrews. 1983. The effect of mood and incentives on helping: Are there some things money can't buy? Motivation and Emotion 7, 2 (01 Jun 1983), 179--189.Google Scholar
- Xiaobo Shi, Yixue Hao, Delu Zeng, Lu Wang, M Shamim Hossain, Sk Md Mizanur Rahman, and Abdulhameed Alelaiwi. 2016. Cloud-Assisted Mood Fatigue Detection System. Mobile Networks and Applications 21, 5 (2016), 744--752. Google ScholarDigital Library
- L.D. Stafford and R. Collins. 2013. The interactive effects of mood and memory on food intake. Appetite 71 (2013), 486.Google ScholarCross Ref
- Yoshihiko Suhara, Yinzhan Xu, and Alex'Sandy' Pentland. 2017. Deepmood: Forecasting depressed mood based on self-reported histories via recurrent neural networks. In Proceedings of the 26th International Conference on World Wide Web. International World Wide Web Conferences Steering Committee, 715--724. Google ScholarDigital Library
- Saeed Turabzadeh, Hongying Meng, Rafiq M Swash, Matus Pleva, and Jozef Juhar. 2018. Facial Expression Emotion Detection for Real-Time Embedded Systems. Technologies 6, 1 (2018), 17.Google ScholarCross Ref
- Chung-Hsien Wu, Jen-Chun Lin, and Wen-Li Wei. 2014. Survey on audiovisual emotion recognition: databases, features, and data fusion strategies. APSIPA transactions on signal and information processing 3 (2014).Google Scholar
- Alexandros Zenonos, Aftab Khan, Georgios Kalogridis, Stefanos Vatsikas, Tim Lewis, and Mahesh Sooriyabandara. 2016. HealthyOffice: Mood recognition at work using smartphones and wearable sensors. (2016).Google Scholar
- Mingmin Zhao, Fadel Adib, and Dina Katabi. 2016. Emotion recognition using wireless signals. In Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking. ACM, 95--108. Google ScholarDigital Library
- Zack Zhu, Hector F Satizabal, Ulf Blanke, Andres Perez-Uribe, and Gerhard Tröster. 2016. Naturalistic recognition of activities and mood using wearable electronics. IEEE Transactions on Affective Computing 7, 3 (2016), 272--285. Google ScholarDigital Library
Index Terms
- Survey of mood detection through various input modes
Recommendations
Out of the lab and into the fray: towards modeling emotion in everyday life
Pervasive'10: Proceedings of the 8th international conference on Pervasive ComputingWe conducted a 19 participant study using a system comprised of wireless galvanic skin response (GSR), heart rate (HR), activity sensors and a mobile phone for aggregating sensor data and enabling affect logging by the user. Each participant wore the ...
Automatic mood detection and tracking of music audio signals
Music mood describes the inherent emotional expression of a music clip. It is helpful in music understanding, music retrieval, and some other music-related applications. In this paper, a hierarchical framework is presented to automate the task of mood ...
In the mood for sharing contents
We develop an aligned corpus of Tweets and news articles with gold standard mood.We perform correlation analysis of personality, communication style and mood sharing in Twitter.We find the best attributes for the prediction of positive and negative mood ...
Comments