Alexandros Mitsou
ABSTRACT
The aim of this work is to design and implement a system that deals with the recognition of human behavior on issues of mental nature. Since the “invasion” of technology in human daily life is continuously growing, a plethora of novel applications have emerged. Therefore, there exists a growing interest for applications that will serve as an aid for people experiencing problems with work fatigue, stress and anxiety. In essence, the goal of this work is to combine ideas, theories and methods from the research areas of psychology and information technologies, towards the automatic recognition of activities that occur within a work environment. To this goal, we use a series of observations including actions, behaviors and situations that constitute sources of fatigue, anxiety and stress, based on measurements coming from several peripheral parts of a computer and also from force sensitive resistor sensors placed on the users chairs. These observations take place during working time. For behaviour recognition we use supervised machine learning techniques. We demonstrate the proposed approach using a real-life scenario.
- Jonathan Aigrain, Michel Spodenkiewicz, Séverine Dubuisson, Marcin Detyniecki, David Cohen, and Mohamed Chetouani. 2018. Multimodal Stress Detection from Multiple Assessments. IEEE Transactions on Affective Computing 9, 4 (Oct. 2018), 491–506. https://doi.org/10.1109/TAFFC.2016.2631594 Conference Name: IEEE Transactions on Affective Computing.Google Scholar
Digital Library
- Linsey M. Barker and Maury A. Nussbaum. 2011. Fatigue, performance and the work environment: a survey of registered nurses. Journal of Advanced Nursing 67, 6 (2011), 1370–1382. https://doi.org/10.1111/j.1365-2648.2010.05597.x _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1111/j.1365-2648.2010.05597.x.Google ScholarCross Ref
- Armando Barreto, Jing Zhai, Naphtali Rishe, and Ying Gao. 2007. Significance of Pupil Diameter Measurements for the Assessment of Affective State in Computer Users. In Advances and Innovations in Systems, Computing Sciences and Software Engineering, Khaled Elleithy (Ed.). Springer Netherlands, Dordrecht, 59–64. https://doi.org/10.1007/978-1-4020-6264-3_11Google Scholar
- Davide Carneiro, José Carlos Castillo, Paulo Novais, Antonio Fernández-Caballero, and José Neves. 2012. Multimodal behavioral analysis for non-invasive stress detection. Expert Systems with Applications 39, 18 (Dec. 2012), 13376–13389. https://doi.org/10.1016/j.eswa.2012.05.065Google ScholarDigital Library
- Burcu Cinaz, Bert Arnrich, Roberto La Marca, and Gerhard Tröster. 2013. Monitoring of mental workload levels during an everyday life office-work scenario. Personal and Ubiquitous Computing 17, 2 (Feb. 2013), 229–239. https://doi.org/10.1007/s00779-011-0466-1Google ScholarDigital Library
- Belinda H. W. Eijckelhof, Maaike A. Huysmans, Birgitte M. Blatter, Priscilla C. Leider, Peter W. Johnson, Jaap H. van Dieën, Jack T. Dennerlein, and Allard J. van der Beek. 2014. Office workers’ computer use patterns are associated with workplace stressors. Applied Ergonomics 45, 6 (Nov. 2014), 1660–1667. https://doi.org/10.1016/j.apergo.2014.05.013Google ScholarCross Ref
- Clayton Epp, Michael Lippold, and Regan L. Mandryk. 2011. Identifying emotional states using keystroke dynamics. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’11). Association for Computing Machinery, New York, NY, USA, 715–724. https://doi.org/10.1145/1978942.1979046Google ScholarDigital Library
- Luciano Floridi. 2013. The Ethics of Information. OUP Oxford. Google-Books-ID: _XHcAAAAQBAJ.Google Scholar
- Takuto Hayashi, Yuko Mizuno-Matsumoto, Eika Okamoto, Makoto Kato, and Tsutomu Murata. 2012. An fMRI study of brain processing related to stress states. In World Automation Congress 2012. 1–6. ISSN: 2154-4824.Google Scholar
- Rafal Kocielnik, Natalia Sidorova, Fabrizio Maria Maggi, Martin Ouwerkerk, and Joyce H. D. M. Westerink. 2013. Smart technologies for long-term stress monitoring at work. In Proceedings of the 26th IEEE International Symposium on Computer-Based Medical Systems. 53–58. https://doi.org/10.1109/CBMS.2013.6627764 ISSN: 1063-7125.Google ScholarCross Ref
- Deborah Lupton. 2014. Self-tracking cultures: towards a sociology of personal informatics. In Proceedings of the 26th Australian Computer-Human Interaction Conference on Designing Futures: the Future of Design(OzCHI ’14). Association for Computing Machinery, New York, NY, USA, 77–86. https://doi.org/10.1145/2686612.2686623Google ScholarDigital Library
- Alexander Markowetz, Konrad Błaszkiewicz, Christian Montag, Christina Switala, and Thomas E. Schlaepfer. 2014. Psycho-Informatics: Big Data shaping modern psychometrics. Medical Hypotheses 82, 4 (April 2014), 405–411. https://doi.org/10.1016/j.mehy.2013.11.030Google ScholarCross Ref
- Daniel McDuff, Amy Karlson, Ashish Kapoor, Asta Roseway, and Mary Czerwinski. 2012. AffectAura: an intelligent system for emotional memory. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’12). Association for Computing Machinery, New York, NY, USA, 849–858. https://doi.org/10.1145/2207676.2208525Google ScholarDigital Library
- Christian Montag, Éilish Duke, and Alexander Markowetz. 2016. Toward Psychoinformatics: Computer Science Meets Psychology. Computational and Mathematical Methods in Medicine 2016 (June 2016), e2983685. https://doi.org/10.1155/2016/2983685 Publisher: Hindawi.Google Scholar
- Klemen Peternel, Matevž Pogačnik, Rudi Tavčar, and Andrej Kos. 2012. A Presence-Based Context-Aware Chronic Stress Recognition System. Sensors 12, 11 (Nov. 2012), 15888–15906. https://doi.org/10.3390/s121115888 Number: 11 Publisher: Multidisciplinary Digital Publishing Institute.Google Scholar
- Kais Riani, Michalis Papakostas, Hussein Kokash, Mohamed Abouelenien, Mihai Burzo, and Rada Mihalcea. 2020. Towards detecting levels of alertness in drivers using multiple modalities. In Proceedings of the 13th ACM International Conference on PErvasive Technologies Related to Assistive Environments(PETRA ’20). Association for Computing Machinery, New York, NY, USA, 1–9. https://doi.org/10.1145/3389189.3389192Google ScholarDigital Library
- Dvijesh Shastri, Manos Papadakis, Panagiotis Tsiamyrtzis, Barbara Bass, and Ioannis Pavlidis. 2012. Perinasal Imaging of Physiological Stress and Its Affective Potential. IEEE Transactions on Affective Computing 3, 3 (July 2012), 366–378. https://doi.org/10.1109/T-AFFC.2012.13 Conference Name: IEEE Transactions on Affective Computing.Google ScholarDigital Library
- Chang Zhi Wei. 2013. Stress Emotion Recognition Based on RSP and EMG Signals. Advanced Materials Research 709 (2013), 827–831. https://doi.org/10.4028/www.scientific.net/AMR.709.827 Conference Name: Advances in Applied Science, Engineering and Technology ISBN: 9783037857182 Publisher: Trans Tech Publications Ltd.Google ScholarCross Ref
- Tal Yarkoni. 2012. Psychoinformatics: New Horizons at the Interface of the Psychological and Computing Sciences. Current Directions in Psychological Science 21, 6 (Dec. 2012), 391–397. https://doi.org/10.1177/0963721412457362 Publisher: SAGE Publications Inc.Google ScholarCross Ref
Index Terms
- Multimodal Workplace Monitoring for Human Activity Recognition
Recommendations
Aerobic activity monitoring: towards a long-term approach
With recent progress in wearable sensing, it becomes reasonable for individuals to wear different sensors all day, and thus, global activity monitoring is establishing. The goals in global activity monitoring systems are among others to tell the type of ...
Human Activity Recognition
ICAART 2016: Proceedings of the 8th International Conference on Agents and Artificial IntelligenceUnobtrusive and mobile activity monitoring using ubiquitous, cheap and widely available technology is the key requirement for human activity recognition supporting novel applications, such as health monitoring. With the recent progress in wearable ...
Comments