Agnieszka Landowska
ABSTRACT
The paper concerns extension of IT usability studies with automatic analysis of the emotional state of a user. Affect recognition methods and emotion representation models are reviewed and evaluated for applicability in usability testing procedures. Accuracy of emotion recognition, susceptibility to disturbances, independence on human will and interference with usability testing procedures are the criteria, that were identified and addressed in this paper. A study of a usability evaluation case was also performed to spot realistic challenges. As a result, a number of concerns were identified, providing a list of pros and cons for affect acquisition applied in usability testing context.
- Hyung Il Ahn, Rosalind Picard. 2014. Measuring Affective-Cognitive Experience and Predicting Market Success. Affective Computing, IEEE Transactions on, vol.5, no.2, pp.173, 186, April-June 1 2014.Google Scholar
- Bill Albert, Tom Tullis. 2013. Measuring the user experience: collecting, analyzing, and presenting usability metrics. Newnes. Google ScholarDigital Library
- Jeremy N. Bailenson, Emmanuel D. Pontikakis, Iris B. Mauss, James J. Gross, Maria E. Jabon, Cendri A.C. Hutcherson, Clifford Nass, Oliver John. 2008. Real-time classification of evoked emotions using facial feature tracking and physiological responses. International journal of human-computer studies, 66(5): 303--317. Google ScholarDigital Library
- Nigel Bevan. 2009. What is the difference between the purpose of usability and user experience evaluation methods. In Proceedings of the Workshop UXEM (Vol. 9).Google Scholar
- Haji Binali, Chen Wu, Vidyasagar Potdar. 2010. Computational approaches for emotion detection in text. 4th IEEE International Conference on Digital Ecosystems and Technologies (DEST): 172--177.Google ScholarCross Ref
- Paul Ekman, Richard J. Davidson. 1999. The Nature of Emotion: Fundamental Questions, Oxford University Press, 1994Google Scholar
- Hatice Gunes, Björn Schuller. 2013. Categorical and dimensional affect analysis in continuous input: Current trends and future directions. Image and Vision Computing, 31(2): 120--136. Google ScholarDigital Library
- Hatice Gunes, Massimo Piccardi. 2005 Affect Recognition from Face and Body: Early Fusion vs. Late Fusion, IEEE International Conference on Systems, Man and Cybernetics, vol. 4: 3437--3443.Google ScholarCross Ref
- Dan Hill, 2010. Emotionomics: Leveraging Emotions for Business Success, Cogan Page, USA.Google Scholar
- ISO. 1998. Norm 9241: Ergonomics of human-system interaction.Google Scholar
- Rana El Kaliouby and Peter Robinson. 2004. Real-time inference of complex mental states from facial expressions and headgestures. In CVPRW. Proceedings of the Conference on Computer Vision and Pattern Recognition Workshop, vol. 10, IEEE Computer Society Google ScholarDigital Library
- Agata Kołakowska, Agnieszka Landowska, Mariusz Szwoch, Wioleta Szwoch, Michal R Wrobel. 2013. Emotion recognition and its application in software engineering, Proc. of 6th International Conference on Human-System Interaction, Gdansk: 532--539.Google ScholarCross Ref
- Agata Kołakowska, Agnieszka Landowska, Mariusz Szwoch, Wioleta Szwoch, Michal R Wrobel. 2014. Emotion recognition and its applications, Human-Computer Systems Interaction: Backgrounds and Applications 3, Springer: 51--62.Google Scholar
- Agata Kołakowska. 2013. A review of emotion recognition methods based on keystroke dynamics and mouse movements. In: Proc 6th International Conference on Human Systems Interaction: 548--555.Google ScholarCross Ref
- Agnieszka Landowska. 2014. Emotion monitoring - verification of physiological characteristics measurement procedures, Metrology and Measurement Systems Journal, Vol XXI, No. 4: 719--732.Google ScholarCross Ref
- Agnieszka Landowska, Michal R Wrobel. 2015. Affective reactions to playing digital games, 8th Int. Conf. on Human-Systems Interaction (unpublished).Google ScholarCross Ref
- Agnieszka Landowska. 2013. Affective computing and affective learning -- methods, tools and prospects, EduAction. Electronic education magazine, 1(5): 16--31.Google Scholar
- Philip Lew, Luis Olsina, Pablo Becker, Li Zhang. 2012. An integrated strategy to systematically understand and manage quality in use for web applications. Requirements Engineering, 17(4): 299--330. Google ScholarDigital Library
- Albert Mehrabian. 1997. Comparison of the PAD and PANAS as models for describing emotions and for differentiating anxiety from depression. Journal of psychopathology and behavioral assessment, 19(4): 331--357.Google ScholarCross Ref
- Alena Neviarouskaya, Helmut Prendinger, Mitsuru Ishizuka. 2009. Compositionality principle in recognition of finegrained emotions from text. Proceedings of the Third International Conference on Weblogs and Social Media: 278--281.Google Scholar
- Jakob Nielsen, 1993. Usability Engineering, Academic Press/AP Professional, Cambridge, MA ISBN 0-12-518406-9 Google ScholarDigital Library
- Maja Pantic, Leon J. M. Rothkrantz, 2000. Automatic Analysis of Facial Expressions: The State of the Art, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.22 n.12: 1424-1445. Google ScholarDigital Library
- Maja Pantic, Leon J. M. Rothkrantz. 2003. Toward an affect-sensitive multimodal human-computer interaction," Proceedings of the IEEE, vol.91, no.9: 1370--1390.Google ScholarCross Ref
- Rosalind Picard, Shaundra Bryant Daily. 2005. Evaluating affective interactions: Alternatives to asking what users feel. CHI Workshop on Evaluating Affective Interfaces: Innovative ApproachesGoogle Scholar
- Jianhua Tao, Tieniu Tan. 2005. Affective computing: A review. In Affective computing and intelligent interaction. Springer Berlin Heidelberg: 981--995. Google ScholarDigital Library
- Robert E. Thayer. 1989. The biopsychology of mood and arousal: Oxford University Press.Google Scholar
- Arnold P. O. S. Vermeeren, Effie Lai-Chong, Virpi Roto, Marianna Obrist, Jettie Hoonhout, Kaisa Väänänen-Vainio-Mattila. 2010. User experience evaluation methods: current state and development needs. In Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries, ACM: 521--530. Google ScholarDigital Library
- Lisa M. Vizer, Lina Zhou, Andrew Sears. 2009. Automated stress detection using keystroke and linguistic features, Int. Journal of Human-Computer Studies 67: 870--886. Google ScholarDigital Library
- Jun Wang, Lijun Yin, Xiaozhou Wei, Yi Sun. 2006. 3D facial expression recognition based on primitive surface feature distribution, Computer Vision and Pattern Recognition, vol. 2: 1399--1406. Google ScholarDigital Library
- Cynthia Whissell. 2009. Using the revised Dictionary of Affect in Language to quantify the emotional undertones of samples of natural language. Psychological Reports, 105: 1--13.Google ScholarCross Ref
- Zhihong Zeng, Maja Pantic, Glenn I. Roisman, Thomas S. Huang. 2009. A survey of affect recognition methods: Audio, visual, and spontaneous expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31(1): 39--58. Google ScholarDigital Library
- Philippe Zimmermann, Patrick Gomez, Brigitta Danuser, Sissel Guttormsen Schär. 2006. Extending usability: putting affect into the user-experience. Proceedings of NordiCHI'06: 27--32.Google Scholar
Recommendations
Emotional web usability evaluation
HCI'07: Proceedings of the 12th international conference on Human-computer interaction: applications and servicesThis paper presents a framework for emotional interface where a method for emotional interface evaluation is purposed and the emotion eliciting conditions in online graphic interfaces are explored. Those eliciting conditions are concerning the design ...
Emotion Recognition Using Physiological Signals
MIDI '15: Proceedings of the Mulitimedia, Interaction, Design and InnnovationIn this paper the problem of emotion recognition using physiological signals is presented. Firstly the problems with acquisition of physiological signals related to specific human emotions are described. It is not a trivial problem to elicit real ...
Emotion and mood recognition in response to video
This paper presents a subject-dependent homogenous emotion recognition method using electroencephalogram (EEG) signals in response to video contents, and a correlation between emotions and moods of subjects in resting state. In the recent years, there ...
Comments