Manon Holman
ABSTRACT
Changes in the contemporary business environment are shifting the focus of designers and developers of Information Systems (IS) from a narrow focus on system usability to an overall user experience (UX). The subjective nature of UX meant that the majority of UX evaluation methods are subjective. However, advancements in new technologies now make it possible to evaluate UX objectively by collecting physiological data unobtrusively. In this study we explored the use of the Emotiv EPOC+ headset to collect electro-encephalography (EEG) patterns to 'examine' brain activities to determine the presence or absence of the emotion of anger, as well as 'performance metrics' on engagement, excitement, interest, focus, relaxation, and stress, in order to evaluate UX. The results showed that the Emotiv EPOC+ headset provides a low-cost means of evaluating UX objectively.
- D. L. Scapin, B. Senach, B. Trousse, and M. Pallot, "User experience: buzzword or new paradigm?." pp. 336--341, Proceedings of the 5th International Conference on Advances in Computer-Human Interactions (ACHI 2012), 2012.Google Scholar
- M. Hassenzahl, and N. Tractinsky, "User experience - a research agenda," Behaviour & Information Technology, vol. 25, no. 2, pp. 91--97, 2006.Google ScholarCross Ref
- E. L.-C. Law, V. Roto, M. Hassenzahl, A. P. Vermeeren, and J. Kort, "Understanding, scoping and defining user experience: a survey approach." pp. 719--728, Proceedings of the SIGCHI conference on human factors in computing systems, 2009. Google ScholarDigital Library
- A. Bruun, M. K. Larusdottir, L. Nielsen, P. A. Nielsen, and J. S. Persson, "The role of UX professionals in agile development: a case study from industry ". pp. 352--363, Proceedings of the 10th Nordic Conference on Human-Computer Interaction, Google ScholarDigital Library
- M. Hassenzahl, "User experience (UX): towards an experiential perspective on product quality," in 20th Conference on I'Interaction Homme-Machine, Metz, France, 2008, pp. 11--15. Google ScholarDigital Library
- International organization for standardization. "Ergonomics of human-system: Human-centred design for interactive systems," Retrieved on 04/04/19, from 2010.Google Scholar
- K. Kuusinen, and K. Väänänen-Vainio-Mattila, "How to make agile UX work more efficient: management and sales perspectives," in Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design, Copenhagen, Denmark, 2012, pp. 139--148. Google ScholarDigital Library
- C. Ardito, P. Buono, D. Caivano, M. F. Costabile, and R. Lanzilotti, "Investigating and Promoting UX Practice in Industry: An Experimental Study," International Journal of Human-Computer Studies, vol. 72, no. 6, pp. 542--551, 2014.Google ScholarCross Ref
- T. Guidini Gonçalves, K. Marçal de Oliveira, and C. Kolski, "HCI in Practice: An Empirical Study with Software Process Capability Maturity Model Consultants in Brazil," Journal of Software: Evolution and Process, vol. 30, no. 11, pp. e2109, 2018.Google ScholarCross Ref
- A. Bilgihan, "Gen Y customer loyalty in online shopping: an integrated model of trust, user experience and branding," Computers in Human Behavior, vol. 61, pp. 103--113, 2016. Google ScholarDigital Library
- G. Paunovic. "The bottom line: why good UX design means better business " Retrieved on 04/04/19, from https://www.forbes.com/sites/forbesagencycouncil/2017/03/23/the-bottom-line-why-good-ux-design-means-better-business/#72d73cdf2396 2017.Google Scholar
- A. A. Ogunyemi, D. Lamas, E. R. Adagunodo, F. Loizides, and I. B. Da Rosa, "Theory, practice and policy: an inquiry into the uptake of HCI practices in the software industry of a developing country," International Journal of Human-Computer Interaction, vol. 32, no. 9, pp. 665--681, 2016.Google ScholarCross Ref
- M. Minge, and M. Thüring, "Hedonic and pragmatic halo effects at early stages of User Experience," International Journal of Human-Computer Studies, vol. 109, no. 2018, pp. 13--25, 2018. Google ScholarDigital Library
- G. Brajnik, and C. Giachin, "Using sketches and storyboards to assess impact of age difference in user experience," International Journal of Human-Computer Studies, vol. 72, no. 6, pp. 552--566, 2014/06/01/, 2014.Google ScholarCross Ref
- P. Desmet, and P. Hekkert, "Framework of product experience," International Journal of Design, vol. 1, no. 1, pp. 57--66, 2007.Google Scholar
- V. Balasubramoniam, and N. Tungatkar, "Study of user experience (UX) and UX evaluation methods," International Journal of Advanced Research in Computer Engineering & Technology, vol. 2, no. 3, pp. 1214--1219, 2013.Google Scholar
- R. L. Mandryk, K. M. Inkpen, and T. W. Calvert, "Using psychophysiological techniques to measure user experience with entertainment technologies," Behaviour & Information Technology, vol. 25, no. 2, pp. 141--158, 2006.Google ScholarCross Ref
- M. Van Camp, M. De Boeck, S. Verwulgen, and G. De Bruyne, "EEG technology for UX evaluation: A mltisensory perspective," Advances in Neuroergonomics and Cognitive Engineering. pp. 337--343, Proceedings of the 2019.Google Scholar
- P. M. Podsakoff, S. B. MacKenzie, J.-Y. Lee, and N. P. Podsakoff, "Common method biases in behavioral research: a critical review of the literature and recommended remedies," Journal of Applied Psychology, vol. 88, no. 5, pp. 879--903, 2003.Google ScholarCross Ref
- B. A. Olken, "Corruption perceptions vs. corruption reality," Journal of Public Economics, vol. 93, no. 7, pp. 950--964, 2009/08/01/, 2009.Google ScholarCross Ref
- D. Zimprich, and T. Kurtz, "Subjective and Objective Memory Changes in Old Age across Five Years," Gerontology, vol. 61, no. 3, pp. 223--231, 2015.Google ScholarCross Ref
- F. F. Morgado, J. F. Meireles, C. M. Neves, A. C. Amaral, and M. E. Ferreira, "Scale development: ten main limitations and recommendations to improve future research practices," Psicologia: Reflexão e Crítica, vol. 30, no. 3, 2017.Google Scholar
- C. A. Latkin, C. Edwards, M. A. Davey-Rothwell, and K. E. Tobin, "The relationship between social desirability bias and self-reports of health, substance use, and social network factors among urban substance users in Baltimore, Maryland," Addictive Behaviors, vol. 73, pp. 133--136, 2017/10/01/, 2017.Google ScholarCross Ref
- L. Vokorokos, B. Madoš, N. Ádám, and A. Baláž, "Data acquisition in noninvasive brain-computer interface using Emotiv EPOC neuroheadset," Acta Electrotechnica et Informatica, vol. 12, no. 1, pp. 5--8, 2012.Google ScholarCross Ref
- N. Vala, and K. Trivedi, "Brain computer interface: data acquisition using noninvasive Emotiv EPOC neuroheadset," International Journal of Software & Hardware Research in Engineering, vol. 2, no. 5, pp. 127--130, 2014.Google Scholar
- R. L. Hazlett, and J. Benedek, "Measuring emotional valence to understand the user's experience of software," International Journal of Human-Computer Studies, vol. 65, no. 4, pp. 306--314, 2007/04/01/, 2007. Google ScholarDigital Library
- J. Brosens, F. Adebesin, and R. Kruger, "In the eye of the beholder: Teaching user centred design to information and communication technology students with the help of Eye Tracking," Handbook of Research on Diverse Teaching Strategies for the Technology-Rich Classroom, L. Tomei, ed., IGI, In Press.Google Scholar
- C. Lallemand, G. Gronier, and V. Koenig, "User experience: A concept without consensus? Exploring practitioners' perspectives through an international survey," Computers in Human Behavior, vol. 43, pp. 35--48, 2015. Google ScholarDigital Library
- M. Thuring, and S. Mahlke, "Usability, aesthetics and emotions in human-technology," International Journal of Psycholohgy, pp. 12, 2007.Google Scholar
- M. D. Good, J. A. Whiteside, D. R. Wixon, and S. J. Jones, "Building a user-derived interface," Communications of the ACM, vol. 27, no. 10, pp. 1032--1043, 1984. Google ScholarDigital Library
- V. Roto, "User experience building blocks," Proceedings of the The 2nd COST294-MAUSE International Open Workshop, 2006.Google Scholar
- N. Fragopanagos, and J. G. Taylor, "Emotion recognition in human-computer interaction," Neural Networks, vol. 18, no. 4, pp. 389--405, 2005. Google ScholarDigital Library
- A. Agarwal, and A. Meyer, "Beyond usability: evaluating emotional response as an integral part of the user experience," in CHI '09 Extended Abstracts on Human Factors in Computing Systems, Boston, MA, USA, 2009, pp. 2919--2930. Google ScholarDigital Library
- I. B. Mauss, and M. D. Robinson, "Measures of emotion: A review," Cognition and Emotion, vol. 23, no. 2, pp. 209--237, 2009.Google ScholarCross Ref
- S. Brave, and C. Nass, "Emotion in human-computer interaction," Handbook of human-computer interaction, J. Jacko and A. Sears, eds., pp. 251--271: Lawrence Erlbaum Associates 2002.Google Scholar
- C. Peter, and R. Beale, "Affect and emotion in human-computer interaction," Expanding the frontiers of visual analytics and visualization D. J. Earnshaw, R. Kasik, J. Vince and P. C. Wong, eds., Springer, 2012, pp. 239--262.Google Scholar
- D. Watson, D. Wiese, J. Vaida, and A. Tellegen, "The two general activation systems of affect: structural findings, evolutionary considerations, and psychobiological evidence," Journal of Personality and Social Psychology, vol. 76, no. 5, pp. 820--838, 1999.Google ScholarCross Ref
- N. Tromp, P. Hekkert, and P.-P. Verbeek, "Design for socially responsible behavior: a classification of influence based on intended user experience," Design Issues, vol. 27, no. 3, pp. 3--19, 2011.Google ScholarCross Ref
- P. J. Lang, "The emotion probe: Studies of motivation and attention," American psychologist, vol. 50, no. 5, pp. 372, 1995.Google ScholarCross Ref
- K. Nesbitt, K. Blackmore, G. Hookham, F. Kay-Lambkin, and P. Walla, "Using the Startle Eye-Blink to Measure Affect in Players," Serious Games Analytics: Methodologies for Performance Measurement, Assessment, and Improvement, C. S. Loh, Y. Sheng and D. Ifenthaler, eds., pp. 401--434, Cham: Springer International Publishing, 2015.Google Scholar
- O. Villon, and C. Lisetti, "A user model of psycho-physiological measure of emotion," Proceedings of the 11th International Conference on User Modeling (UM2007), 2007. Google ScholarDigital Library
- K. Väänänen-Vainio-Mattila, V. Roto, and M. Hassenzahl, "Towards practical user experience evaluation methods," Meaningful measures: Valid useful user experience measurement (VUUM), pp. 19--22, 2008.Google Scholar
- Y.-P. Lin, C.-H. Wang, T.-P. Jung, T.-L. Wu, S.-K. Jeng, J.-R. Duann, and J.-H. Chen, "EEG-based emotion recognition in music listening," IEEE Transactions on Biomedical Engineering, vol. 57, no. 7, pp. 1798--1806, 2010.Google ScholarCross Ref
- M. Williamson, "Emotions, reason and behaviour: A search for the truth," Journal of Consumer Behaviour, vol. 2, no. 2, pp. 196--202, 2002.Google ScholarCross Ref
- U. R. Acharya, F. Molinari, S. V. Sree, S. Chattopadhyay, K.-H. Ng, and J. S. Suri, "Automated diagnosis of epileptic EEG using entropies," Biomedical Signal Processing and Control, vol. 7, no. 4, pp. 401--408, 2012.Google ScholarCross Ref
- J. Kosiński, K. Szklanny, A. Wieczorkowska, and M. Wichrowski, "An analysis of game-related emotions using Emotiv EPOC." pp. 913--917, Proceedings of the Federated Conference on Computer Science and Information Systems, 2018.Google Scholar
- P. C. Petrantonakis, and L. J. Hadjileontiadis, "A novel emotion elicitation index using frontal brain asymmetry for enhanced EEG-based emotion recognition," IEEE Transactions on information technology in biomedicine, vol. 15, no. 5, pp. 737--746, 2011. Google ScholarDigital Library
- K. Stytsenko, E. Jablonskis, and C. Prahm, "Evaluation of consumer EEG device Emotiv EPOC," Proceedings of the MEi: CogSci Conference 2011, Ljubljana, 2011.Google Scholar
- N. A. Badcock, P. Mousikou, Y. Mahajan, P. De Lissa, J. Thie, and G. McArthur, "Validation of the Emotiv EPOC® EEG gaming system for measuring research quality auditory ERPs," PeerJ, vol. 1, pp. e38, 2013.Google ScholarCross Ref
- R. Lievesley, M. Wozencroft, and D. Ewins, "The Emotiv EPOC neuroheadset: an inexpensive method of controlling assistive technologies using facial expressions and thoughts?," Journal of Assistive Technologies, vol. 5, no. 2, pp. 67--82, 2011.Google ScholarCross Ref
- A. Kawala-Janik, M. Podpora, A. Gardecki, W. Czuczwara, J. Baranowski, and W. Bauer, "Game controller based on biomedical signals." pp. 934--939, Proceedings of the 20th International Conference on Methods and Models in Automation and Robotics (MMAR), 2015.Google Scholar
- T. McMahan, I. Parberry, and T. D. Parsons, "Modality specific assessment of video game player's experience using the Emotiv," Entertainment Computing, vol. 7, pp. 1--6, 2015/03/01/, 2015.Google ScholarCross Ref
- D. Boucha, A. Amiri, and D. Chogueur, "Controlling electronic devices remotely by voice and brain waves." pp. 38--42, Proceedings of the 2017 International Conference on Mathematics and Information Technology (ICMIT), 2017.Google Scholar
- A. E. Alchalcabi, A. N. Eddin, and S. Shirmohammadi, "More attention, less deficit: Wearable EEG-based serious game for focus improvement." pp. 1--8, Proceedings of the 2017 IEEE 5th International Conference on Serious Games and Applications for Health (SeGAH), 2017.Google ScholarCross Ref
Index Terms
- Taking the Subjectivity out of UX Evaluation with Emotiv EPOC+
Recommendations
Emotion recognition using the emotiv EPOC device
ICONIP'12: Proceedings of the 19th international conference on Neural Information Processing - Volume Part VEmotion plays an important role in the interaction between humans as emotion is fundamental to human experience, influencing cognition, perception, learning communication, and even rational decision-making. Therefore, studying emotion is indispensable. ...
How to evaluate emotional experiences in television drama series: Improving viewer evaluations by psychophysiological measurements and self-reports
ECCE '18: Proceedings of the 36th European Conference on Cognitive ErgonomicsThis paper describes experiences with new methodological approaches utilized in early viewer evaluations of a public service television drama series. We would like to challenge self-reports as the only source of data in viewer evaluations of television ...
CogniMeter: EEG-Based Brain States Monitoring
Special Issue on Cyberworlds and Cybersecurity on Transactions on Computational Science XXVIII - Volume 9590Electroencephalogram EEG techniques are traditionally used in the medical field. Recent research work focuses on applying these techniques to daily life with wireless and relatively low-price EEG devices available in the market. As a result, ...
Comments