skip to main content
10.1145/3457784.3457832acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicscaConference Proceedingsconference-collections
research-article

The Method and Metric of User Experience Evaluation: A Systematic Literature Review

Published:30 July 2021Publication History

ABSTRACT

With the growth of User Experience (UX) research field, researchers have developed various ways to implement UX evaluation method. These evaluation methods have different practice, evaluated application, and type of collected aspect. This article provides a systematic literature review on research papers from 2000 to 2019 related to UX evaluation, to better understand UX evaluation method and its implementation, what kind of application its applied to, and what type of collected metric. The result of this paper presents the most frequently used method is self-reported measurement that evaluates self-reported metric and issue-based metric and the least frequently used method is physiological measurement that evaluates emotion and stress metric.

References

  1. Mohammad Zarour and Mubarak Alharbi. 2017. User Experience Aspects and Dimensions: Systematic Literature Review. Cogent Engineering 4, 1 (December 2017), 52-59. https://doi.org/10.1080/23311916.2017.1421006Google ScholarGoogle ScholarCross RefCross Ref
  2. Marc Hassenzahl and Noam Tractinsky. 2006. User experience – a research agenda.Behaviour & Information Technology 25, 2 (March 2006), 91-97. https://doi.org/10.1080/01449290500330331Google ScholarGoogle Scholar
  3. Effie Lai-Chong Law, Virpi Roto, Marc Hassenzahl, Arnold P.O.S. Vermeeren, and Joke Kort. 2009. Understanding, scoping and defining user experience: a survey approach. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). Association for Computing Machinery, New York, NY, USA, 719–728. https://doi.org/10.1145/1518701.1518813Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. ISO 9241-110. 2020. https://www.iso.org/obp/ui/#iso:std:iso:9241:-110:ed-2:v1:enGoogle ScholarGoogle Scholar
  5. Lauralee Alben. 1996. Quality of experience: defining the criteria for effective interaction design. interactions 3, 3 (May/June 1996), 11–15. https://doi.org/10.1145/235008.235010Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Manon Holman and Funmi Adebesin. 2019. Taking the Subjectivity out of UX Evaluation with Emotiv EPOC+. In Proceedings of the South African Institute of Computer Scientists and Information Technologists 2019 (SAICSIT '19). Association for Computing Machinery, New York, NY, USA, Article 30, 1–10. https://doi.org/10.1145/3351108.3351139Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Jamil Hussain, Wajahat Ali Khan, Taeho Hur, Hafiz Syed Muhammad Bilal, Jaehun Bang, Anees Ul Hassan, Muhammad Afzal, and Sungyoung Lee. 2018. A Multimodal Deep Log-Based User Experience (UX) Platform for UX Evaluation. Sensors 18, 5(18 May 2018), 1622. https://doi.org/10.3390/s18051622Google ScholarGoogle Scholar
  8. Fu Guo, Yi Ding, Weilin Liu, Chang Liu, and Xuefeng Zhang. 2016. Can eye-tracking data be measured to assess product design? Visual attention mechanism should be considered. International Journal of Industrial Ergonomics 53 (May 2016), 229-235. https://doi.org/10.1016/j.ergon.2015.12.001Google ScholarGoogle ScholarCross RefCross Ref
  9. Camila Loiola Brito Maia and Elizabeth S. Furtado. 2016. A study about psychophysiological measures in user experience monitoring and evaluation. In Proceedings of the 15th Brazilian Symposium on Human Factors in Computing Systems (IHC '16). Association for Computing Machinery, New York, NY, USA, Article 7, 1–9. https://doi.org/10.1145/3033701.3033708Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Yulyani Arifin, Thomas Galih Sastria, and Edo Barlian.2018. User Experience Metric for Augmented Reality Application: A Review, Procedia Computer Science 135 (January 2018), 648-656. https://doi.org/10.1016/j.procs.2018.08.221"Google ScholarGoogle Scholar
  11. Luis Rivero and Tayana Conte. 2017. A Systematic Mapping Study on Research Contributions on UX Evaluation Technologies. In Proceedings of the XVI Brazilian Symposium on Human Factors in Computing Systems (IHC 2017). Association for Computing Machinery, New York, NY, USA, Article 5, 1–10. https://doi.org/10.1145/3160504.3160512Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Arnold P. O. S. Vermeeren, Effie Lai-Chong Law, Virpi Roto, Marianna Obrist, Jettie Hoonhout, and Kaisa Väänänen-Vainio-Mattila. 2010. User experience evaluation methods: current state and development needs. In Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries (NordiCHI '10). Association for Computing Machinery, New York, NY, USA, 521–530. https://doi.org/10.1145/1868914.1868973Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Asbjørn Følstad and Rolf Kenneth Rolfsen. 2006. Measuring the Effect of User Experience Design Changes in e-Commerce Web Sites: a Case on Customer Guidance. In Proceedings of the 2nd International COST294-MAUSE Open Workshop. COST, Oslo, Norway, 10-15.Google ScholarGoogle Scholar
  14. Hala Magdy Hassan and Galal Hassan Galal-Edeen. 2017. From usability to user experience. In Proceedings of the International Conference on Intelligent Informatics and Biomedical Sciences (ICIIBMS). IEEE, Okinawa, Japan, 216-222. https://doi.org/10.1109/ICIIBMS.2017.8279761.Google ScholarGoogle ScholarCross RefCross Ref
  15. Marc Hassenzahl. 2003. The Thing and I: Understanding the Relationship Between User and Product. In: Blythe M.A., Overbeeke K., Monk A.F., Wright P.C. (eds) Funology. Human-Computer Interaction Series, vol 3. Springer, Dordrecht. https://doi.org/10.1007/1-4020-2967-5_4Google ScholarGoogle Scholar
  16. Sascha Mahlke. 2008. User Experience of Interaction with Technical Systems. PhD Thesis.Google ScholarGoogle Scholar
  17. William Albert and Thomas Tullis. 2013. Measuring the User Experience: Collecting, Analyzing, and Presenting Usability Metrics. Morgan Kaufmann. https://doi.org/10.1016/C2011-0-00016-9Google ScholarGoogle Scholar
  18. Helmut Prendinger, Junichiro Mori, and Mitsuru Ishizuka. 2005. Using human physiology to evaluate subtle expressivity of a virtual quizmaster in a mathematical game. Int. J. Hum. Comput. Stud. 62, 2 (February 2005), 231–245. https://doi.org/10.1016/j.ijhcs.2004.11.009Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Natasa Milic-Frayling, Martin Hicks, Rachel Jones, and Jamie Costello. 2007. On the design and evaluation of web augmented mobile applications. In Proceedings of the 9th international conference on Human computer interaction with mobile devices and services (MobileHCI '07). Association for Computing Machinery, New York, NY, USA, 226–233. https://doi.org/10.1145/1377999.1378011Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Gerald Madlmayr, Dominik Brandlberger, Josef Langer, and Josef Scharinger. 2008. Evaluation of SmartCard webserver as an application platform from a user's perspective. In Proceedings of the 6th International Conference on Advances in Mobile Computing and Multimedia (MoMM '08). Association for Computing Machinery, New York, NY, USA, 360–363. https://doi.org/10.1145/1497185.1497263Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Kaisa Väänänen-Vainio-Mattila and Minna Wäljas. 2009. Developing an expert evaluation method for user eXperience of cross-platform web services. In Proceedings of the 13th International MindTrek Conference: Everyday Life in the Ubiquitous Era (MindTrek '09). Association for Computing Machinery, New York, NY, USA, 162–169. https://doi.org/10.1145/1621841.1621871Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Areej Al-Wabil, Ebtisam Alabdulqader, Latifa Al-Abdulkarim, and Nora Al-Twairesh. 2010. Measuring the user experience of digital books with children: An eyetracking study of interaction with digital libraries. In Proceedings of the 2010 International Conference for Internet Technology and Secured Transactions. IEEE, London, 1-7.Google ScholarGoogle Scholar
  23. H Idyawati, Murni Mahmud, and Abu Osman Md Tap. 2010. User Experience: Assessing the effectiveness of Internet booking service. In Proceeding of the 2010 International Conference on User Science and Engineering (i-USEr). IEEE, Shah Alam, Malaysia, 1-6. https://doi.org/10.1109/IUSER.2010.5716712Google ScholarGoogle ScholarCross RefCross Ref
  24. Johanna Viitanen, Hannele Hyppönen, Tinja Lääveri, Jukka Vänskä, Jarmo Reponen, and Ilkka Winblad, 2011. National questionnaire study on clinical ICT systems proofs: Physicians suffer from poor usability. International Journal of Medical Informatics, 80, 10, 708-725. https://doi.org/10.1016/j.ijmedinf.2011.06.010.Google ScholarGoogle ScholarCross RefCross Ref
  25. Cynthia S Gadd, Yun-Xian Ho, Cather Marie Cala, Dana Blakemore, Qingxia Chen, Mark E Frisse, and Kevin B Johnson. 2011. User perspectives on the usability of a regional health information exchange. Journal of the American Medical Informatics Association, 18, 5 (27 May 2011), 711-6. https://doi.org/10.1136/amiajnl-2011-000281Google ScholarGoogle ScholarCross RefCross Ref
  26. Stephan Engl, and Lennart E. Nacke. 2013. Contextual influences on mobile player experience – A game user experience model. Entertainment Computing, 4, 1, 83-91. https://doi.org/10.1016/j.entcom.2012.06.001."Google ScholarGoogle ScholarCross RefCross Ref
  27. Annemie Heselmans, Bert Aertgeerts, Peter Donceel, Siegfried Geens, Stijn Van de Velde, and Dirk Ramaekers. 2012. Family Physicians’ Perceptions and Use of Electronic Clinical Decision Support During the First Year of Implementation. J Med Syst 36, 3677-3684. https://doi.org/10.1007/s10916-012-9841-3Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. A. Dhir and Mohammed Al-kahtani. 2013. A case study on user experience (UX) evaluation of mobile augmented reality prototypes. J. Univers. Comput. Sci. 19, 1175-1196. https://doi.org/10.3217/jucs-019-08-1175Google ScholarGoogle Scholar
  29. Jean-Luc Lugrin, Marc Cavazza, Fred Charles, Marc Le Renard, Jonathan Freeman, and Jane Lessiter. 2013. Immersive FPS games: user experience and performance. In Proceedings of the 2013 ACM international workshop on Immersive media experiences (ImmersiveMe '13). Association for Computing Machinery, New York, NY, USA, 7–12. https://doi.org/10.1145/2512142.2512146Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Jia Tan, Kari Rönkkö, and Cigdem Gencel. 2013. A Framework for Software Usability and User Experience Measurement in Mobile Industry. In Proceedings of the 2013 Joint Conference of the 23nd International Workshop on Software Measurement (IWSM) and the 8th International Conference on Software Process and Product Measurement (IWSM-MENSURA '13). IEEE Computer Society, USA, 156–164. https://doi.org/10.1109/IWSM-Mensura.2013.31Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Tuuli Keskinen, Jaakko Hakulinen, Tomi Heimonen, Markku Turunen, Sumita Sharma, Toni Miettinen, and Matti Luhtala. 2013. Evaluating the experiential user experience of public display applications in the wild. In Proceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia (MUM '13). Association for Computing Machinery, New York, NY, USA, Article 7, 1–10. https://doi.org/10.1145/2541831.2541840Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Casper Shyr, Andre Kushniruk, and Wyeth W Wasserman. 2014. Usability study of clinical exome analysis software: Top lessons learned and recommendations. J Biomed Inform 51, (October 2014), 129-136. https://doi.org/10.1016/j.jbi.2014.05.004Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Luca Colombo and Monica Landoni. 2014. A diary study of children's user experience with EBooks using flow theory as framework. In Proceedings of the 2014 conference on Interaction design and children (IDC '14). Association for Computing Machinery, New York, NY, USA, 135–144. https://doi.org/10.1145/2593968.2593978Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Sharmistha Roy, Prasant Kumar Pattnaik, and Rajib Mall. 2014. A quantitative approach to evaluate usability of academic websites based on human perception. Egyptian Informatics Journal 15, 3, 159-167. https://doi.org/10.1016/j.eij.2014.08.002.Google ScholarGoogle ScholarCross RefCross Ref
  35. Fotis Liarokapis, Kurt Debattista, Athanasios Vourvopoulos, Panagiotis Petridis, and Alina Ene. Comparing interaction techniques for serious games through brain–computer interfaces: A user perception evaluation study. Entertainment Computing 5, 4, 391-399. https://doi.org/10.1016/j.entcom.2014.10.004.Google ScholarGoogle Scholar
  36. A Kushniruk, J Kaipio, M Nieminen, H Hyppönen, T Lääveri, C Nohr, A M Kanstrup, M Berg Christiansen, M-H Kuo, and E Borycki. 2014. Human Factors in the Large: Experiences from Denmark, Finland and Canada in Moving Towards Regional and National Evaluations of Health Information System Usability. Contribution of the IMIA Human Factors Working Group. Yearb Med Inform 9, 1 (15 August 2014), 67-81. https://doi.org/10.15265/IY-2014-0023Google ScholarGoogle Scholar
  37. Ather Nawaz, Nina Skjæret, Kristine Ystmark, Jorunn L. Helbostad, Beatrix Vereijken, and Dag Svanæs. 2014. Assessing seniors' user experience (UX) of exergames for balance training. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational (NordiCHI '14). Association for Computing Machinery, New York, NY, USA, 578–587. https://doi.org/10.1145/2639189.2639235Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Luis Gustavo Rotoly de Lima, André de Lima Salgado, and André Pimenta Freire. 2015. Evaluation of the user experience and intrinsic motivation with educational and mainstream digital games. In Proceedings of the Latin American Conference on Human Computer Interaction (CLIHC '15). Association for Computing Machinery, New York, NY, USA, Article 11, 1–7. https://doi.org/10.1145/2824893.2824904Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Ankur Pant. 2015. Usability evaluation of an academic library website: Experience with the Central Science Library, University of Delhi. The Electronic Library 33, 5, 896-915. https://doi.org/10.1108/EL-04-2014-0067Google ScholarGoogle ScholarCross RefCross Ref
  40. Nova Eka Diana and Ocky Aditia Saputra. 2015. Measuring user experience of a potential shipment tracking application. In Proceedings of the International HCI and UX Conference in Indonesia (CHIuXiD '15). Association for Computing Machinery, New York, NY, USA, 47–51. https://doi.org/10.1145/2742032.2742039Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Carofiglio, Valeria and Ricci, Giuseppe and Abbattista, Fabio. 2015. User brain-driven evaluation of an educational 3D virtual environment. In Proceedings of 2015 10th Iberian Conference on Information Systems and Technologies (CISTI 2015). IEEE, Aveiro, Portugal, 1-7. https://doi.org/10.1109/CISTI.2015.7170553Google ScholarGoogle Scholar
  42. Marcin Wichrowski, Danijel Koržinek, and Krzysztof Szklanny. 2015. Google Glass Development in Practice: UX Design Sprint Workshops. In Proceedings of the Mulitimedia, Interaction, Design and Innnovation (MIDI '15). Association for Computing Machinery, New York, NY, USA, Article 11, 1–12. https://doi.org/10.1145/2814464.2814475Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Nouzha Harrati, Imed Bouchrika, Abdelkame Tari and Ammar Ladjailia. 2015. Automating the evaluation of usability remotely for web applications via a model-based approach. In Proceedings of the First International Conference on New Technologies of Information and Communication (NTIC). IEEE, Mila, Algeria, 1-6. https://doi.org/10.1109/NTIC.2015.7368757Google ScholarGoogle ScholarCross RefCross Ref
  44. Jakub Miler, and Agnieszka Landowska. Designing effective educational games - a case study of a project management game. 2016. In Proceedings of the 2016 Federated Conference on Computer Science and Information Systems (FedCSIS). IEEE, Gdańsk, Poland, 1657-1661. https://doi.org/10.15439/2016F434"Google ScholarGoogle ScholarCross RefCross Ref
  45. Bruno Fanini and Alfonsina Pagano. 2015. Interface Design for Serious Game Visual Strategies-The Case Study of "Imago Bononiae". In Proceedings of the 2015 Digital Heritage. IEEE, Granada, Spain, 623-626. https://doi.org/10.1109/DigitalHeritage.2015.7419583Google ScholarGoogle ScholarCross RefCross Ref
  46. Pride Bongiwe Nyambi and Mamello Thinyane Telkom. 2014. Persona mapping for usability of ICTD services. In Proceedings of the 2014 IEEE 6th International Conference on Adaptive Science & Technology (ICAST). IEEE, Ota, Nigeria, 1-7. https://doi.org/10.1109/ICASTECH.2014.7068128Google ScholarGoogle ScholarCross RefCross Ref
  47. Joelma Choma, Luciana A.M. Zaina, and Tiago Silva da Silva. 2016. Working beyond technical aspects: an approach for driving the usability inspection adding the perspective of user experience. In Proceedings of the 34th ACM International Conference on the Design of Communication (SIGDOC '16). Association for Computing Machinery, New York, NY, USA, Article 11, 1–10. https://doi.org/10.1145/2987592.2987607Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. Yucheng Jin, Joris Klerkx, and Katrien Verbert. 2016. CircleBuy: a visual search based second screen application of buying products in videos. In Proceedings of the 8th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS '16). Association for Computing Machinery, New York, NY, USA, 287–292. https://doi.org/10.1145/2933242.2935871Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. Nouzha Harrati, Imed Bouchrika, Abdelkamel Tari, and Ammar Ladjailia. 2016. Exploring user satisfaction for e-learning systems via usage-based metrics and system usability scale analysis. Comput. Hum. Behav. 61, C (August 2016), 463–471. https://doi.org/10.1016/j.chb.2016.03.051Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. Daryoush D. Vaziri,Konstantin Aal, Corinna Ogonowski, Thomas Von Rekowski, Michael Kroll, Hannah R. Marston, Rakel Poveda, Yves J. Gschwind, Kim Delbaere, Rainer Wieching, and Volker Wulf. 2016.Exploring user experience and technology acceptance for a fall prevention system: results from a randomized clinical trial and a living lab. Eur Rev Aging Phys Act. 13, 6 (10 Juny 2016). https://doi.org/10.1186/s11556-016-0165-zGoogle ScholarGoogle Scholar
  51. Noraini Ibrahim, Masitah Ghazali, Tan Wee Quan, Rooster Tumeng, and Shahliza Abd Halim. 2017. An evaluation study on Dengue-Entomological Surveillance system using alpha acceptance test. International Journal on Advanced Science, Engineering and Information Technology, 7, 4-2. 10.18517/ijaseit.7.4-2.3410Google ScholarGoogle ScholarCross RefCross Ref
  52. Qing-Xing Qu, Fu Guo, and Vincent G. Duffy. 2017. Effective use of human physiological metrics to evaluate website usability: An empirical investigation from China. Aslib Journal of Information Management, 69, 4, 370-388. https://doi.org/10.1108/AJIM-09-2016-0155Google ScholarGoogle ScholarCross RefCross Ref
  53. Amorim, Ana and Boechat, Glaucya and Novais, Renato and Vieira, Vaninha and Villela, Karina. 2017. Quality Attributes Analysis in a Crowdsourcing based emergency. In Proceedings of the 19th International Conference on Enterprise Information Systems - Volume 2: ICEIS. SciTePress, Porto, Portugal, 501-509. https://doi.org/10.5220/0006360405010509Google ScholarGoogle Scholar
  54. Azham Hussain, Emmanuel O. C. Mkpojiogu, Ja'afaru Musa, and Salah Mortada. 2017. A user experience evaluation of Amazon Kindle mobile application. In Proceedings of the AIP Conference Proceedings. AIP, 1 (October 2017). https://doi.org/10.1063/1.5005393Google ScholarGoogle ScholarCross RefCross Ref
  55. Azham Hussain, Emmanuel O. C. Mkpojiogu, Najdawati Mohd Fadzil, and Norhasizasuriati Mohd Hassan. 2017. The UX of amila pregnancy on mobile device. In Proceedings of the AIP Conference Proceedings. AIP, 1 (October 2017). https://doi.org/10.1063/1.5005394Google ScholarGoogle ScholarCross RefCross Ref
  56. Kazi Md. Munim, Iyolita Islam, Mahmuda Khatun, Md Mahboob Karim, and Muhammad Nazrul Islam. 2017. Towards developing a tool for UX evaluation using facial expression. In Proceedings of The 2017 3rd International Conference on Electrical Information and Communication Technology (EICT). IEEE, Khulna, Bangladesh, 1-6. https://doi.org/10.1109/EICT.2017.8275227Google ScholarGoogle ScholarCross RefCross Ref
  57. Giulia de Andrade Cardieri and Luciana Martinez Zaina. 2018. Analyzing User Experience in Mobile Web, Native and Progressive Web Applications: A User and HCI Specialist Perspectives. In Proceedings of the 17th Brazilian Symposium on Human Factors in Computing Systems (IHC 2018). Association for Computing Machinery, New York, NY, USA, Article 9, 1–11. https://doi.org/10.1145/3274192.3274201Google ScholarGoogle ScholarDigital LibraryDigital Library
  58. Mohd Kamal Othman, Muhd Nur Shaful Sulaiman, Shaziti Aman, and Vesna Popovic. 2018. Heuristic Evaluation: Comparing Generic and Specific Usability Heuristics for Identification of Usability Problems in a Living Museum Mobile Guide App. Adv. in Hum.-Comp. Int. 2018 (2018). https://doi.org/10.1155/2018/1518682Google ScholarGoogle Scholar
  59. Joachim Majors, Anette Bengs, Sören Granlund, Anu Ylitalo, and Maria Byholm. 2018. Moodle Moods? A User Experience Study of a Small Private Online Course for Higher Teacher Education. In Proceedings of the 22nd International Academic Mindtrek Conference (Mindtrek '18). Association for Computing Machinery, New York, NY, USA, 228–235. https://doi.org/10.1145/3275116.3275146Google ScholarGoogle ScholarDigital LibraryDigital Library
  60. Lisa Schuhmacher, Anne Pagenkopf, Ragavendra Lingamaneni, and Jürgen Scheible. 2018. Emotion Enhancement through Ubiquitous Media Technology in a Smart Kitchen Environment. In Proceedings of the 17th International Conference on Mobile and Ubiquitous Multimedia (MUM 2018). Association for Computing Machinery, New York, NY, USA, 317–325. https://doi.org/10.1145/3282894.3282904Google ScholarGoogle ScholarDigital LibraryDigital Library
  61. A.A. Istri Ita Paramitha, Gede Rasben Dantes, and Gede Indrawan. 2018. The evaluation of web based academic progress information system using heuristic evaluation and user experience questionnaire (UEQ). In Proceedings of The 2018 Third International Conference on Informatics and Computing (ICIC). IEEE, Palembang, Indonesia, 1-6. https://doi.org/10.1109/IAC.2018.8780430Google ScholarGoogle Scholar
  62. Bagus Anugrah Ramadhan and Billy Muhamad Iqbal. 2018. User Experience Evaluation on the Cryptocurrency Website by Trust Aspect. In Proceedings of 2018 International Conference on Intelligent Informatics and Biomedical Sciences (ICIIBMS). IEEE, Bangkok, Thailand, 274-279. https://doi.org/10.1109/ICIIBMS.2018.8550019Google ScholarGoogle ScholarCross RefCross Ref
  63. Wahyu Nur Hidayat, Setiadi Cahyono Putro, Mukhamad Angga Gumilang, and Indriana Hidayah. 2018. What is Informatics Education Students Impression of Using Metacognitive Training System at The First Time?. In Proceedings of The 2018 International Conference on Advanced Computer Science and Information Systems (ICACSIS). IEEE, Yogyakarta, Indonesia, 213-218. https://doi.org/10.1109/ICACSIS.2018.8618171Google ScholarGoogle ScholarCross RefCross Ref
  64. Johanna Kaipio, Anne Kuusisto, Hannele Hyppönen, Tarja Heponiemi, and Tinja Lääveri. 2019. Physicians’ and nurses’ experiences on EHR usability: Comparison between the professional groups by employment sector and system brand. International Journal of Medical Informatics 134. https://doi.org/10.1016/j.ijmedinf.2019.104018.Google ScholarGoogle Scholar
  65. Manon Holman and Funmi Adebesin. 2019. Taking the Subjectivity out of UX Evaluation with Emotiv EPOC+. In Proceedings of the South African Institute of Computer Scientists and Information Technologists 2019 (SAICSIT '19). Association for Computing Machinery, New York, NY, USA, Article 30, 1–10. https://doi.org/10.1145/3351108.3351139Google ScholarGoogle ScholarDigital LibraryDigital Library
  66. Siti Nur Aisyiah Syahrir and Sfenrianto. 2019. User experience questioner and heuristics evaluation in online learning environment. Journal of Theoretical and Applied Information Technology 97, 4 (February 2019), 1071-1081.Google ScholarGoogle Scholar
  67. Abdul Samad Dahri and Ahmaed Al-Athwari and A. Hussain. 2019. Usability evaluation of mobile health application from AI perspective in rural areas of Pakistan. Int. J. Interact. Mob. Technol. 13, 11 (2019), 213-225. https://doi.org/10.3991/ijim.v13i11.11513Google ScholarGoogle ScholarCross RefCross Ref
  68. Andrew Pringle, Stefanie Hutka, Jesse Mom, Robin van Esch, Niall Heffernan, and Paul Chen. 2019. Ethnographic study of a commercially available augmented reality HMD app for industry work instruction. In Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments (PETRA '19). Association for Computing Machinery, New York, NY, USA, 389–397. https://doi.org/10.1145/3316782.3322752Google ScholarGoogle ScholarDigital LibraryDigital Library
  69. Michael Carroll, Ethan Osborne, and Caglar Yildirim. 2019. Effects of VR gaming and game genre on player experience. In Proceedings of the 2019 IEEE Games, Entertainment, Media Conference (GEM). IEEE, New Haven, USA, 1-6. https://doi.org/10.1109/GEM.2019.8811554Google ScholarGoogle ScholarCross RefCross Ref
  70. Davidavičienė, V., Raudeliūnienė, J. and Viršilaitė, R. 2019. User experience evaluation and creativity stimulation with augmented reality mobile applications. Creativity Studies. 12, 1 (Mar. 2019), 34-48. https://doi.org/10.3846/cs.2019.3576.Google ScholarGoogle Scholar
  71. Chen-Wei Chang, Shih-Ching Yeh, Mengtong Li, and Eason Yao. 2019. The Introduction of a Novel Virtual Reality Training System for Gynecology Learning and Its User Experience Research. IEEE Access, 7, 1 (2019), 43637 - 43653. https://doi.org/10.1109/ACCESS.2019.2905143Google ScholarGoogle ScholarCross RefCross Ref
  72. Fahad Ahmed Satti, Jamil Hussain, H. S. Bilal, W. Khan, A. Khattak, Ju Eun Yeon, and S. Lee. 2019. Holistic User eXperience in Mobile Augmented Reality Using User eXperience Measurement Index. In Proceedings of The 2019 Conference on Next Generation Computing Applications (NextComp). IEEE, Mauritius, Mauritius, 1-6. https://doi.org/10.1109/NEXTCOMP.2019.8883528Google ScholarGoogle ScholarCross RefCross Ref
  73. Denizhan Demirkol and Cagla Seneler. 2019. Evaluation of Student Information System (SIS) In Terms of User Emotion, Performance and Perceived Usability: A Turkish University Case (An Empirical Study). Procedia Computer Science 158 (2019), 1033-1051. https://doi.org/10.1016/j.procs.2019.09.145.Google ScholarGoogle ScholarDigital LibraryDigital Library
  74. Jonathan Moizer, Jonathan Lean, Elena Dell'Aquila, Paul Walsh, Alphonsus (Alfie) Keary, Deirdre O'Byrne, Andrea Di Ferdinando, Orazio Miglino, Ralf Friedrich, Roberta Asperges, and Luigia Simona Sica. 2019. An approach to evaluating the user experience of serious games. Computers & Education 136 (2019), 141-151. https://doi.org/10.1016/j.compedu.2019.04.006Google ScholarGoogle ScholarDigital LibraryDigital Library
  75. Najeebullah Soomro, Meraj Chhaya, Mariam Soomro, Naukhez Asif, Emily Saurman, David Lyle, and Ross Sanders. 2019. Design, Development, and Evaluation of an Injury Surveillance App for Cricket: Protocol and Qualitative Study. JMIR Mhealth Uhealth 7, 1 (22 January 2019). https://doi.org/10.2196/10978Google ScholarGoogle Scholar
  76. Fasola P. Abifarin, Shaka Apodoghe Imavah, and Ayodele S. Olobashola. 2019. Design effectiveness of academic library web sites A comparison of university, polytechnic, and college sites in Nigeria. The Electronic Library 37, 3 (Juny 2019), 577-591. https://doi.org/10.1108/EL-08-2018-0159Google ScholarGoogle ScholarCross RefCross Ref
  77. Ryu Hyeongju and Kim Jeongeun. 2019. Evaluation of User Experience of New Defense Medical Information System. Healthcare Informatics Research 25, 2(April 2019), 73-81. https://doi.org/10.4258/hir.2019.25.2.73Google ScholarGoogle Scholar
  78. H. O'Brien and M. Lebow. 2013. Mixed-methods approach to measuring user experience in online news interactions. J. Assoc. Inf. Sci. Technol. 64, 1543-1556. https://doi.org/10.1002/asi.22871Google ScholarGoogle ScholarCross RefCross Ref

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in
  • Published in

    cover image ACM Other conferences
    ICSCA '21: Proceedings of the 2021 10th International Conference on Software and Computer Applications
    February 2021
    325 pages
    ISBN:9781450388825
    DOI:10.1145/3457784

    Copyright © 2021 ACM

    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 30 July 2021

    Permissions

    Request permissions about this article.

    Request Permissions

    Check for updates

    Qualifiers

    • research-article
    • Research
    • Refereed limited

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format .

View HTML Format