skip to main content
10.1145/2074712.2074743acmotherconferencesArticle/Chapter ViewAbstractPublication PagesecceConference Proceedingsconference-collections
research-article

Combining interviews and scales in the multidimensional evaluation of user experience: a case study in 3D games

Authors Info & Claims
Published:24 August 2011Publication History

ABSTRACT

Motivation -- To study the convergence between different methods evaluating two dimensions of User Experience: usability and emotions.

Research approach -- A prospective experimental approach was used, in which 20 participants were asked to express their experience of two 3D applications of board sports. Scales, questionnaires and self-confrontation interviews are compared.

Findings -- The results show that participants' responses for the different scales broadly converge. However, regarding the users' emotions, the convergence between scales responses and statements in the interviews is less obvious.

Research limitations/Implications -- The sample size (twenty university students) restricts the possible generalization of the findings.

Originality/Value -- The research makes a contribution to study the effective gain of UX assessment approaches combining different methods.

Take away message -- Methods based on self-reports of experience are critical as questionnaires did not allow to make a clear distinction between UX of two applications.

References

  1. Attrakdiff (2011). http://www.attrakdiff.de/Google ScholarGoogle Scholar
  2. Bach, C., & Scapin, D. L. (2010). Comparing Inspections and User Testing for the Evaluation of Virtual Environments. IJHCI, 26(8), 786--824.Google ScholarGoogle Scholar
  3. Bangor, A., T. Kortum, P., & T. Miller, J. (2008) An Empirical Evaluation of the System Usability Scale. IJHCI, 24(6), 574--594.Google ScholarGoogle Scholar
  4. Barcenilla, J., & Bastien, J. M. C. (2009). L'acceptabilitéé des nouvelles technologies: quelles relations avec l'ergonomie, l'utilisabilité et l'expérience utilisateur? Le Travail Humain, 72, 311--331.Google ScholarGoogle ScholarCross RefCross Ref
  5. Battarbee, K. (2003). Defining co-experience. In DPPI'03, June 23--26. Pittsburgh, USA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Cahour, B., Brassac, C., Vermersch, P., Bouraoui, J.-L., Pachoud, B., & Salembier, P. (2007). ÉÉtude de l'expérience du sujet pour l'évaluation de nouvelles technologies: l'exemple d'une communication médiée. Revue d'anthropologie des connaissances 1(1), 85--120.Google ScholarGoogle Scholar
  7. Hassenzahl, M. (2003) The thing and I: understanding the relationship between user and product. In M. Blythe, C., et al. (Eds.). Funology: From Usability to Enjoyment (pp. 31--42). Dordrecht. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Kuutti, K. (2010). Where are the Ionians of user experience research? In NordiCHI '10, Reykjavik, Iceland (pp. 715--718). NY: ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Lang, P. J. (1980). Behavioral treatment and bio-behavioral assessment: Computer applications. In J. Sidowski, H. Johnson and T. Williams (Eds.), Technology in Mental Health Care Delivery Systems, (pp. 119--137). Norwood, NJ: Ablex.Google ScholarGoogle Scholar
  10. Law, E., & Hornbaek, K. (2007). Measures of usability and user experience (UX): correlation and confusion. In E. Law, et al. (Eds.), Towards a UX manifesto. COST 294-MAUSE affiliated Workshop, Lancaster (pp. 49--56): COST-ESF.Google ScholarGoogle Scholar
  11. Light, A. (2006). Adding method to meaning: a technique for exploring peoples' experience with technology. BIT, 25(2), 175--187.Google ScholarGoogle Scholar
  12. Mahlke, S. & Lindgaard, G. (2007). Emotional experiences and quality perception of interactive products. In J. Jacko (Ed.), HCII 2007 (pp. 164--173). Berlin: Springer-Verlag. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Mahlke, S. & Thüüring, M. (2007). Studying Antecedents of Emotional Experiences in Interactive Contexts. In CHI 2007 (pp. 915--918). NY: ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Scherer, K. R. (2001). Appraisal considered as a process of multi-level sequential checking. In K. R. Scherer, et al. (Eds.). Appraisal processes in emotion: Theory, Methods, Research (pp. 92--120). Oxford University Press.Google ScholarGoogle Scholar
  15. Vermeeren, A., Law, E., Roto, V., Obrist, M., & Vääänänen-Vainio-Mattila, K. (2010). User Experience Evaluation Methods: Current State and Development Needs, In NordiCHI '10, Reykjavik, Iceland. New York: ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Combining interviews and scales in the multidimensional evaluation of user experience: a case study in 3D games

            Recommendations

            Comments

            Login options

            Check if you have access through your login credentials or your institution to get full access on this article.

            Sign in
            • Published in

              cover image ACM Other conferences
              ECCE '11: Proceedings of the 29th Annual European Conference on Cognitive Ergonomics
              August 2011
              291 pages
              ISBN:9781450310291
              DOI:10.1145/2074712

              Copyright © 2011 ACM

              Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

              Publisher

              Association for Computing Machinery

              New York, NY, United States

              Publication History

              • Published: 24 August 2011

              Permissions

              Request permissions about this article.

              Request Permissions

              Check for updates

              Qualifiers

              • research-article

              Acceptance Rates

              Overall Acceptance Rate56of91submissions,62%

            PDF Format

            View or Download as a PDF file.

            PDF

            eReader

            View online with eReader.

            eReader