skip to main content
10.1145/1358628.1358967acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
technical-note

Now let's do it in practice: user experience evaluation methods in product development

Published: 05 April 2008 Publication History

Abstract

As the selection of products and services becomes profuse in the technology market, it is often the delighting user experience (UX) that differentiates a successful product from the competitors. Product development is no longer about implementing features and testing their usability, but understanding users' daily lives and evaluating if a product resonates with the in-depth user needs. Although UX is a widely adopted term in industry, the tools for evaluating UX in product development are still inadequate. Based on industrial case studies and the latest research on UX evaluation, this workshop forms a model for aligning the used UX evaluation methods to product development processes. The results can be used to advance the state of "putting UX evaluation into practice".

References

[1]
Alben, L. 1996, Quality of Experience: Defining the Criteria for Effective Interaction Design. Interactions, 3, 3, pp. 11--15.
[2]
Cockton, G. (2004). From quality in use to value in the world. In Proceedings of the CHI 04 Conference on Human Factors in Computing Systems. Extended abstracts (pp. 1287--1290). New York: ACM.
[3]
COST294-MAUSE (2006). Workshop on User Experience -- Towards a Unified View. In conjuction with NordiCHI 2006 conference, Oslo, Norway. http://www.cost294.org/
[4]
Desmet, P. M. A. (2003). Measuring emotion: Development and application of an instrument to measure emotional responses to products. In M. Blythe, C. Overbeeke, A. F. Monk, & P. C. Wright (Eds.), Funology: From Usability to Enjoyment (pp. 111--124). Dordrecht: Kluwer.
[5]
Desmet, P. M. A., Overbeeke, C. J., & Tax, S. J. E. T. (2001). Designing products with added emotional value: development and application of an approach for research through design. The design journal, 4, 32--47.
[6]
Hassenzahl, M. (2003). The thing and I: understanding the relationship between user and product. In M. Blythe, C. Overbeeke, A. F. Monk, & P. C. Wright (Eds.), Funology: From Usability to Enjoyment (pp. 31--42). Dordrecht: Kluwer.
[7]
Hassenzahl, M., Tractinsky, N. 2006, User Experience -- a Research Agenda. Behaviour and Information Technology, Vol. 25, No. 2, March-April 2006, pp. 91--97.
[8]
ISO 13407:1999, Human-Centred Design Proceses for Interactive Systems. International Standardization Organization (ISO), Switzerland.
[9]
Knemeyer, D. and Svoboda, E. (2005). User Experience - UX. interaction-design.org, http://interaction-design.org/encyclopedia/user_experience_or_ux.html.
[10]
Mäkelä, A., Fulton Suri, J. 2001, Supporting Users' Creativity: Design to Induce Pleasurable Experiences. Proceedings of the International Conference on Affective Human Factors Design, pp. 387--394.
[11]
Nielsen-Norman group (online). User Experience -- Our Definition. http://www.nngroup.com/about/userexperience.html
[12]
Nokia Corporation, 2005, Inspired Human Technology. White paper available at http://www.nokia.com/NOKIA_COM_1/About_Nokia/Press/White_Papers/pdf_files/backgrounder_inspired_human_technology.pdf
[13]
Norman, D. A., Miller, J., and Henderson, A. What you see, some of what's in the future, and how we go about doing it: HI at Apple Computer. Proc. CHI 1995, ACM Press (1995), 155
[14]
Oliver, R. L. (1980). A cognitive model of antecedents and consequences of satisfaction decisions. Journal of Marketing Research, 17, 460--469.
[15]
Pine, J. & Gilmore, J. H. (1999). The Experience Economy: Working is Theatre & Every Business a Stage. Boston MA: Harvard Business School Press.
[16]
Seidel, M., Loch, C., Chahil, S. (2005). Quo Vadis, Automotiven Industry? A Vision of Possible Industry Transformations. European Management Journal, Vol. 23, No. 4, pp. 439--449, 2005
[17]
Shedroff, N. An Evolving Glossary of Experience Design, online glossary at http://www.nathan.com/ed/glossary/
[18]
UPA (Usability Professionals' Association): "Usability Body of Knowledge", http://www.usabilitybok.org/glossary (23.5.2006)

Cited By

View all
  • (2023)The Application of Implicit Measures Evaluating Implicit Attitudes to Assess User Experience in the Human-Technology Interaction Field: A Scoping ReviewInternational Journal of Human–Computer Interaction10.1080/10447318.2023.227653040:23(7892-7907)Online publication date: 10-Nov-2023
  • (2022)The “DAUX Framework”: A Need-Centered Development Approach to Promote Positive User Experience in the Development of Driving AutomationUser Experience Design in the Era of Automated Driving10.1007/978-3-030-77726-5_10(237-271)Online publication date: 1-Jan-2022
  • (2022)User‐centered approaches in software development processes: Qualitative research into the practice of Hungarian companiesJournal of Software: Evolution and Process10.1002/smr.250135:2Online publication date: 25-Aug-2022
  • Show More Cited By

Index Terms

  1. Now let's do it in practice: user experience evaluation methods in product development

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI EA '08: CHI '08 Extended Abstracts on Human Factors in Computing Systems
    April 2008
    2035 pages
    ISBN:9781605580128
    DOI:10.1145/1358628
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 05 April 2008

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. evaluation methods
    2. product development
    3. user experience
    4. user-centered design

    Qualifiers

    • Technical-note

    Conference

    CHI '08
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)21
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 23 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)The Application of Implicit Measures Evaluating Implicit Attitudes to Assess User Experience in the Human-Technology Interaction Field: A Scoping ReviewInternational Journal of Human–Computer Interaction10.1080/10447318.2023.227653040:23(7892-7907)Online publication date: 10-Nov-2023
    • (2022)The “DAUX Framework”: A Need-Centered Development Approach to Promote Positive User Experience in the Development of Driving AutomationUser Experience Design in the Era of Automated Driving10.1007/978-3-030-77726-5_10(237-271)Online publication date: 1-Jan-2022
    • (2022)User‐centered approaches in software development processes: Qualitative research into the practice of Hungarian companiesJournal of Software: Evolution and Process10.1002/smr.250135:2Online publication date: 25-Aug-2022
    • (2021)Cross-Cultural Difference in Product Preference in Consumer Review-Based Text Mining Methods: a Case Study on Smart BandProceedings of the Human Factors and Ergonomics Society Annual Meeting10.1177/107118132064133064:1(1383-1387)Online publication date: 9-Feb-2021
    • (2021)Innovating Methods: Observing In Situ Technology Experiences Using Novel Visual Research MethodsInternational Journal of Human–Computer Interaction10.1080/10447318.2021.193838838:3(253-262)Online publication date: 16-Jun-2021
    • (2018)On the way to anticipated car UXProceedings of the 10th Nordic Conference on Human-Computer Interaction10.1145/3240167.3240219(494-504)Online publication date: 29-Sep-2018
    • (2018)Experiencing Expectations: Extending the Concept of UX AnticipationNordic Contributions in IS Research10.1007/978-3-319-96367-9_1(1-13)Online publication date: 6-Jul-2018
    • (2018)Towards a Conceptual Framework for the Objective Evaluation of User ExperienceDesign, User Experience, and Usability: Theory and Practice10.1007/978-3-319-91797-9_39(546-559)Online publication date: 2-Jun-2018
    • (2017)Learning Maths with MobilesBlended Learning10.4018/978-1-5225-0783-3.ch037(741-759)Online publication date: 2017
    • (2017)Triangulation in UX StudiesProceedings of the 2017 ACM Conference Companion Publication on Designing Interactive Systems10.1145/3064857.3064858(341-344)Online publication date: 10-Jun-2017
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media