skip to main content
10.1145/3488392.3488398acmotherconferencesArticle/Chapter ViewAbstractPublication PagesclihcConference Proceedingsconference-collections
short-paper

Customer eXperience Evaluation Methodologies: A Literature Review

Published: 22 November 2021 Publication History

Abstract

Despite the multiple evaluation approaches (methods, instruments, and tools) available to evaluate the Customer eXperience (CX), there is a dearth of CX evaluation methodologies. This research presents a review of 12 studies mainly related to methodologies and evaluation approaches within them that are used –or can be used as a reference– to evaluate the CX. We conduct a literature review of papers published on ScienceDirect, Scopus, and Google Scholar. The review was based on the guidelines proposed by Kitchenham (2007) and shows that: (1) there is a lack of formal CX evaluation methodologies; (2) CX studies reviewed do not consider factors, such as touchpoints, channels, and dimensions; (3) CX studies reviewed do not validate their stages and do not provide sufficient detail for both stages and evaluation approaches within them; and (4) it is possible to use methodologies from other domains to fill the shortcomings found in CX studies reviewed.

References

[1]
Christopher Meyer and Andre Schwager. 2007. Understanding Customer experience. Harvard business review, 85(2), 116-126.
[2]
Peter C. Verhoef, Katherine N. Lemon, Ananthanarayanan Parasuraman, Anne Roggeveen, Michael Tsiros, and Leonard A. Schlesinger. 2009. Customer experience creation: Determinants, dynamics and management strategies. Journal of retailing, 85(1), 31-41.
[3]
ISO 9241-210. 2010. Ergonomics of human-system interaction — Part 210: Human-centred design for interactive systems. International Organization for Standardization.
[4]
Virginica Rusu, Cristian Rusu, Federico Botella, Daniela Quiñones, Camila Bascur, and Virginia Zaraza Rusu. 2020. Customer eXperience: A Bridge Between Service Science and Human-Computer Interaction. In International Conference on Human Systems Engineering and Design: Future Trends and Applications. 385-390. Springer, Cham.
[5]
James R. Lewis. 2014. Usability: lessons learned… and yet to be learned. International Journal of Human-Computer Interaction, 30(9), 663-684
[6]
Barbara Kitchenham and Stuart Charters, S. 2007. Guidelines for performing Systematic Literature Reviews in Software Engineering. Keele University and Durham University Joint Report.
[7]
Jennifer Rowley. 1999. Measuring total customer experience in museums. International journal of contemporary Hospitality management, 11(6), 303-308.
[8]
Mark Hurst. 2003. Joining Strategy and Usability: the Customer Experience Methodology. New York: Creative Good Inc. (11)
[9]
Robert Johnston and Xiangyu Kong. 2011. The customer experience: a road‐map for improvement. Managing Service Quality: An International Journal, 21, 5-24.
[10]
María Consuelo Figueroa and Osvaldo Gonzáles. 2015. Propuesta metodológica para la evaluación de experiencia de usuario en dispositivos móviles tipo Smartphone. Thesis. Pontificia Universidad Católica de Valparaíso, Valparaíso, Chile.
[11]
Camila Escudero and Angélica Gómez. 2017. Propuesta metodológica de evaluación de experiencia de usuario en agencias virtuales de viajes. Thesis. Pontificia Universidad Católica de Valparaíso, Valparaíso, Chile.
[12]
Teresita de Jesús Álvarez Robles. 2019. Metodología para la evaluación de la experiencia del usuario de Sistemas de Software Interactivos para usuarios ciegos. Ph.D. Dissertation. Universidad Veracruzana, Xalapa, México.
[13]
Mohammed Abboodi. 2014. A Framework for Measuring and Analyzing Customer Satisfaction at Computer Service Company using Lean Six Sigma. Master Thesis. University of Central Florida, Florida, USA.
[14]
Baqar Ali Zardari, Zahid Hussain, Aijaz Ahmed Arain, Wajid H. Rizvi, and Muhammad Saleem Vighio. 2020. QUEST e-learning portal: applying heuristic evaluation, usability testing and eye tracking. Universal Access in the Information Society, 1-13.
[15]
Kata Kapusy and Emma Lógó. 2020. User Experience Evaluation Methodology in the Onboarding Process: Snapchat Case Study. Ergonomics in Design, 1064804620962270.
[16]
Jorge Abreu, Pedro Almeida, and Telmo Silva. 2015. A UX evaluation approach for second-screen applications. In Applications and Usability of Interactive TV. 105-120. Springer, Cham.
[17]
Rosalie Allison, Catherine Hayes, Cliodna A. McNulty, and Vicki Young. 2019. A comprehensive framework to evaluate websites: literature review and development of GoodWeb. JMIR formative research, 3(4), e14372.
[18]
Mohammed Arif, Hani M. Aburas, Abdullah Al Kuwaiti, and Dennis Kulonda. 2010. Suggestion systems: a usability-based evaluation methodology. Engineering Sciences, 21(2).

Cited By

View all

Index Terms

  1. Customer eXperience Evaluation Methodologies: A Literature Review
    Index terms have been assigned to the content through auto-classification.

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    CLIHC '21: Proceedings of the X Latin American Conference on Human Computer Interaction
    November 2021
    87 pages
    ISBN:9781450384896
    DOI:10.1145/3488392
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 22 November 2021

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. customer experience
    2. evaluation
    3. evaluation approaches
    4. instruments
    5. methodology
    6. methods
    7. tools

    Qualifiers

    • Short-paper
    • Research
    • Refereed limited

    Funding Sources

    • Agencia Nacional de Investigación y Desarrollo de Chile
    • Escuela de Ingeniería Informática, Pontificia Universidad Católica de Valparaíso, Chile

    Conference

    CLIHC 2021

    Acceptance Rates

    Overall Acceptance Rate 14 of 42 submissions, 33%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 146
      Total Downloads
    • Downloads (Last 12 months)29
    • Downloads (Last 6 weeks)2
    Reflects downloads up to 08 Mar 2025

    Other Metrics

    Citations

    Cited By

    View all

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media