skip to main content
10.1145/3064857.3064858acmconferencesArticle/Chapter ViewAbstractPublication PagesdisConference Proceedingsconference-collections
abstract

Triangulation in UX Studies: Learning from Experience

Published: 10 June 2017 Publication History

Abstract

While the consideration of User Experience (UX) has become embedded in research and design processes, UX evaluation remains a challenging and strongly discussed area for both researchers in academia and practitioners in industry. A variety of different evaluation methods have been developed or adapted from related fields, building on identified methodology gaps. Although the importance of mixed methods and data-driven approaches to get well-founded study results of interactive systems has been emphasized numerous times, there is a lack of evolved understandings and recommendations of when and in which ways to combine different methods, theories, and data related to the UX of interactive systems. The workshop aims to gather experiences of user studies from UX professionals and academics to contribute to the knowledge of mixed methods, theories, and data in UX evaluation. We will discuss individual experiences, best practices, risks and gaps, and reveal correlations among triangulation strategies.

References

[1]
Javier A Bargas-Avila and Kasper Hornbæk. 2011. Old wine in new bottles or novel challenges: a critical analysis of empirical studies of user experience. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2689--2698.
[2]
R Burke Johnson, Anthony J Onwuegbuzie, and Lisa A Turner. 2007. Toward a definition of mixed methods research. Journal of mixed methods research 1, 2 (2007), 112--133.
[3]
Marianna Obrist, Virpi Roto, and Kaisa Väänänen-Vainio-Mattila. 2009. User experience evaluation: do you know which method to use? In CHI'09 Extended Abstracts on Human Factors in Computing Systems. ACM, 2763--2766.
[4]
Virpi Roto, Marianna Obrist, and Kaisa Väänänen-Vainio-Mattila. 2009a. User experience evaluation methods in academic and industrial contexts. In Proceedings of the Workshop UXEM, Vol. 9. Citeseer.
[5]
Virpi Roto, Kaisa Väänänen-Vainio-Mattila, Effie Law, and Arnold Vermeeren. 2009b. User experience evaluation methods in product development (UXEM'09). In IFIP Conference on Human-Computer Interaction. Springer, 981--982.
[6]
Kaisa Väänänen-Vainio-Mattila, Virpi Roto, and Marc Hassenzahl. 2008. Now let's do it in practice: user experience evaluation methods in product development. In CHI'08 extended abstracts on Human factors in computing systems. ACM, 3961--3964.
[7]
Koen van Turnhout, Arthur Bennis, Sabine Craenmehr, Robert Holwerda, Marjolein Jacobs, Ralph Niels, Lambert Zaad, Stijn Hoppenbrouwers, Dick Lenior, and René Bakker. 2014. Design patterns for mixed-method research in HCI. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational. ACM, 361--370.
[8]
Arnold POS Vermeeren, Effie Lai-Chong Law, Virpi Roto, Marianna Obrist, Jettie Hoonhout, and Kaisa Väänänen-Vainio-Mattila. 2010. User experience evaluation methods: current state and development needs. In Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries. ACM, 521--530.

Cited By

View all
  • (2022)The “DAUX Framework”: A Need-Centered Development Approach to Promote Positive User Experience in the Development of Driving AutomationUser Experience Design in the Era of Automated Driving10.1007/978-3-030-77726-5_10(237-271)Online publication date: 1-Jan-2022
  • (2020)Where We Come from and Where We Are Going: A Systematic Review of Human Factors Research in Driving AutomationApplied Sciences10.3390/app1024891410:24(8914)Online publication date: 14-Dec-2020
  • (2020)Evaluating Creativity Support Tools in HCI ResearchProceedings of the 2020 ACM Designing Interactive Systems Conference10.1145/3357236.3395474(457-476)Online publication date: 3-Jul-2020
  • Show More Cited By

Index Terms

  1. Triangulation in UX Studies: Learning from Experience

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    DIS '17 Companion: Proceedings of the 2017 ACM Conference Companion Publication on Designing Interactive Systems
    June 2017
    424 pages
    ISBN:9781450349918
    DOI:10.1145/3064857
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 10 June 2017

    Check for updates

    Author Tags

    1. evaluation
    2. mixed methods
    3. triangulation
    4. user experience

    Qualifiers

    • Abstract

    Conference

    DIS '17
    Sponsor:
    DIS '17: Designing Interactive Systems Conference 2017
    June 10 - 14, 2017
    Edinburgh, United Kingdom

    Acceptance Rates

    DIS '17 Companion Paper Acceptance Rate 107 of 487 submissions, 22%;
    Overall Acceptance Rate 1,158 of 4,684 submissions, 25%

    Upcoming Conference

    DIS '25
    Designing Interactive Systems Conference
    July 5 - 9, 2025
    Funchal , Portugal

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)33
    • Downloads (Last 6 weeks)6
    Reflects downloads up to 10 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2022)The “DAUX Framework”: A Need-Centered Development Approach to Promote Positive User Experience in the Development of Driving AutomationUser Experience Design in the Era of Automated Driving10.1007/978-3-030-77726-5_10(237-271)Online publication date: 1-Jan-2022
    • (2020)Where We Come from and Where We Are Going: A Systematic Review of Human Factors Research in Driving AutomationApplied Sciences10.3390/app1024891410:24(8914)Online publication date: 14-Dec-2020
    • (2020)Evaluating Creativity Support Tools in HCI ResearchProceedings of the 2020 ACM Designing Interactive Systems Conference10.1145/3357236.3395474(457-476)Online publication date: 3-Jul-2020
    • (2020)Towards a UX Assessment Method for AI-Enabled Domestic DevicesDistributed, Ambient and Pervasive Interactions10.1007/978-3-030-50344-4_24(336-347)Online publication date: 19-Jul-2020
    • (2018)How Usability Can Save the Day - Methodological Considerations for Making Automated Driving a Success StoryProceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3239060.3239076(278-290)Online publication date: 23-Sep-2018
    • (2018)A Bermuda Triangle?Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3174035(1-16)Online publication date: 21-Apr-2018

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media