skip to main content
10.1145/3322276.3322346acmconferencesArticle/Chapter ViewAbstractPublication PagesdisConference Proceedingsconference-collections
research-article

User Experience (UX) Capacity-Building: A Conceptual Model and Research Agenda

Published: 18 June 2019 Publication History

Abstract

Many User Experience (UX) practitioners face organizational barriers that limit their ability to influence product decisions. Unfortunately, there is little concrete knowledge about how to systematically overcome these barriers to optimize UX work and foster a stronger organizational UX culture. This paper introduces the concept of User Experience Capacity-Building (UXCB) to describe the process of building, strengthening, and sustaining effective UX practices throughout an organization. Through an integrated literature review of relevant HCI and capacity-building research, this paper defines UXCB and proposes a conceptual model that outlines the conditions, strategies, and outcomes that define a UXCB initiative. Five areas of future research are presented that aim to deepen our understanding of UXCB as both a practice and an area of scholarship.

References

[1]
Rui Alves, Pedro Valente, and Nuno Jardim Nunes. 2014. The state of user experience evaluation practice. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational (NordiCHI '14), 93--102.
[2]
Carmelo Ardito, Paolo Buono, Danilo Caivano, Maria Francesca Costabile, and Rosa Lanzilotti. 2014. Investigating and promoting UX practice in industry: An experimental study. International Journal of Human Computer Studies 72, 6: 542--551.
[3]
Irene Au, Richard Boardman, Robin Jeffries, Patrick Larvie, Antonella Pavese, Jens Riegelsberger, Kerry Rodden, and Molly Stevens. 2008. User experience at google- Focus on the user and all else will follow. In CHI '08 Extended Abstracts on Human Factors in Computing Systems, 3681--3686.
[4]
Michael Baizerman, Donald W Compton, and Stacey Hueftle Stockdill. 2002. Summary and analysis of the case studies: Themes across the cases. New Directions for Evaluation 2002, 93: 101--108.
[5]
Jakob Otkjær Bak, Kim Nguyen, Peter Risgaard, and Jan Stage. 2009. Bringing usability evaluation into practice: Field studies in two software organizations. In Proceedings of the Second International Workshop on the Interplay between Usability Evaluation and Software Development (I-USED '09).
[6]
Isabelle Bourgeois and J. Bradley Cousins. 2008. Informing evaluation capacity building through profiling organizational capacity for evaluation: An empirical examination of four Canadian Federal Government Organizations. Canadian Journal of Program Evaluation 23, 3 SPEC. ISSUE: 127--146.
[7]
Isabelle Bourgeois, Jane Whynot, and Étienne Thériault. 2015. Application of an organizational evaluation capacity self-assessment instrument to different organizations: Similarities and lessons learned. Evaluation and Program Planning 50: 47--55.
[8]
Jan vom Brocke, Alexander Simons, Björn Niehaves, Kai Riemer, Ralf Plattfaut, Anne Cleven, Jan Von Brocke, and Kai Reimer. 2009. Reconstructing the Giant: On the Importance of Rigour in Documenting the Literature Search Process. In 17th European Conference on Information Systems, 2206--2217.
[9]
Anders Bruun, Marta Kristin Larusdottir, Lene Nielsen, Peter Axel Nielsen, and John Stouby Persson. 2018. The role of UX professionals in agile development. In Proceedings of the 10th Nordic Conference on Human-Computer Interaction - NordiCHI '18, 352--363.
[10]
Anders Bruun and Jan Stage. 2014. Barefoot usability evaluations. Behaviour and Information Technology 33, 11: 1148--1167.
[11]
Anders Bruun and Jan Stage. 2015. New approaches to usability evaluation in software development: Barefoot and crowdsourcing. Journal of Systems and Software 105.
[12]
Tara Kolar Bryan. 2011. Exploring the Dimensions of Organizational Capacity for Local Social Service Delivery Organizations Using a Multi-Method Approach; Virginia Tech.
[13]
Michael Budwig, Soojin Jeong, and Kuldeep Kelkar. 2009. When user experience met agile: A case study. In Proceedings of the 27th International Conference Extended Abstracts on Human Factors in Computing Systems, 3075--3083.
[14]
Luis Cayola and José A. Macías. 2018. Systematic guidance on usability methods in user-centered software development. Information and Software Technology 97: 163--175.
[15]
Lorraine Chapman and Scott Plewes. 2014. A UX maturity model: Effective introduction of UX into organizations. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 12--22.
[16]
Elizabeth F. Churchill. 2017. The ROI of HCI. interactions 24, 3: 22--23.
[17]
J. Bradley Cousins, Swee C. Goh, Catherine J. Elliott, and Isabelle Bourgeois. 2014. Framing the capacity to do and use evaluation. New Directions for Evaluation 2014, 141: 7--23.
[18]
J. Earthy. 1998. Usability Maturity Model: Human Centredness Scale. INUSE Project Deliverable D5 5: 1--34.
[19]
Meghan Ede and Garett Dworman. 2016. Why Designers Might Want to Redesign Company Processes to Get to Better UX Design. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA '16, 840--848.
[20]
Susan Farrell and Jakob Nielsen. 2014. User Experience Careers.
[21]
Jennifer Fraser and Scott Plewes. 2015. Applications of a UX Maturity Model to Influencing HF Best Practices in Technology Centric Companies -- Lessons from Edison. Procedia Manufacturing 3.
[22]
Dominic Furniss, Paul Curzon, and Ann Blandford. 2018. Exploring organisational competences in Human Factors and UX project work: managing careers, project tactics and organisational strategy. Ergonomics 61, 6: 739--761.
[23]
Elizabeth Goodman, Erik Stolterman, and Ron Wakkary. 2011. Understanding interaction design practices. In Proceedings of the 2011 annual conference on Human factors in computing systems - CHI '11, 1061.
[24]
Colin M. Gray. 2016. "It's More of a Mindset Than a Method": UX Practitioners' Conception of Design Methods. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 4044--4055.
[25]
Colin M Gray, Austin L Toombs, and Shad Gross. 2015. Flow of Competence in UX Design Practice. Proceedings of the ACM CHI'15 Conference on Human Factors in Computing Systems 1: 3285--3294.
[26]
Delia Grenville. 2012. Framing participatory practices in a large corporation. In Proceedings of the 12th Participatory Design Conference on Exploratory Papers Workshop Descriptions Industry Cases, 133--136.
[27]
Rune Th. Høegh. 2008. Case study: integrating usability activities in a software development process. Behaviour & Information Technology 27, 4: 301--306.
[28]
Rune Th. Høegh, Christian M. Nielsen, Michael Overgaard, Michael B. Pedersen, and Jan Stage. 2006. The impact of usability reports and user test observations on developers' understanding of usability data: An exploratory study. International Journal of Human-Computer Interaction 21, 2: 173--196.
[29]
Laura Hokkanen, Yueqiang Xu, and Kaisa Väänänen. 2016. Focusing on user experience and business models in startups: Investigation of two-dimensional value creation. AcademicMindtrek 2016 - Proceedings of the 20th International Academic Mindtrek Conference: 59--67.
[30]
Stacey Hueftle Stockdill, Michael Baizerman, and Donald W. Compton. 2002. Toward a definition of the ECB process: A conversation with the ECB literature. New Directions for Evaluation 2002, 93: 7--26.
[31]
Anirudha Joshi, N. L. Sarda, and Sanjay Tripathi. 2010. Measuring effectiveness of HCI integration in software development processes. Journal of Systems and Software 83, 11: 2045--2058.
[32]
Pariya Kashfi, Agneta Nilsson, and Robert Feldt. 2017. Integrating User eXperience practices into software development processes: implications of the UX characteristics. PeerJ Computer Science 3.
[33]
Micky P. Kerr, David S. Knott, Michael A. Moss, Chris W. Clegg, and Robin P. Horton. 2008. Assessing the value of human factors initiatives. Applied Ergonomics 39: 305--315.
[34]
Suzanne Kieffer and Jean Vanderdonckt. 2016. STRATUS: A questionnaire for strategic usability assessment. In Proceedings of the 31st Annual ACM Symposium on Applied Computing - SAC '16, 205--212.
[35]
Janne van Kollenburg, Sander Bogers, Eva Deckers, Joep Frens, and Caroline Hummels. 2017. How Design-inclusive UXR Influenced the Integration of Project Activities. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI '17, 1408--1418.
[36]
Susan N Labin. 2014. Developing Common Measures in Evaluation Capacity Building. American Journal of Evaluation 35, 1: 107--115.
[37]
Susan N. Labin, Jennifer L. Duffy, Duncan C. Meyers, Abraham Wandersman, and Catherine A. Lesesne. 2012. A Research Synthesis of the Evaluation Capacity Building Literature. American Journal of Evaluation 33, 3: 307--338.
[38]
Thaísa C. Lacerda and Christiane Gresse von Wangenheim. 2018. Systematic literature review of usability capability/maturity models. Computer Standards & Interfaces 55: 95--105.
[39]
Marta Larusdottir, Jan Gulliksen, and Åsa Cajander. 2017. A license to kill -- Improving UCSD in Agile development. Journal of Systems and Software 123: 214--222.
[40]
Effie Lai Chong Law, Paul Van Schaik, and Virpi Roto. 2014. Attitudes towards user experience (UX) measurement. International Journal of Human Computer Studies 72, 6: 526--541.
[41]
Lassi A. Liikkanen. 2016. UX Strategy as a Kick-starter for Design Transformation in an Engineering Company. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA '16, 816--822.
[42]
Agnes Lisowska Masson, Denis Lalanne, and Timon Amstutz. 2017. A Usability Refactoring Process for Large-Scale Open Source Projects. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA '17, 1135--1143.
[43]
Ariel Liu, Victoria Schwanda Sosik, and Khadine Singh. 2018. Building Empathy: Scaling User Research for Organizational Impact. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18, 1--7.
[44]
Craig M. MacDonald. 2017. "It Takes a Village": On UX Librarianship and Building UX Capacity in Libraries. Journal of Library Administration 57, 2.
[45]
Job Mashapa, Edna Chelule, Darelle Van Greunen, and Alida Veldsman. 2013. Managing user experience - Managing change. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 660--677.
[46]
Job Mashapa, Edna Chelule, Darelle Greunen, Alida Veldsman, Job Mashapa, Edna Chelule, Darelle Greunen, Alida Veldsman, Managing User, Managing Change, Paula Kotz, Gary Marsden, Gitte Lindgaard, and Janet Wesson. 2013. Managing User Experience -- Managing Change. In Human-Computer Interaction -- INTERACT 2013 (Lecture Notes in Computer Science), 660--677.
[47]
Peter Merholz and Kristin Skinner. 2016. Org design for design orgs: Building and managing in-house design teams. O'Reilly Media, Sebastopol, CA.
[48]
National Resource Center. 2010. Strengthening Nonprofits: A Capacity Builder's Resource Library - Delivering Training and Technical Assistance.
[49]
Jakob Nielsen. 2006. Corporate UX Maturity: Stages 1--4. Retrieved June 11, 2018 from https://www.nngroup.com/articles/ux-maturity-stages-1--4/
[50]
Jakob Nielsen. 2006. Corporate UX Maturity: Stages 5--8. Retrieved June 11, 2018 from https://www.nngroup.com/articles/ux-maturity-stages-5--8/
[51]
James E. Nieters, Subbarao Ivaturi, and Garett Dworman. 2007. The internal consultancy model for strategic UXD relevance. In CHI '07 Extended Abstracts on Human Factors in Computing Systems, 1825--1832.
[52]
Sophie Norton, Andrew Milat, Barry Edwards, and Michael Giffin. 2016. Narrative review of strategies by organizations for building evaluation capacity. Evaluation and Program Planning 58: 1--19.
[53]
Tina Øvad, Nis Bornoe, Lars Bo Larsen, and Jan Stage. 2015. Teaching Software Developers to Perform UX Tasks. In Proceedings of the Annual Meeting of the Australian Special Interest Group for Computer Human Interaction on - OzCHI '15, 397--406.
[54]
Tina Øvad and Lars Bo Larsen. 2016. How to reduce the UX bottleneck -- train your software developers. Behaviour and Information Technology 35, 12.
[55]
Kerry Rodden, Hilary Hutchinson, and Xin Fu. 2010. Measuring the user experience on a large scale?: User-centered metrics for web applications. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2395--2398.
[56]
Janice Anne Rohn. 2007. How to organizationally embed UX in your company. Interactions 14, 3: 25--26.
[57]
Stephanie Rosenbaum, Janice Anne Rohn, and Judee Humburg. 2000. A toolkit for strategic usability: Results from workshops, panels, and surveys. In Proceedings of the SIGCHI conference on Human Factors in computing systems, 337--344.
[58]
Virpi Roto, Eija Kaasinen, Maaria Nuutinen, and Marko Seppänen. 2016. UX Expeditions in Business-to-Business Heavy Industry. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA '16, 833--839.
[59]
Jeff Sauro, Kristin Johnson, and Chelsea Meenan. 2017. From Snake-Oil to Science. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA '17, 1084--1091.
[60]
Eric Schaffer and Apala Lahiri. 2014. Institutionalization of UX: A Step-by-Step Guide to a User Experience Practice. Addison-Wesley, Upper Saddle River, NJ.
[61]
Mikael Brasholt Skov and Jan Stage. 2009. Training software developers and designers to conduct usability evaluations. Behaviour and Information Technology: 1--11.
[62]
Maria Stone, Frank Bentley, Brooke White, and Mike Shebanek. 2016. Embedding User Understanding in the Corporate Culture. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA '16, 823--832.
[63]
Tina Taylor-Ritzler, Yolanda Suarez-Balcazar, Edurne Garcia-Iriarte, David B. Henry, and Fabricio E. Balcazar. 2013. Understanding and Measuring Evaluation Capacity. American Journal of Evaluation 34, 2: 190--206.
[64]
Richard J. Torraco. 2005. Writing Integrative Literature Reviews: Guidelines and Examples. Human Resource Development Review 4, 3: 356--367.
[65]
Marcin Treder, Jerry Cao, and Vince Ho. 2017. Enterprise UX Industry Report: 2017 to 2018.
[66]
Algan Uskarc? and Onur Demirörs. 2017. Do staged maturity models result in organization-wide continuous process improvement? Insight from employees. Computer Standards and Interfaces 52: 25--40.
[67]
Adeola Yetunde Wale-Kolade. 2015. Integrating usability work into a large inter-organisational agile development project: Tactics developed by usability designers. Journal of Systems and Software 100: 54--66.
[68]
Jane Webster and Richard T Watson. 2002. Analyzing the Past to Prepare for the Future: Writing a Literature Review. MIS Quarterly 26, 2: xiii--xxiii.
[69]
Jeff Winter, Kari Rönkkö, and Mikko Rissanen. 2014. Identifying organizational barriers - A case study of usability work when developing software in the automation industry. Journal of Systems and Software 88, 1: 54--73.
[70]
Charles Yiu. 2013. UX design with international teams: Challenges and best practices. In CHI '13 Extended Abstracts on Human Factors in Computing Systems on, 2333--2336.
[71]
Reginald Tomas Yu-Lee. 2002. Essentials of capacity management. Wiley.

Cited By

View all
  • (2024)Human Resource Development (HRD) Strategies for Emerging EntrepreneurshipNavigating Usability and User Experience in a Multi-Platform World10.4018/979-8-3693-2337-3.ch008(221-248)Online publication date: 15-Nov-2024
  • (2024)Perceived Value of UX in Organizations: A Systematic Literature ReviewDesign, User Experience, and Usability10.1007/978-3-031-61356-2_12(177-194)Online publication date: 29-Jun-2024
  • (2023)Literature Reviews in HCI: A Review of ReviewsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581332(1-24)Online publication date: 19-Apr-2023
  • Show More Cited By

Index Terms

  1. User Experience (UX) Capacity-Building: A Conceptual Model and Research Agenda

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    DIS '19: Proceedings of the 2019 on Designing Interactive Systems Conference
    June 2019
    1628 pages
    ISBN:9781450358507
    DOI:10.1145/3322276
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 18 June 2019

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. design
    2. hci practice
    3. organizational capacity
    4. ux strategy

    Qualifiers

    • Research-article

    Conference

    DIS '19
    Sponsor:
    DIS '19: Designing Interactive Systems Conference 2019
    June 23 - 28, 2019
    CA, San Diego, USA

    Acceptance Rates

    DIS '19 Paper Acceptance Rate 105 of 415 submissions, 25%;
    Overall Acceptance Rate 1,053 of 4,269 submissions, 25%

    Upcoming Conference

    DIS '25
    Designing Interactive Systems Conference
    July 5 - 9, 2025
    Funchal , Portugal

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)148
    • Downloads (Last 6 weeks)8
    Reflects downloads up to 22 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Human Resource Development (HRD) Strategies for Emerging EntrepreneurshipNavigating Usability and User Experience in a Multi-Platform World10.4018/979-8-3693-2337-3.ch008(221-248)Online publication date: 15-Nov-2024
    • (2024)Perceived Value of UX in Organizations: A Systematic Literature ReviewDesign, User Experience, and Usability10.1007/978-3-031-61356-2_12(177-194)Online publication date: 29-Jun-2024
    • (2023)Literature Reviews in HCI: A Review of ReviewsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581332(1-24)Online publication date: 19-Apr-2023
    • (2023)Towards the conceptual design of ML-enhanced products: the UX value framework and the CoMLUX design processArtificial Intelligence for Engineering Design, Analysis and Manufacturing10.1017/S089006042200027037Online publication date: 30-Mar-2023
    • (2021)A Framework for Assessing Organizational User Experience (UX) CapacityInternational Journal of Human–Computer Interaction10.1080/10447318.2021.197981138:11(1064-1080)Online publication date: 28-Sep-2021
    • (2019)Having a Smarter City through Digital Urban Interfaces: An Evaluation MethodApplied Sciences10.3390/app91734989:17(3498)Online publication date: 24-Aug-2019

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media