research-article

User involvement in software development and system success: a systematic literature review

Authors:

Didar ZowghiAuthors Info & Claims

EASE '13: Proceedings of the 17th International Conference on Evaluation and Assessment in Software Engineering

Pages 125 - 130

https://doi.org/10.1145/2460999.2461017

Published: 14 April 2013 Publication History

Abstract

Context: In the last four decades involving users in the software development process is claimed to have a positive impact on the success of that software. However, previous reviews on this topic have produced conflicting results. Objectives: Our aim is to present a review on user involvement in software development process and investigate its relationship to software system success. Methods: For our exploration, we performed a Systematic Literature Review using the guidelines provided in the Evidence Based Software Engineering literature. Results: 87 relevant empirical studies were selected and reviewed that investigate various perspectives and concepts of user involvement in software development process during the period of 1980--2012. Among 87 studies reviewed, 59 report that user involvement positively contributes to system success, 7 suggest a negative contribution and 21 are uncertain. Conclusions: Our results show an overall positive impact of user involvement on system success. It also suggests that the relationship between user involvement and system success is neither direct nor simple, and it depends on many different factors and conditions surrounding systems development processes.

References

[1]

B. Ives and M. H. Olson, 'User involvement and MIS success: a review of research', Management science, vol. 30, no. 5, pp. 586--603, 1984.

[2]

K. E. Emam, S. Quintin, and N. H. Madhavji, 'User participation in the requirements engineering process: An empirical study', Requirements Engineering, vol. 1, no. 1, pp. 4--26, 1996.

Digital Library

[3]

E. L. Wagner and G. Piccoli, 'Moving beyond user participation to achieve successful IS design', Communications of the ACM, vol. 50, no. 12, pp. 51--55, 2007.

Digital Library

[4]

A. L. M. Cavaye, 'User participation in system development revisited', Information & Management, vol. 28, no. 5, pp. 311--323, 1995.

Digital Library

[5]

M. I. Hwang and R. G. Thorn, 'The effect of user engagement on system success: a meta-analytical integration of research findings', Information & Management, vol. 35, no. 4, pp. 229--236, 1999.

Digital Library

[6]

J. He and W. R. King, 'The role of user participation in information systems development: Implications from a meta-analysis', Journal of Management Information Systems, vol. 25, no. 1, pp. 301--331, 2008.

Digital Library

[7]

S. Kujala, 'User involvement: a review of the benefits and challenges', Behaviour & information technology, vol. 22, no. 1, pp. 1--16, 2003.

[8]

H. Barki and J. Hartwick, 'Rethinking the concept of user involvement', MIS quarterly, vol. 13, no. 1, pp. 53--63, 1989.

Digital Library

[9]

J. McKeen, T. Guimaraes, and J. C. Whetherbe, 'The Relationship between Participation and User Satisfaction of Four Contigency Factors', MIS Quarterly, 1992.

Digital Library

[10]

W. H. DeLone and E. R. McLean, 'Information systems success: The quest for the dependent variable', Information systems research, vol. 3, no. 1, pp. 60--95, 1992.

[11]

B. A. Kitchenham and S. Charters, 'Guidelines for performing systematic literature reviews in software engineering', 2007.

[12]

M. Staples and M. Niazi, 'Experiences using systematic review guidelines', Journal of Systems and Software, vol. 80, no. 9, pp. 1425--1437, 2007.

Digital Library

[13]

T. Dyba, T. Dingsoyr, and G. K. Hanssen, 'Applying systematic reviews to diverse study types: An experience report', in Empirical Software Engineering and Measurement, 2007. ESEM 2007. First International Symposium on, 2007, pp. 225--234.

Digital Library

[14]

N. Qureshi, N. Ikram, M. Bano, and M. Usman, 'Empirical Evidence in Software Architecture: A Systematic Literature Review Protocol', in The Sixth International Conference on Software Engineering Advances, 2011, pp. 534--538.

[15]

D. S. Cruzes and T. Dyba, 'Research synthesis in software engineering: A tertiary study', Information and Software Technology, vol. 53, no. 5, pp. 440--455, 2011.

Digital Library

[16]

M. L. Markus and J. Y. Mao, 'Participation in development and implementation-updating an old, tired concept for today's IS contexts', Journal of the Association for Information Systems, vol. 5, no. 11, p. 1, 2004.

Cited By

Myagkova I(2024)IMPROVING THE USER EXPERIENCE OF FINANCIAL TECHNOLOGY IT SERVICES BASED ON UX/UI RESEARCHStrategic decisions and risk management10.17747/2618-947X-2023-4-400-41414:4(400-414)Online publication date: 5-Jun-2024
https://doi.org/10.17747/2618-947X-2023-4-400-414
De-Rosende-Celeiro IFrancisco-Gilmartín VBautista-Blasco SÁvila-Álvarez A(2024)Co-creation and evaluation of an app to support reminiscence therapy interventions for older people with dementiaDIGITAL HEALTH10.1177/2055207624126184910Online publication date: 3-Oct-2024
https://doi.org/10.1177/20552076241261849
Jahn LEngelbutzeder PRandall DBollmann YNtouros VMichel LWulf V(2024)In Between Users and Developers: Serendipitous Connections and Intermediaries in Volunteer-Driven Open-Source Software DevelopmentProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642541(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642541
Show More Cited By

Index Terms

User involvement in software development and system success: a systematic literature review
1. Software and its engineering
  1. Software creation and management

Recommendations

Alignment of Stakeholder Expectations about User Involvement in Agile Software Development
EASE '17: Proceedings of the 21st International Conference on Evaluation and Assessment in Software Engineering

Context: User involvement is generally considered to contributing to user satisfaction and project success and is central to Agile software development. In theory, the expectations about user involvement, such as the PO's, are quite demanding in this ...
Power and Politics of User Involvement in Software Development
EASE '18: Proceedings of the 22nd International Conference on Evaluation and Assessment in Software Engineering 2018

[CONTEXT] Involving users in software development is a complex and multi-faceted concept. Empirical research that studies power and politics of user involvement in software development is scarce. [OBJECTIVE] In this paper, we present the results from a ...
Problems and challenges of user involvement in software development: an empirical study
EASE '15: Proceedings of the 19th International Conference on Evaluation and Assessment in Software Engineering

Context: The benefits of involving users in software development projects have been studied extensively in the last four decades and have been reported to contribute to user satisfaction thus leading to system success. However, the relationship between ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

EASE '13: Proceedings of the 17th International Conference on Evaluation and Assessment in Software Engineering

April 2013

268 pages

ISBN:9781450318488

DOI:10.1145/2460999

General Chair:
Fabio Q. B. da Silva
Universidade Federal de Pernambuco, Brazil
,
Program Chairs:
Natalia Juristo
Universidad Politécnica de Madrid, Spain
,
Guilherme Horta Travassos
Universidade Federal do Rio de Janeiro, Brazil

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Centro de Informatica - UFPE: Centro de Informatica - UFPE
SBC: Brazilian Computer Society
CNPq: Conselho Nacional de Desenvolvimento Cientifico e Tecn
CAPES: Brazilian Higher Education Funding Council

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 April 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

EASE '13

Sponsor:

Centro de Informatica - UFPE
SBC
CNPq
CAPES

EASE '13: 17th International Conference on Evaluation and Assessment in Software Engineering

April 14 - 16, 2013

Porto de Galinhas, Brazil

Acceptance Rates

EASE '13 Paper Acceptance Rate 31 of 94 submissions, 33%;

Overall Acceptance Rate 71 of 232 submissions, 31%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

49
Total Citations
View Citations
1,470
Total Downloads

Downloads (Last 12 months)82
Downloads (Last 6 weeks)14

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Myagkova I(2024)IMPROVING THE USER EXPERIENCE OF FINANCIAL TECHNOLOGY IT SERVICES BASED ON UX/UI RESEARCHStrategic decisions and risk management10.17747/2618-947X-2023-4-400-41414:4(400-414)Online publication date: 5-Jun-2024
https://doi.org/10.17747/2618-947X-2023-4-400-414
De-Rosende-Celeiro IFrancisco-Gilmartín VBautista-Blasco SÁvila-Álvarez A(2024)Co-creation and evaluation of an app to support reminiscence therapy interventions for older people with dementiaDIGITAL HEALTH10.1177/2055207624126184910Online publication date: 3-Oct-2024
https://doi.org/10.1177/20552076241261849
Jahn LEngelbutzeder PRandall DBollmann YNtouros VMichel LWulf V(2024)In Between Users and Developers: Serendipitous Connections and Intermediaries in Volunteer-Driven Open-Source Software DevelopmentProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642541(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642541
Salis RKusumo D(2024)Monitoring the Scrum Team Using Internal and External Measure2024 2nd International Conference on Software Engineering and Information Technology (ICoSEIT)10.1109/ICoSEIT60086.2024.10497493(76-81)Online publication date: 28-Feb-2024
https://doi.org/10.1109/ICoSEIT60086.2024.10497493
Gunatilake HGrundy JHoda RMueller I(2024)The impact of human aspects on the interactions between software developers and end-users in software engineering: A systematic literature reviewInformation and Software Technology10.1016/j.infsof.2024.107489(107489)Online publication date: May-2024
https://doi.org/10.1016/j.infsof.2024.107489
Akello CNabukenya J(2024)UCD–CE Integration: A Hybrid Approach to Reinforcing User Involvement in Systems Requirements Elicitation and Analysis TasksGroup Decision and Negotiation10.1007/s10726-024-09897-733:6(1355-1403)Online publication date: 5-Sep-2024
https://doi.org/10.1007/s10726-024-09897-7
Jesus FRocha RVanderlei IAraujo JFreitas F(2023)Design Thinking Evidence in Software Development: Results from a Systematic Mapping2023 IEEE International Conference on Enabling Technologies: Infrastructure for Collaborative Enterprises (WETICE)10.1109/WETICE57085.2023.10477817(1-6)Online publication date: 14-Dec-2023
https://doi.org/10.1109/WETICE57085.2023.10477817
Saudy REl-Ghazaly ANasr EGheith M(2023)A Proposed Keyword-Based Feature Extraction Approach for Labeling and Classifying Egyptian Mobile Apps Arabic Slang User Requirements ReviewsBig Data Technologies and Applications10.1007/978-3-031-33614-0_2(24-37)Online publication date: 26-May-2023
https://doi.org/10.1007/978-3-031-33614-0_2
Tremblay MHamel CViau-Guay AGiroux D(2022)User Experience of the Co-design Research Approach in eHealth: Activity Analysis With the Course-of-Action FrameworkJMIR Human Factors10.2196/355779:3(e35577)Online publication date: 9-Aug-2022
https://doi.org/10.2196/35577
Frich JBiskjaer MRemy CMacDonald Vermulen LDalsgaard P(2021)Revisiting the Role of User Research in Design CreativityProceedings of the 32nd European Conference on Cognitive Ergonomics10.1145/3452853.3452857(1-5)Online publication date: 26-Apr-2021
https://dl.acm.org/doi/10.1145/3452853.3452857
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten