skip to main content
10.1145/3530019.3531335acmotherconferencesArticle/Chapter ViewAbstractPublication PageseaseConference Proceedingsconference-collections
research-article

Assessing the Maturity of DevOps Practices in Software Industry: An Empirical Study of HELENA2 Dataset

Published: 13 June 2022 Publication History

Abstract

Currently, the software development organizations are adopting DevOps practices in order to develop quality product. Due to the lack of definition of DevOps, the principles, practices, and methods adopted in DevOps to determine success have changed substantially. There are several benefits of DevOps can be achieved if the DevOps practices are implemented effectively and efficiently. This study has been conducted to identify the DevOps practices that contribute to achieve a high level of DevOps. The qualitative and interpretive approach have been used for analyzing the HELENA2 dataset. The maturity is calculated using 36 DevOps practices based on the four different classifications: (1) rarely used DevOps, (2) sometimes used DevOps, (3) often used DevOps, and (4) always used DevOps with the help of degrees of addressing 18 goals. The maturity score for the different categories indicates that organizations that use DevOps always are more mature to achieve goals than organizations that use it rarely.

References

[1]
Hasselbring, Wilhelm. "Benchmarking as empirical standard in software engineering research." Evaluation and Assessment in Software Engineering. 2021. 365-372.
[2]
Richards, Mark, and Neal Ford. Fundamentals of Software Architecture: An Engineering Approach. O'Reilly Media, 2020.
[3]
Kuusinen, Kati, and Sofus Albertsen. "Industry-academy collaboration in teaching DevOps and continuous delivery to software engineering students: towards improved industrial relevance in higher education." 2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET). IEEE, 2019.
[4]
Khan, A. A., Shameem, M., Nadeem, M., & Akbar, M. A. (2021). Agile trends in Chinese global software development industry: Fuzzy AHP based conceptual mapping. Applied Soft Computing, 102, 107090.
[5]
Pedra, Mauro Lourenço, Mônica Ferreira da Silva, and Leonardo Guerreiro Azevedo. "DevOps Adoption: Eight Emergent Perspectives." arXiv preprint arXiv:2109.09601 (2021).
[6]
Shameem, Mohammad. "A Systematic Literature Review of Challenges Factors for Implementing DevOps Practices in Software Development Organizations: A Development and Operation Teams Perspective." Evolving Software Processes: Trends and Future Directions (2022): 187-199.
[7]
Hemon-Hildgen, Aymeric, Frantz Rowe, and Laetitia Monnier-Senicourt. "Orchestrating automation and sharing in DevOps teams: a revelatory case of job satisfaction factors, risk and work conditions." European journal of information systems 29, no. 5 (2020): 474-499.
[8]
Kaiser, Abhinav Krishna. "Brief Overview of DevOps." In Become ITIL® 4 Foundation Certified in 7 Days, pp. 21-50. Apress, Berkeley, CA, 2021.
[9]
Macarthy, Ruth W., and Julian M. Bass. "An empirical taxonomy of DevOps in practice." 2020 46th Euromicro Conference on Software Engineering and Advanced Applications (SEAA). IEEE, 2020.
[10]
Bobrov, Evgeny, "Teaching DevOps in academia and industry: reflections and vision." International Workshop on Software Engineering Aspects of Continuous Development and New Paradigms of Software Production and Deployment. Springer, Cham, 2019.
[11]
Shahin, Mojtaba, and M. Ali Babar. "On the role of software architecture in DevOps Transformation: An industrial case study." In Proceedings of the International Conference on Software and System Processes, pp. 175-184. 2020.
[12]
Díaz, Jessica, "Why are many businesses instilling a DevOps culture into their organization?." Empirical Software Engineering 26.2 (2021): 1-50.
[13]
Pérez-Sánchez, Juanjo, Joaquín Nicolás Ros, and Juan Manuel Carrillo de Gea. "DevOps Certification in IT Industry: Preliminary Findings." World Conference on Information Systems and Technologies. Springer, Cham, 2021.
[14]
Uzun AP, Uzun YO, DrS P, Kharchenko VS. 23. SDN IN CONTEXT OF DEVOPS TECHNOLOGY. Internet of Things for Industry and Human Applications.:241.
[15]
Abrahamsson, Pekka, "Towards a secure devops approach for cyber-physical systems: An industrial perspective." International Journal of Systems and Software Security and Protection (IJSSSP) 11.2 (2020): 38-57.
[16]
Marnewick, Carl, and Josef Langerman. "DevOps and Organizational Performance: The Fallacy of Chasing Maturity." IEEE Software 38, no. 5 (2020): 48-55.
[17]
Cusick, James J. "A Survey of Maturity Models from Nolon to DevOps and Their Applications in Process Improvement." arXiv preprint arXiv:1907.01878 (2019).
[18]
Teixeira, Daniel, "A maturity model for DevOps." International Journal of Agile Systems and Management 13.4 (2020): 464-511.
[19]
Marnewick, Carl, and Josef Langerman. "DevOps and Organizational Performance: The Fallacy of Chasing Maturity." IEEE Software 38.5 (2020): 48-55.
[20]
P. Bahrs, “Adopting the IBM DevOps approach for continuous software delivery: Adoption paths and the DevOps maturity model,” 2013.
[21]
S. Mohamed, “DevOps shifting software engineering strategy-value based perspective,” Int. J. Comput. Eng., vol. 17, no. 2, pp. 51–57, 2015.
[22]
G. Menzel and A. Macaulay, “DevOps - The Future of Application Lifecycle Automation,” Capgemini.Com, p. 24, 2015.
[23]
Zarour, Mohammad, "A research on DevOps maturity models." Int. J. Recent Technol. Eng. 8.3 (2019): 4854-4862.
[24]
Khan, Arif Ali, and Mohammad Shameem. "Multicriteria decision‐making taxonomy for DevOps challenging factors using analytical hierarchy process." Journal of software: evolution and process 32.10 (2020): e2263.
[25]
Marrero, Lilianny, and Hernán Astudillo. "DevOps-RAF: An assessment framework to measure DevOps readiness in software organizations." 2021 40th International Conference of the Chilean Computer Science Society (SCCC). IEEE, 2021.
[26]
Milivojevic, Marko. "DevOps-A Maturity Model for Small Software Companies." (2021).
[27]
Kuhrmann, Marco, Paolo Tell, Jil Klünder, Regina Hebig, Sherlock Licorish, and Stephen MacDonell. "Helena stage 2 results." ResearchGate (2018).

Cited By

View all
  • (2024)A Systematic Literature Review for Investigating DevOps Metrics to Implement in Software Development OrganizationsJournal of Software: Evolution and Process10.1002/smr.2733Online publication date: 27-Oct-2024
  • (2023)Trends of Software Development Methodologies Toward DevOps: Analysis and ReviewRecent Advances in Computer Science and Communications10.2174/266625581666623061912101816:8Online publication date: Oct-2023
  • (2023)Designing a ARRHHO with MCFSA-CNN based Models for DevOps practices in Software Organizations2023 International Conference on Integrated Intelligence and Communication Systems (ICIICS)10.1109/ICIICS59993.2023.10420955(1-6)Online publication date: 24-Nov-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
EASE '22: Proceedings of the 26th International Conference on Evaluation and Assessment in Software Engineering
June 2022
466 pages
ISBN:9781450396134
DOI:10.1145/3530019
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 June 2022

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. DevOps
  2. DevOps maturity
  3. DevOps practices
  4. Software development methods

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

EASE 2022

Acceptance Rates

Overall Acceptance Rate 71 of 232 submissions, 31%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)42
  • Downloads (Last 6 weeks)5
Reflects downloads up to 17 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)A Systematic Literature Review for Investigating DevOps Metrics to Implement in Software Development OrganizationsJournal of Software: Evolution and Process10.1002/smr.2733Online publication date: 27-Oct-2024
  • (2023)Trends of Software Development Methodologies Toward DevOps: Analysis and ReviewRecent Advances in Computer Science and Communications10.2174/266625581666623061912101816:8Online publication date: Oct-2023
  • (2023)Designing a ARRHHO with MCFSA-CNN based Models for DevOps practices in Software Organizations2023 International Conference on Integrated Intelligence and Communication Systems (ICIICS)10.1109/ICIICS59993.2023.10420955(1-6)Online publication date: 24-Nov-2023
  • (2023)Development of an Alignment Model for the Implementation of DevOps in SMEs: An Exploratory StudyIEEE Access10.1109/ACCESS.2023.334404011(144213-144225)Online publication date: 2023
  • (2023)Assessment of DevOps Lifecycle Phases and their Role in DevOps Implementation using Best–Worst MCDMInternational Journal of Information Technology10.1007/s41870-023-01566-316:4(2139-2147)Online publication date: 20-Oct-2023

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media