ABSTRACT
DevOps is an intermarriage between developmental practices and operational modalities. The methodology employs the practices of continuous integration and delivery and places the deployment pipeline as the main requirement to automate, deliver and operate software in a robust way, without compromising on the quality in the software development process. Over time, many systems and tools have been developed to implement the deployment pipeline and support the continuous delivery process. A pipeline splits the process of software delivery into various stages. Each stage is designed to verify the quality of new features from a new perspective to attest to the functionality and prevent either small or big errors from impacting the end users. The pipeline must provide a response and feedback loop to the concerned team and provide a window into the flow of changes that takes place. However, there is no clear rule to define what goes into a pipeline. This paper reviews the challenges of quality assurance of DevOps and provides tentative recommendations to deal with quality issues. Our proposed pipeline with analytic features is expected to provide accurate metrics on a real-time basis.
- A. Chakraborty, K. K. Ramachandran, S. S. R. K. C. Yamijala, S. K. Pati, and T. K. Maji, "A hexanuclear Cu(i) cluster supported by cuprophilic interaction: Effects of aromatics on luminescence properties," RSC Adv., vol. 4, no. 66, pp. 35167--35170, 2014.Google ScholarCross Ref
- M. Shahin, M. Zahedi, M. Ali Babar, L. Zhu, M. A. Babar, and L. Zhu, "An empirical study of architecting for continuous delivery and deployment," Springer, 2018.Google Scholar
- P. Perera, R. Silva, and I. Perera, "Improve software quality through practicing DevOps," in 17th International Conference on Advances in ICT for Emerging Regions, ICTer 2017 - Proceedings, 2018, vol. 2018--Janua, pp. 13--18.Google Scholar
- A. Qumer Gill, A. Loumish, I. Riyat, and S. Han, "DevOps for Information Management," VINE J. Inf. Knowl. Manag. Syst., vol. 48, no. 1, pp. 122--139, 2018.Google ScholarCross Ref
- A. Steffens, H. Lichter, and J. S. Döring, "Designing a Next-Generation Continuous Software Delivery System: Concepts and Architecture," pp. 1--7, 2018. Google ScholarDigital Library
- M. Senapathi, J. Buchan, and H. Osman, "DevOps Capabilities, Practices, and Challenges," Proc. 22nd Int. Conf. Eval. Assess. Softw. Eng. 2018 - EASE'18, pp. 57--67, 2018. Google ScholarDigital Library
- CapGemini, "World Quality Report 2015-16," 2016.Google Scholar
- J. Humble and D. Farley, Continuous Delivery: Reliable Software Releases through Build, Test, and Deployment Automation (Adobe Reader). Pearson Education, 2010. Google ScholarDigital Library
- L. Bass, I. Weber, and L. Zhu, DevOps: A Software Architect's Perspective. Pearson Education, 2015. Google ScholarDigital Library
- S. A. I. B. S. Arachchi and I. Perera, "Continuous Integration and Continuous Delivery Pipeline Automation for Agile Software Project Management," no. May, 2018.Google Scholar
- M. Shahin, M. Ali Babar, and L. Zhu, "Continuous Integration, Delivery and Deployment: A Systematic Review on Approaches, Tools, Challenges and Practices," IEEE Access, vol. 5, no. Ci. pp. 3909--3943, 2017.Google ScholarCross Ref
- P. Perera, M. Bandara, and I. Perera, "Evaluating the impact of DevOps practice in Sri Lankan software development organizations," 16th Int. Conf. Adv. ICT Emerg. Reg. ICTer 2016 - Conf. Proc., pp. 281--287, 2017.Google Scholar
- L. Chen, "Continuous delivery: Huge benefits, but challenges too," IEEE Softw., 2015.Google Scholar
- M. Shahin, M. A. Babar, M. Zahedi, and L. Zhu, "Beyond Continuous Delivery: An Empirical Investigation of Continuous Deployment Challenges," in International Symposium on Empirical Software Engineering and Measurement, 2017, vol. 2017--Novem, pp. 111--120. Google ScholarDigital Library
- E. Laukkanen, T. O. A. Lehtinen, J. Itkonen, M. Paasivaara, and C. Lassenius, "Bottom-up Adoption of Continuous Delivery in a Stage-Gate Managed Software Organization," Proc. 10th ACM/IEEE Int. Symp. Empir. Softw. Eng. Meas. - ESEM '16, pp. 1--10, 2016. Google ScholarDigital Library
- Hadar Hawk, "IBM Cloud Continuous Delivery: Build, deploy, and manage apps with toolchains." {Online}. Available: https://www.ibm.com/cloud/garage/content/deliver/tool_continuous_delivery. {Accessed: 02-Jan-2019}.Google Scholar
- S. Gerstner, "Cognitive QA -- leveraging AI and Analytics for data driven QA," 2018. {Online}. Available: https://www.sogeti.no/globalassets/norway/downloads/testexpo/test-expo-2018-downloads/stefan-gerstner-cognitive-qa-leveraging-ai-and-analytics-for-data-driven-qa.pdf. {Accessed: 02-Jan-2019}.Google Scholar
Index Terms
- Managing Quality Assurance Challenges of DevOps through Analytics
Recommendations
Adoption Issues in DevOps from the Perspective of Continuous Delivery Pipeline
ICSCA '19: Proceedings of the 2019 8th International Conference on Software and Computer ApplicationsDevOps and Continuous Delivery (CD) are the terms that are always related to each other in Software Delivery and Operation Process area. DevOps introduces a significant agile perspective to deliver the software product in short cycle time that will ...
Understanding DevOps critical success factors and organizational practices
IWSiB '22: Proceedings of the 5th International Workshop on Software-intensive Business: Towards Sustainable Software BusinessDevOps is a combination of practices and a company culture which aims minimize the barriers between the operation and development teams in the organization. As its adoption and use in the industry has been growing, different kinds of research are trying ...
Systematic literature review on the impacts of agile release engineering practices
ContextAgile release engineering (ARE) practices are designed to deliver software faster and cheaper to end users; hence, claims of such impacts should be validated by rigorous and relevant empirical studies. ObjectiveThe study objective was to analyze ...
Comments