skip to main content
10.1145/3316615.3316670acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicscaConference Proceedingsconference-collections
research-article

Managing Quality Assurance Challenges of DevOps through Analytics

Published:19 February 2019Publication History

ABSTRACT

DevOps is an intermarriage between developmental practices and operational modalities. The methodology employs the practices of continuous integration and delivery and places the deployment pipeline as the main requirement to automate, deliver and operate software in a robust way, without compromising on the quality in the software development process. Over time, many systems and tools have been developed to implement the deployment pipeline and support the continuous delivery process. A pipeline splits the process of software delivery into various stages. Each stage is designed to verify the quality of new features from a new perspective to attest to the functionality and prevent either small or big errors from impacting the end users. The pipeline must provide a response and feedback loop to the concerned team and provide a window into the flow of changes that takes place. However, there is no clear rule to define what goes into a pipeline. This paper reviews the challenges of quality assurance of DevOps and provides tentative recommendations to deal with quality issues. Our proposed pipeline with analytic features is expected to provide accurate metrics on a real-time basis.

References

  1. A. Chakraborty, K. K. Ramachandran, S. S. R. K. C. Yamijala, S. K. Pati, and T. K. Maji, "A hexanuclear Cu(i) cluster supported by cuprophilic interaction: Effects of aromatics on luminescence properties," RSC Adv., vol. 4, no. 66, pp. 35167--35170, 2014.Google ScholarGoogle ScholarCross RefCross Ref
  2. M. Shahin, M. Zahedi, M. Ali Babar, L. Zhu, M. A. Babar, and L. Zhu, "An empirical study of architecting for continuous delivery and deployment," Springer, 2018.Google ScholarGoogle Scholar
  3. P. Perera, R. Silva, and I. Perera, "Improve software quality through practicing DevOps," in 17th International Conference on Advances in ICT for Emerging Regions, ICTer 2017 - Proceedings, 2018, vol. 2018--Janua, pp. 13--18.Google ScholarGoogle Scholar
  4. A. Qumer Gill, A. Loumish, I. Riyat, and S. Han, "DevOps for Information Management," VINE J. Inf. Knowl. Manag. Syst., vol. 48, no. 1, pp. 122--139, 2018.Google ScholarGoogle ScholarCross RefCross Ref
  5. A. Steffens, H. Lichter, and J. S. Döring, "Designing a Next-Generation Continuous Software Delivery System: Concepts and Architecture," pp. 1--7, 2018. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. M. Senapathi, J. Buchan, and H. Osman, "DevOps Capabilities, Practices, and Challenges," Proc. 22nd Int. Conf. Eval. Assess. Softw. Eng. 2018 - EASE'18, pp. 57--67, 2018. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. CapGemini, "World Quality Report 2015-16," 2016.Google ScholarGoogle Scholar
  8. J. Humble and D. Farley, Continuous Delivery: Reliable Software Releases through Build, Test, and Deployment Automation (Adobe Reader). Pearson Education, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. L. Bass, I. Weber, and L. Zhu, DevOps: A Software Architect's Perspective. Pearson Education, 2015. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. S. A. I. B. S. Arachchi and I. Perera, "Continuous Integration and Continuous Delivery Pipeline Automation for Agile Software Project Management," no. May, 2018.Google ScholarGoogle Scholar
  11. M. Shahin, M. Ali Babar, and L. Zhu, "Continuous Integration, Delivery and Deployment: A Systematic Review on Approaches, Tools, Challenges and Practices," IEEE Access, vol. 5, no. Ci. pp. 3909--3943, 2017.Google ScholarGoogle ScholarCross RefCross Ref
  12. P. Perera, M. Bandara, and I. Perera, "Evaluating the impact of DevOps practice in Sri Lankan software development organizations," 16th Int. Conf. Adv. ICT Emerg. Reg. ICTer 2016 - Conf. Proc., pp. 281--287, 2017.Google ScholarGoogle Scholar
  13. L. Chen, "Continuous delivery: Huge benefits, but challenges too," IEEE Softw., 2015.Google ScholarGoogle Scholar
  14. M. Shahin, M. A. Babar, M. Zahedi, and L. Zhu, "Beyond Continuous Delivery: An Empirical Investigation of Continuous Deployment Challenges," in International Symposium on Empirical Software Engineering and Measurement, 2017, vol. 2017--Novem, pp. 111--120. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. E. Laukkanen, T. O. A. Lehtinen, J. Itkonen, M. Paasivaara, and C. Lassenius, "Bottom-up Adoption of Continuous Delivery in a Stage-Gate Managed Software Organization," Proc. 10th ACM/IEEE Int. Symp. Empir. Softw. Eng. Meas. - ESEM '16, pp. 1--10, 2016. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Hadar Hawk, "IBM Cloud Continuous Delivery: Build, deploy, and manage apps with toolchains." {Online}. Available: https://www.ibm.com/cloud/garage/content/deliver/tool_continuous_delivery. {Accessed: 02-Jan-2019}.Google ScholarGoogle Scholar
  17. S. Gerstner, "Cognitive QA -- leveraging AI and Analytics for data driven QA," 2018. {Online}. Available: https://www.sogeti.no/globalassets/norway/downloads/testexpo/test-expo-2018-downloads/stefan-gerstner-cognitive-qa-leveraging-ai-and-analytics-for-data-driven-qa.pdf. {Accessed: 02-Jan-2019}.Google ScholarGoogle Scholar

Index Terms

  1. Managing Quality Assurance Challenges of DevOps through Analytics

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      ICSCA '19: Proceedings of the 2019 8th International Conference on Software and Computer Applications
      February 2019
      611 pages
      ISBN:9781450365734
      DOI:10.1145/3316615

      Copyright © 2019 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 19 February 2019

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed limited

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader