Skip to main content

From DevOps to NoOps: Is It Worth It?

  • Conference paper
  • First Online:
Cloud Computing and Services Science (CLOSER 2020)

Abstract

With the rise of the adoption of microservice architecture due to its agility, scalability, and resiliency for building the cloud-based applications and their deployment using containerization, DevOps were in demand for handling the development and operations together. However, nowadays serverless computing offers a new way of developing and deploying cloud-native applications. Serverless computing also called NoOps, offloads management and server configuration (operations work) from the user to the cloud provider and lets the user focus only on the product developments. Hence, there are debates regarding which deployment strategy to use.

This research provides a performance comparison of a cloud-native web application along with three different function benchmarks in terms of scalability, reliability, and latency when deployed using DevOps and NoOps deployment strategy. NoOps deployment in this work is achieved using Google Cloud Function and OpenWhisk, while DevOps is achieved using the Kubernetes engine. This research shows that neither of the deployment strategies fits all the scenarios. The experimental results demonstrate that each type of deployment strategy has its advantages under different scenarios. The DevOps deployment strategy has a huge performance advantage (almost 72% lesser 90 percentile response time) for simple web-based requests and requests accessing databases while compute-intensive applications perform better with NoOps deployment. Additionally, NoOps deployment provides better scaling-agility as compared to DevOps.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    https://kubernetes.io/docs/.

  2. 2.

    https://cloud.google.com/kubernetes-engine.

  3. 3.

    https://github.com/umermansoor/microservices.

  4. 4.

    https://kubernetes.io/docs/setup/production-environment/tools/kubeadm/create-cluster-kubeadm/.

  5. 5.

    https://docs.influxdata.com/influxdb/v1.7/.

  6. 6.

    https://grafana.com/docs/grafana/latest/.

References

  1. Aws lambda - pricing. https://aws.amazon.com/lambda/pricing/. Accessed 30 July 2020

  2. Cloud functions overview. https://cloud.google.com/functions/docs/concepts/overview. Accessed 22 Aug 08 2020

  3. What is k6? https://k6.io/docs/. Accessed 28 July 2020

  4. Akbulut, A., Perros, H.G.: Performance analysis of microservice design patterns. IEEE Internet Comput. 23(6), 19–27 (2019)

    Article  Google Scholar 

  5. Şamdan, E.: Dealing with cold starts in AWS lambda (2018). https://medium.com/thundra/dealing-with-cold-starts-in-aws-lambda-a5e3aa8f532. Accessed 14 Feb 2020

  6. Apache: Openwhisk cli (2017). https://github.com/apache/openwhisk/blob/master/docs/cli.md#openwhisk-cli

  7. Apache: Openwhisk documentation (2017). https://openwhisk.apache.org/documentation.html

  8. Architect: Project philosophy (2020). https://arc.codes/intro/philosophy. Accessed 4 Feb 2020

  9. Avritzer, A., Ferme, V., Janes, A., Russo, B., Schulz, H., van Hoorn, A.: A quantitative approach for the assessment of microservice architecture deployment alternatives by automated performance testing. In: Cuesta, C.E., Garlan, D., Pérez, J. (eds.) ECSA 2018. LNCS, vol. 11048, pp. 159–174. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00761-4_11

    Chapter  Google Scholar 

  10. Baldini, I., et al.: Serverless computing: current trends and open problems. In: Chaudhary, S., Somani, G., Buyya, R. (eds.) Research Advances in Cloud Computing, pp. 1–20. Springer, Singapore (2017). https://doi.org/10.1007/978-981-10-5026-8_1

    Chapter  Google Scholar 

  11. Baldini, I., et al.: Serverless computing: current trends and open problems. CoRR abs/1706.03178 (2017). http://arxiv.org/abs/1706.03178

  12. Bhojwani, R.: Design patterns for microservice-to-microservice communication - DZone microservices, December 2018. https://dzone.com/articles/design-patterns-for-microservice-communication

  13. Casalicchio, E., Perciballi, V.: Auto-scaling of containers: the impact of relative and absolute metrics. In: 2017 IEEE 2nd International Workshops on Foundations and Applications of Self* Systems (FAS*W), pp. 207–214 (2017)

    Google Scholar 

  14. Di Francesco, P., Lago, P., Malavolta, I.: Migrating towards microservice architectures: an industrial survey. In: 2018 IEEE International Conference on Software Architecture (ICSA), pp. 29–38, April 2018. https://doi.org/10.1109/ICSA.2018.00012

  15. Eivy, A.: Be wary of the economics of “serverless” cloud computing. IEEE Cloud Comput. 4, 6–12 (2017)

    Article  Google Scholar 

  16. Fan., C., Jindal., A., Gerndt., M.: Microservices vs serverless: a performance comparison on a cloud-native web application. In: Proceedings of the 10th International Conference on Cloud Computing and Services Science, CLOSER, vol. 1, pp. 204–215. INSTICC, SciTePress (2020). https://doi.org/10.5220/0009792702040215

  17. Gancarz, R.: The economics of serverless computing: a real-world test (2017). https://techbeacon.com/enterprise-it/economics-serverless-computing-real-world-test. Accessed 23 Mar 2020

  18. GoogleCloud: Cloud functions execution environment. https://cloud.google.com/functions/docs/concepts/exec. Accessed 22 Aug 2020

  19. Handy, A.: Amazon introduces lambda, containers at AWS re:Invent (2014). https://sdtimes.com/amazon/amazon-introduces-lambda-containers/. Accessed 4 Feb 2020

  20. Hendrickson, S., Sturdevant, S., Harter, T., Venkataramani, V., Arpaci-Dusseau, A.C., Arpaci-Dusseau, R.H.: Serverless computation with openlambda. In: 8th USENIX Workshop on Hot Topics in Cloud Computing (HotCloud 2016) (2016)

    Google Scholar 

  21. Jambunathan, B., Yoganathan, K.: Architecture decision on using microservices or serverless functions with containers. In: 2018 International Conference on Current Trends Towards Converging Technologies (ICCTCT), pp. 1–7, March 2018. https://doi.org/10.1109/ICCTCT.2018.8551035

  22. Jamieson, F.: Losing the server? (2017). https://www.bcs.org/content-hub/losing-the-server/

  23. Jindal, A., Podolskiy, V., Gerndt, M.: Performance modeling for cloud microservice applications. In: Proceedings of the 2019 ACM/SPEC International Conference on Performance Engineering, ICPE 2019, pp. 25–32. Association for Computing Machinery, New York (2019). https://doi.org/10.1145/3297663.3310309

  24. Jonas, E., Pu, Q., Venkataraman, S., Stoica, I., Recht, B.: Occupy the cloud: distributed computing for the 99 cloud computing. In: SoCC 2017, pp. 445–451. Association for Computing Machinery, New York (2017). https://doi.org/10.1145/3127479.3128601

  25. Kozhirbayev, Z., Sinnott, R.O.: A performance comparison of container-based technologies for the cloud. Future Gener. Comput. Syst. 68, 175–182 (2017). https://doi.org/10.1016/j.future.2016.08.025. http://www.sciencedirect.com/science/article/pii/S0167739X16303041

  26. Lane, K.: Overview of the backend as a service (baaS) space. API Evangelist (2015)

    Google Scholar 

  27. Lee, H., Satyam, K., Fox, G.: Evaluation of production serverless computing environments. In: 2018 IEEE 11th International Conference on Cloud Computing (CLOUD), pp. 442–450, July 2018. https://doi.org/10.1109/CLOUD.2018.00062

  28. Lloyd, W., Ramesh, S., Chinthalapati, S., Ly, L., Pallickara, S.: Serverless computing: an investigation of factors influencing microservice performance. In: 2018 IEEE International Conference on Cloud Engineering (IC2E), pp. 159–169, April 2018. https://doi.org/10.1109/IC2E.2018.00039

  29. Lynn, T., Rosati, P., Lejeune, A., Emeakaroha, V.: A preliminary review of enterprise serverless cloud computing (function-as-a-service) platforms. In: 2017 IEEE International Conference on Cloud Computing Technology and Science (CloudCom), pp. 162–169, December 2017. https://doi.org/10.1109/CloudCom.2017.15

  30. Mohan, A., Sane, H., Doshi, K., Edupuganti, S., Nayak, N., Sukhomlinov, V.: Agile cold starts for scalable serverless. In: Proceedings of the 11th USENIX Conference on Hot Topics in Cloud Computing, HotCloud 2019, p. 21. USENIX Association (2019)

    Google Scholar 

  31. Mohanty, S.K., Premsankar, G., di Francesco, M.: An evaluation of open source serverless computing frameworks. In: 2018 IEEE International Conference on Cloud Computing Technology and Science (CloudCom), pp. 115–120, December 2018. https://doi.org/10.1109/CloudCom2018.2018.00033

  32. Novoseltseva, E.: Benefits of microservices architecture implementation (2017). https://dzone.com/articles/benefits-amp-examples-of-microservices-architectur. Accessed 23 Mar 2020

  33. Pierre-Louis, M.A.: OpenWhisk: a quick tech preview. DeveloperWorks Open, IBM, p. 7, 22 February 2016 (2016)

    Google Scholar 

  34. Pinto, D., Dias, J.P., Ferreira, H.S.: Dynamic allocation of serverless functions in IoT environments. In: 2018 IEEE 16th International Conference on Embedded and Ubiquitous Computing (EUC), pp. 1–8, October 2018. https://doi.org/10.1109/EUC.2018.00008

  35. Reese, W.: Nginx: the high-performance web server and reverse proxy. Linux J. 2008(173) (2008)

    Google Scholar 

  36. Richardson, C.: Introduction to microservices, May 2015. https://www.nginx.com/blog/introduction-to-microservices/. Accessed 25 Jan 2020

  37. Richardson, C.: Microservices pattern: microservice architecture pattern, May 2019. https://microservices.io/patterns/microservices.html. Accessed 28 Jan 2020

  38. Schneider, T.: Achieving cloud scalability with microservices and DevOps in the connected car domain. In: Software Engineering (2016)

    Google Scholar 

  39. Serverless: documentation (2020). https://serverless.com/framework/docs/. Accessed 4 Feb 2020

  40. Shahrad, M., Balkind, J., Wentzlaff, D.: Architectural implications of function-as-a-service computing. In: Proceedings of the 52nd Annual IEEE/ACM International Symposium on Microarchitecture, pp. 1063–1075 (2019)

    Google Scholar 

  41. Shillaker, S., Pietzuch, P.R.: A provider-friendly serverless framework for latency-critical applications (2018)

    Google Scholar 

  42. Thömmes, M.: Squeezing the milliseconds: how to make serverless platforms blazing fast! (2017) https://medium.com/openwhisk/squeezing-the-milliseconds-how-to-make-serverless-platforms-blazing-fast-aea0e9951bd0. Accessed 14 Feb 2020

  43. CNCF WG-Serverless: CNCF WG-Serverless whitepaper v1.0, March 2018. https://gw.alipayobjects.com/os/basement_prod/24ec4498-71d4-4a60-b785-fa530456c65b.pdf. Accessed 15 July 2020

Download references

Acknowledgements

This work was supported by the funding of the German Federal Ministry of Education and Research (BMBF) in the scope of the Software Campus program. Google Cloud credits were provided by the Google Cloud Platform research credits. The authors also thank the anonymous reviewers whose comments helped in improving this paper.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Anshul Jindal .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Jindal, A., Gerndt, M. (2021). From DevOps to NoOps: Is It Worth It?. In: Ferguson, D., Pahl, C., Helfert, M. (eds) Cloud Computing and Services Science. CLOSER 2020. Communications in Computer and Information Science, vol 1399. Springer, Cham. https://doi.org/10.1007/978-3-030-72369-9_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-72369-9_8

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-72368-2

  • Online ISBN: 978-3-030-72369-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics