Abstract
With the rise of the adoption of microservice architecture due to its agility, scalability, and resiliency for building the cloud-based applications and their deployment using containerization, DevOps were in demand for handling the development and operations together. However, nowadays serverless computing offers a new way of developing and deploying cloud-native applications. Serverless computing also called NoOps, offloads management and server configuration (operations work) from the user to the cloud provider and lets the user focus only on the product developments. Hence, there are debates regarding which deployment strategy to use.
This research provides a performance comparison of a cloud-native web application along with three different function benchmarks in terms of scalability, reliability, and latency when deployed using DevOps and NoOps deployment strategy. NoOps deployment in this work is achieved using Google Cloud Function and OpenWhisk, while DevOps is achieved using the Kubernetes engine. This research shows that neither of the deployment strategies fits all the scenarios. The experimental results demonstrate that each type of deployment strategy has its advantages under different scenarios. The DevOps deployment strategy has a huge performance advantage (almost 72% lesser 90 percentile response time) for simple web-based requests and requests accessing databases while compute-intensive applications perform better with NoOps deployment. Additionally, NoOps deployment provides better scaling-agility as compared to DevOps.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
- 2.
- 3.
- 4.
- 5.
- 6.
References
Aws lambda - pricing. https://aws.amazon.com/lambda/pricing/. Accessed 30 July 2020
Cloud functions overview. https://cloud.google.com/functions/docs/concepts/overview. Accessed 22 Aug 08 2020
What is k6? https://k6.io/docs/. Accessed 28 July 2020
Akbulut, A., Perros, H.G.: Performance analysis of microservice design patterns. IEEE Internet Comput. 23(6), 19–27 (2019)
Şamdan, E.: Dealing with cold starts in AWS lambda (2018). https://medium.com/thundra/dealing-with-cold-starts-in-aws-lambda-a5e3aa8f532. Accessed 14 Feb 2020
Apache: Openwhisk cli (2017). https://github.com/apache/openwhisk/blob/master/docs/cli.md#openwhisk-cli
Apache: Openwhisk documentation (2017). https://openwhisk.apache.org/documentation.html
Architect: Project philosophy (2020). https://arc.codes/intro/philosophy. Accessed 4 Feb 2020
Avritzer, A., Ferme, V., Janes, A., Russo, B., Schulz, H., van Hoorn, A.: A quantitative approach for the assessment of microservice architecture deployment alternatives by automated performance testing. In: Cuesta, C.E., Garlan, D., Pérez, J. (eds.) ECSA 2018. LNCS, vol. 11048, pp. 159–174. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00761-4_11
Baldini, I., et al.: Serverless computing: current trends and open problems. In: Chaudhary, S., Somani, G., Buyya, R. (eds.) Research Advances in Cloud Computing, pp. 1–20. Springer, Singapore (2017). https://doi.org/10.1007/978-981-10-5026-8_1
Baldini, I., et al.: Serverless computing: current trends and open problems. CoRR abs/1706.03178 (2017). http://arxiv.org/abs/1706.03178
Bhojwani, R.: Design patterns for microservice-to-microservice communication - DZone microservices, December 2018. https://dzone.com/articles/design-patterns-for-microservice-communication
Casalicchio, E., Perciballi, V.: Auto-scaling of containers: the impact of relative and absolute metrics. In: 2017 IEEE 2nd International Workshops on Foundations and Applications of Self* Systems (FAS*W), pp. 207–214 (2017)
Di Francesco, P., Lago, P., Malavolta, I.: Migrating towards microservice architectures: an industrial survey. In: 2018 IEEE International Conference on Software Architecture (ICSA), pp. 29–38, April 2018. https://doi.org/10.1109/ICSA.2018.00012
Eivy, A.: Be wary of the economics of “serverless” cloud computing. IEEE Cloud Comput. 4, 6–12 (2017)
Fan., C., Jindal., A., Gerndt., M.: Microservices vs serverless: a performance comparison on a cloud-native web application. In: Proceedings of the 10th International Conference on Cloud Computing and Services Science, CLOSER, vol. 1, pp. 204–215. INSTICC, SciTePress (2020). https://doi.org/10.5220/0009792702040215
Gancarz, R.: The economics of serverless computing: a real-world test (2017). https://techbeacon.com/enterprise-it/economics-serverless-computing-real-world-test. Accessed 23 Mar 2020
GoogleCloud: Cloud functions execution environment. https://cloud.google.com/functions/docs/concepts/exec. Accessed 22 Aug 2020
Handy, A.: Amazon introduces lambda, containers at AWS re:Invent (2014). https://sdtimes.com/amazon/amazon-introduces-lambda-containers/. Accessed 4 Feb 2020
Hendrickson, S., Sturdevant, S., Harter, T., Venkataramani, V., Arpaci-Dusseau, A.C., Arpaci-Dusseau, R.H.: Serverless computation with openlambda. In: 8th USENIX Workshop on Hot Topics in Cloud Computing (HotCloud 2016) (2016)
Jambunathan, B., Yoganathan, K.: Architecture decision on using microservices or serverless functions with containers. In: 2018 International Conference on Current Trends Towards Converging Technologies (ICCTCT), pp. 1–7, March 2018. https://doi.org/10.1109/ICCTCT.2018.8551035
Jamieson, F.: Losing the server? (2017). https://www.bcs.org/content-hub/losing-the-server/
Jindal, A., Podolskiy, V., Gerndt, M.: Performance modeling for cloud microservice applications. In: Proceedings of the 2019 ACM/SPEC International Conference on Performance Engineering, ICPE 2019, pp. 25–32. Association for Computing Machinery, New York (2019). https://doi.org/10.1145/3297663.3310309
Jonas, E., Pu, Q., Venkataraman, S., Stoica, I., Recht, B.: Occupy the cloud: distributed computing for the 99 cloud computing. In: SoCC 2017, pp. 445–451. Association for Computing Machinery, New York (2017). https://doi.org/10.1145/3127479.3128601
Kozhirbayev, Z., Sinnott, R.O.: A performance comparison of container-based technologies for the cloud. Future Gener. Comput. Syst. 68, 175–182 (2017). https://doi.org/10.1016/j.future.2016.08.025. http://www.sciencedirect.com/science/article/pii/S0167739X16303041
Lane, K.: Overview of the backend as a service (baaS) space. API Evangelist (2015)
Lee, H., Satyam, K., Fox, G.: Evaluation of production serverless computing environments. In: 2018 IEEE 11th International Conference on Cloud Computing (CLOUD), pp. 442–450, July 2018. https://doi.org/10.1109/CLOUD.2018.00062
Lloyd, W., Ramesh, S., Chinthalapati, S., Ly, L., Pallickara, S.: Serverless computing: an investigation of factors influencing microservice performance. In: 2018 IEEE International Conference on Cloud Engineering (IC2E), pp. 159–169, April 2018. https://doi.org/10.1109/IC2E.2018.00039
Lynn, T., Rosati, P., Lejeune, A., Emeakaroha, V.: A preliminary review of enterprise serverless cloud computing (function-as-a-service) platforms. In: 2017 IEEE International Conference on Cloud Computing Technology and Science (CloudCom), pp. 162–169, December 2017. https://doi.org/10.1109/CloudCom.2017.15
Mohan, A., Sane, H., Doshi, K., Edupuganti, S., Nayak, N., Sukhomlinov, V.: Agile cold starts for scalable serverless. In: Proceedings of the 11th USENIX Conference on Hot Topics in Cloud Computing, HotCloud 2019, p. 21. USENIX Association (2019)
Mohanty, S.K., Premsankar, G., di Francesco, M.: An evaluation of open source serverless computing frameworks. In: 2018 IEEE International Conference on Cloud Computing Technology and Science (CloudCom), pp. 115–120, December 2018. https://doi.org/10.1109/CloudCom2018.2018.00033
Novoseltseva, E.: Benefits of microservices architecture implementation (2017). https://dzone.com/articles/benefits-amp-examples-of-microservices-architectur. Accessed 23 Mar 2020
Pierre-Louis, M.A.: OpenWhisk: a quick tech preview. DeveloperWorks Open, IBM, p. 7, 22 February 2016 (2016)
Pinto, D., Dias, J.P., Ferreira, H.S.: Dynamic allocation of serverless functions in IoT environments. In: 2018 IEEE 16th International Conference on Embedded and Ubiquitous Computing (EUC), pp. 1–8, October 2018. https://doi.org/10.1109/EUC.2018.00008
Reese, W.: Nginx: the high-performance web server and reverse proxy. Linux J. 2008(173) (2008)
Richardson, C.: Introduction to microservices, May 2015. https://www.nginx.com/blog/introduction-to-microservices/. Accessed 25 Jan 2020
Richardson, C.: Microservices pattern: microservice architecture pattern, May 2019. https://microservices.io/patterns/microservices.html. Accessed 28 Jan 2020
Schneider, T.: Achieving cloud scalability with microservices and DevOps in the connected car domain. In: Software Engineering (2016)
Serverless: documentation (2020). https://serverless.com/framework/docs/. Accessed 4 Feb 2020
Shahrad, M., Balkind, J., Wentzlaff, D.: Architectural implications of function-as-a-service computing. In: Proceedings of the 52nd Annual IEEE/ACM International Symposium on Microarchitecture, pp. 1063–1075 (2019)
Shillaker, S., Pietzuch, P.R.: A provider-friendly serverless framework for latency-critical applications (2018)
Thömmes, M.: Squeezing the milliseconds: how to make serverless platforms blazing fast! (2017) https://medium.com/openwhisk/squeezing-the-milliseconds-how-to-make-serverless-platforms-blazing-fast-aea0e9951bd0. Accessed 14 Feb 2020
CNCF WG-Serverless: CNCF WG-Serverless whitepaper v1.0, March 2018. https://gw.alipayobjects.com/os/basement_prod/24ec4498-71d4-4a60-b785-fa530456c65b.pdf. Accessed 15 July 2020
Acknowledgements
This work was supported by the funding of the German Federal Ministry of Education and Research (BMBF) in the scope of the Software Campus program. Google Cloud credits were provided by the Google Cloud Platform research credits. The authors also thank the anonymous reviewers whose comments helped in improving this paper.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Jindal, A., Gerndt, M. (2021). From DevOps to NoOps: Is It Worth It?. In: Ferguson, D., Pahl, C., Helfert, M. (eds) Cloud Computing and Services Science. CLOSER 2020. Communications in Computer and Information Science, vol 1399. Springer, Cham. https://doi.org/10.1007/978-3-030-72369-9_8
Download citation
DOI: https://doi.org/10.1007/978-3-030-72369-9_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-72368-2
Online ISBN: 978-3-030-72369-9
eBook Packages: Computer ScienceComputer Science (R0)