skip to main content
10.1145/2996890.2996901acmotherconferencesArticle/Chapter ViewAbstractPublication PagesuccConference Proceedingsconference-collections
research-article

Modelling and managing deployment costs of microservice-based cloud applications

Published: 06 December 2016 Publication History

Abstract

We present an approach to model the deployment costs, including compute and IO costs, of Microservice-based applications deployed to a public cloud. Our model, which we dubbed CostHat, supports both, Microservices deployed on traditional IaaS or PaaS clouds, and services that make use of novel cloud programming paradigms, such as AWS Lambda. CostHat is based on a network model, and allows for what-if and cost sensitivity analysis. Further, we have used this model to implement tooling that warns cloud developers directly in the Integrated Development Environment (IDE) about certain classes of potentially costly code changes. We illustrate our work based on a case study, and evaluate the CostHat model using a standalone Python implementation. We show that, once instantiated, cost calculation in CostHat is computationally inexpensive on standard hardware (below 1 ms even for applications consisting of thousand services and endpoints). This enables its use in real-time for developer tooling which continually re-evaluates the costs of an application in the background, while the developer is working on the code.

References

[1]
A. Balalaie, A. Heydarnoori, and P. Jamshidi. Microservices Architecture Enables DevOps: Migration to a Cloud-Native Architecture. IEEE Software, 33(3):42--52, May 2016.
[2]
A. Begel and T. Zimmermann. Analyze This! 145 Questions for Data Scientists in Software Engineering. In Proceedings of the 36th International Conference on Software Engineering, ICSE 2014, pages 12--23, New York, NY, USA, 2014. ACM.
[3]
A. H. Borhani, P. Leitner, B. S. Lee, X. Li, and T. Hung. WPress: An Application-Driven Performance Benchmark for Cloud-Based Virtual Machines. In Proceedings of the 2014 IEEE 18th International Enterprise Distributed Object Computing Conference (EDOC), pages 101--109, Sept 2014.
[4]
D. Bruneo, T. Fritz, S. Keidar-Barner, P. Leitner, F. Longo, C. Marquezan, A. Metzger, K. Pohl, A. Puliafito, D. Raz, A. Roth, E. Salant, I. Segall, M. Villari, Y. Wolfsthal, and C. Woods. CloudWave: where Adaptive Cloud Management Meets DevOps. In Proceedings of the Fourth International Workshop on Management of Cloud Systems (MoCS 2014), 2014.
[5]
R. Buyya, C. S. Yeo, S. Venugopal, J. Broberg, and I. Brandic. Cloud Computing and Emerging IT Platforms: Vision, Hype, and Reality for Delivering Computing as the 5th Utility. Future Generation Computing Systems, 25:599--616, 2009.
[6]
A. Chandra, W. Gong, and P. Shenoy. Dynamic Resource Allocation for Shared Data Centers using Online Measurements. ACM SIGMETRICS Performance Evaluation Review, 31(1):300, 2003.
[7]
J. Cito, P. Leitner, T. Fritz, and H. C. Gall. The Making of Cloud Applications: An Empirical Study on Software Development for the Cloud. In Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering (ESEC/FSE), pages 393--403, New York, NY, USA, 2015. ACM.
[8]
J. Cito, P. Leitner, H. C. Gall, A. Dadashi, A. Keller, and A. Roth. Runtime Metric Meets Developer - Building Better Cloud Applications Using Feedback. In Proceedings of the 2015 ACM International Symposium on New Ideas, New Paradigms, and Reflections on Programming & Software (Onward! 2015), New York, NY, USA, 2015. ACM.
[9]
J. Doyle, V. Giotsas, M. A. Anam, and Y. Andreopoulos. Cloud Instance Management and Resource Prediction for Computation-as-a-Service Platforms. In Proceedings of the 2016 IEEE International Conference on Cloud Engineering (IC2E, pages 89--98, Apr. 2016.
[10]
A. García García, I. Blanquer Espert, and V. Hernández García. SLA-Driven Dynamic Cloud Resource Management. Future Generation Computing Systems, 31:1--11, 2014.
[11]
Z. Gong, X. Gu, and J. Wilkes. PRESS: PRedictive Elastic ReSource Scaling for Cloud Systems. Proceedings of the 2010 International Conference on Network and Service Management (CNSM 2010), pages 9--16, 2010.
[12]
A. Greenberg, J. Hamilton, D. A. Maltz, and P. Patel. The Cost of a Cloud: Research Problems in Data Center Networks. SIGCOMM Computing Communications Review, 39(1):68--73, Dec. 2008.
[13]
M. N. Huhns and M. P. Singh. Service-Oriented Computing: Key Concepts and Principles. IEEE Internet Computing, 9(1):75--81, Jan. 2005.
[14]
S. Islam, J. Keung, K. Lee, and A. Liu. Empirical Prediction Models for Adaptive Resource Provisioning in the Cloud. Future Generation Computing Systems, 28(1):155--162, 2012.
[15]
B. Jennings and R. Stadler. Resource Management in Clouds: Survey and Research Challenges. Journal of Network and Systems Management, 23(3):567--619, 2 Mar. 2014.
[16]
G. Jung, M. a. Hiltunen, K. R. Joshi, R. D. Schlichting, and C. Pu. Mistral: Dynamically Managing Power, Performance, and Adaptation Cost in Cloud Infrastructures. Proceedings of the International Conference on Distributed Computing Systems, pages 62--73, 2010.
[17]
P. Leitner and J. Cito. Patterns in the Chaos - a Study of Performance Variation and Predictability in Public IaaS Clouds. ACM Transactions on Internet Technology, 2016.
[18]
P. Leitner, W. Hummer, B. Satzger, C. Inzinger, and S. Dustdar. Cost-Efficient and Application SLA-Aware Client Side Request Scheduling in an Infrastructure-as-a-Service Cloud. In Proceedings of the 2012 IEEE 5th International Conference on Cloud Computing (CLOUD), pages 213--220. ieeexplore.ieee.org, June 2012.
[19]
M. Malawski, G. Juve, E. Deelman, and J. Nabrzyski. Cost-and Deadline-Constrained Provisioning for Scientific Workflow Ensembles in IaaS Clouds. In Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis (SC), page 22, Los Alamitos, CA, USA, 10 Nov. 2012. IEEE Computer Society Press.
[20]
M. Mao and M. Humphrey. Scaling and Scheduling to Maximize Application Performance within Budget Constraints in Cloud Workflows. In Proceedings of the 2013 IEEE 27th International Symposium on Parallel Distributed Processing (IPDPS), pages 67--78. ieeexplore.ieee.org, May 2013.
[21]
M. Mao, J. Li, and M. Humphrey. Cloud Auto-Scaling with Deadline and Budget Constraints. In Proceedings of the 2010 11th IEEE/ACM International Conference on Grid Computing, pages 41--48. ieeexplore.ieee.org, Oct. 2010.
[22]
P. Mell and T. Grance. The NIST Definition of Cloud Computing. Technical Report 800-145, National Institute of Standards and Technology (NIST), Gaithersburg, MD, September 2011.
[23]
R. Mian, P. Martin, and J. Vazquez-Poletti. Provisioning Data Analytic Workloads in a Cloud. Future Generation Computing Systems, 29(6):1452--1458, 2013.
[24]
A. Michlmayr, F. Rosenberg, P. Leitner, and S. Dustdar. End-to-End Support for QoS-Aware Service Selection, Binding, and Mediation in VRESCo. IEEE Transactions on Services Computing, 3(3):193--205, July 2010.
[25]
S. Newman. Building Microservices. O'Reilly, 2015.
[26]
G. Schermann, J. Cito, and P. Leitner. All the Services Large and Micro: Revisiting Industrial Practice in Services Computing. In Proceedings of the 11th International Workshop on Engineering Service Oriented Applications (WESOA'15), 2015.
[27]
B. H. Sigelman, L. A. Barroso, M. Burrows, P. Stephenson, M. Plakal, D. Beaver, S. Jaspan, and C. Shanbhag. Dapper, a Large-Scale Distributed Systems Tracing Infrastructure. Technical report, Google, Inc., 2010.
[28]
R. Singh, P. Shenoy, M. Natu, V. Sadaphal, and H. Vin. Predico: a System for What-If Analysis in Complex Data Center Ppplications. In Proceedings of the 12th International Middleware Conference, pages 120--139, 2011.
[29]
M. Smit and E. Stroulia. Configuration Decision Making Using Simulation-Generated Data. In E. Michael Maximilien, G. Rossi, S.-T. Yuan, H. Ludwig, and M. Fantinato, editors, Proceedings of the International Conference on Service-Oriented Computing (ICSOC), Lecture Notes in Computer Science, pages 15--26. Springer Berlin Heidelberg, 7 Dec. 2010.
[30]
E. Stöckli. Feedback Driven Development - Predicting the Costs of Code Changes in Microservice Architectures based on Runtime Feedback. Master's thesis, University of Zurich, 2015.
[31]
K. Tsakalozos, H. Kllapi, E. Sitaridi, M. Roussopoulos, D. Paparas, and A. Delis. Flexible Use of Cloud Resources Through Profit Maximization and Price Discrimination. In Proceedings of the 2011 IEEE 27th International Conference on Data Engineering (ICDE), pages 75--86, Apr. 2011.

Cited By

View all
  • (2024)A Systematic Literature Review on the Strategic Shift to Cloud ERP: Leveraging Microservice Architecture and MSPs for Resilience and AgilityElectronics10.3390/electronics1314288513:14(2885)Online publication date: 22-Jul-2024
  • (2024)A Faster Multi-Cloud Provisioning Framework for Microservice Users2024 IEEE International Conference on Consumer Electronics (ICCE)10.1109/ICCE59016.2024.10444460(1-4)Online publication date: 6-Jan-2024
  • (2023)Cost-Profiling Microservice Applications Using an APM StackFuture Internet10.3390/fi1501003715:1(37)Online publication date: 13-Jan-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
UCC '16: Proceedings of the 9th International Conference on Utility and Cloud Computing
December 2016
549 pages
ISBN:9781450346160
DOI:10.1145/2996890
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 December 2016

Permissions

Request permissions for this article.

Check for updates

Qualifiers

  • Research-article

Conference

UCC '16

Acceptance Rates

Overall Acceptance Rate 38 of 125 submissions, 30%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)52
  • Downloads (Last 6 weeks)3
Reflects downloads up to 17 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)A Systematic Literature Review on the Strategic Shift to Cloud ERP: Leveraging Microservice Architecture and MSPs for Resilience and AgilityElectronics10.3390/electronics1314288513:14(2885)Online publication date: 22-Jul-2024
  • (2024)A Faster Multi-Cloud Provisioning Framework for Microservice Users2024 IEEE International Conference on Consumer Electronics (ICCE)10.1109/ICCE59016.2024.10444460(1-4)Online publication date: 6-Jan-2024
  • (2023)Cost-Profiling Microservice Applications Using an APM StackFuture Internet10.3390/fi1501003715:1(37)Online publication date: 13-Jan-2023
  • (2023)A Penny a Function: Towards Cost Transparent Cloud ProgrammingProceedings of the 2nd ACM SIGPLAN International Workshop on Programming Abstractions and Interactive Notations, Tools, and Environments10.1145/3623504.3623566(1-10)Online publication date: 18-Oct-2023
  • (2023)AFaVS: Accurate Yet Fast Version Switching for Graph Processing Systems2023 IEEE 39th International Conference on Data Engineering (ICDE)10.1109/ICDE55515.2023.00012(53-66)Online publication date: Apr-2023
  • (2023)EIS: Edge Information-Aware Scheduler for Containerized IoT Applications2023 IEEE International Conference on Edge Computing and Communications (EDGE)10.1109/EDGE60047.2023.00050(280-289)Online publication date: Jul-2023
  • (2023)Evaluation of a Multitenant SaaS Using Monolithic and Microservice ArchitecturesSN Computer Science10.1007/s42979-022-01610-24:2Online publication date: 31-Jan-2023
  • (2023)Minimizing Resource Allocation for Cloud-Native MicroservicesJournal of Network and Systems Management10.1007/s10922-023-09726-331:2Online publication date: 9-Feb-2023
  • (2022)Dynamic Evaluation of Microservice Granularity AdaptationACM Transactions on Autonomous and Adaptive Systems10.1145/350272416:2(1-35)Online publication date: 4-Mar-2022
  • (2022)Optimal Resource Provisioning for Data-intensive MicroservicesNOMS 2022-2022 IEEE/IFIP Network Operations and Management Symposium10.1109/NOMS54207.2022.9789857(1-6)Online publication date: 25-Apr-2022
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media