skip to main content
10.1145/3135974.3135982acmconferencesArticle/Chapter ViewAbstractPublication PagesmiddlewareConference Proceedingsconference-collections
research-article

ORCA: an <u>ORC</u>hestration <u>a</u>utomata for configuring VNFs

Published: 11 December 2017 Publication History

Abstract

Onboarding network functions onto current clouds requires labor-intensive configuration of the virtual environment. Developers need to dimension the resources available to each virtual machine such as CPU and memory, define thresholds for scaling dynamically and create configuration files that operators can use to execute the network services. This process is time consuming and dependent on the server architecture. As resources are managed on an individual virtual machine basis, services cannot be orchestrated end to end without significant expertise. In this paper, we argue that much of the manual configuration needed for onboarding services onto a cloud can be automated. Moreover, we can automatically generate abstractions that consider services end-to-end and enable their holistic orchestration. We propose a framework that benchmarks network services during the onboarding process and generates an elastic model which relates workload mixes to resource requirements, identifies component dependencies and automates service operation on heterogeneous stacks. We have evaluated our framework using a real-time communication service that handles multiple classes of workloads. Results show that underprovisioning can be eliminated for regular daily traffic, reducing resource provisioning time by at least 5X for the most stressing traffic surges, while improving key performance indicators by at least 40%.

References

[1]
2010. Gartner Says Efficient Data Center Design Can Lead to 300 Percent Capacity Growth in 60 Percent Less Space. http://www.gartner.com/newsroom/id/1472714. (2010). Retrieved on: April.
[2]
2017. Amazon. Web Services Auto Scaling. https://aws.amazon.com/autoscaling/. (2017). Retrieved on: April.
[3]
2017. Ansible. https://www.ansible.com/. (2017). Retrieved on: April.
[4]
2017. Docker. https://www.docker.com. (2017). Retrieved on: April.
[5]
2017. Rancher. http://rancher.com/. (2017). Retrieved on: April.
[6]
2017. Scalr. https://www.scalr.com. (2017). Retrieved on: April.
[7]
2017. Unified Communications. http://www.imtc.org/uc/. (2017). Retrieved on: April.
[8]
2107. Heat documentation. http://docs.openstack.org/developer/heat/. (2107). Retrieved on: April.
[9]
A. Ali-Eldin, J. Tordsson, and E. Elmroth. 2012. An adaptive hybrid elasticity controller for cloud infrastructures. In Network Operations and Management Symposium (NOMS), 2012 IEEE. 204--212.
[10]
Peter Bodík, Rean Griffith, Charles Sutton, Armando Fox, Michael Jordan, and David Patterson. 2009. Statistical Machine Learning Makes Automatic Control Practical for Internet Datacenters. In Proceedings of the 2009 Conference on Hot Topics in Cloud Computing (HotCloud'09). USENIX Association, Berkeley, CA, USA, Article 12. http://dl.acm.org/citation.cfm?id=1855533.1855545
[11]
Robert B. Cleveland, William S. Cleveland, Jean E. McRae, and Terpenning Irma. 1990. STL: A Seasonal-Trend Decomposition Procedure Based on Loess. In Journal of Official Statistics. 3--73.
[12]
Sheng Di, Derrick Kondo, and Walfredo Cirne. 2014. Google hostload prediction based on Bayesian model with optimized feature combination. In Journal of Parallel and Distributed Computing, Vol. 74. Elsevier, 1820--1832.
[13]
Anshul Gandhi, Parijat Dube, Alexei Karve, Andrzej Kochut, and Li Zhang. 2014. Adaptive, Model-driven Autoscaling for Cloud Applications. In USENIX 11th International Conference on Autonomic Computing (ICAC 2014). 57--64.
[14]
Anshul Gandhi, Mor Harchol-Balter, Ram Raghunathan, and Michael A. Kozuch. 2012. AutoScale: Dynamic, Robust Capacity Management for Multi-Tier Data Centers. ACM Trans. Comput. Syst. 30, 4, Article 14 (2012), 26 pages.
[15]
Aaron Gember, Anand Krishnamurthy, Saul St. John, Robert Grandl, Xiaoyang Gao, Ashok Anand, Theophilus Benson, Aditya Akella, and Vyas Sekar. 2013. Stratos: A Network-Aware Orchestration Layer for Middleboxes in the Cloud. CoRR abs/1305.0209 (2013). http://arxiv.org/abs/1305.0209
[16]
Aaron Gember-Jacobson, Raajay Viswanathan, Chaithan Prakash, Robert Grandl, Junaid Khalid, Sourav Das, and Aditya Akella. 2014. OpenNF: Enabling Innovation in Network Function Control. In Proceedings of the 2014 ACM Conference on SIGCOMM (SIGCOMM '14). ACM, 163--174.
[17]
Adem Efe Gencer, David Bindel, Emin Gün Sirer, and Robbert van Renesse. 2015. Configuring Distributed Computations Using Response Surfaces. In Proceedings of the 16th Annual Middleware Conference (Middleware '15). ACM, New York, NY, USA, 235--246.
[18]
James Hamilton. 2009. Internet-scale Service Infrastructure Efficiency. In Proceedings of the 36th Annual International Symposium on Computer Architecture (ISCA '09). 232--232.
[19]
Rui Han, Moustafa M. Ghanem, Li Guo, Yike Guo, and Michelle Osmond. 2014. Enabling Cost-aware and Adaptive Elasticity of Multi-tier Cloud Applications. Future Gener. Comput. Syst. 32 (2014), 82--98.
[20]
Rui Han, Li Guo, M.M. Ghanem, and Yike Guo. 2012. Lightweight Resource Scaling for Cloud Applications. In Cluster, Cloud and Grid Computing (CCGrid), 2012 12th IEEE/ACM International Symposium on. 644--651.
[21]
M.Z. Hasan, E. Magana, A. Clemm, L. Tucker, and S.L.D. Gudreddi. 2012. Integrated and autonomic cloud resource scaling. In Network Operations and Management Symposium (NOMS), 2012 IEEE. 1327--1334.
[22]
Nikolas Roman Herbst, Nikolaus Huber, Samuel Kounev, and Erich Amrehn. 2013. Self-adaptive Workload Classification and Forecasting for Proactive Resource Provisioning. In Proceedings of the 4th ACM/SPEC International Conference on Performance Engineering (ICPE '13). ACM, 187--198.
[23]
Rob Hyndman. 2017. forecast: Forecasting Functions for Time Series and Linear Models. https://hbr.org/resources/pdfs/tools/16700_HBR_Microsoft%20Report_LONG_webview.pdf. (2017). Retrieved on: April.
[24]
Daniel Jacobson, Danny Yuan, and Joshi Neeraj. 2103. Scryer: Netflix's Predictive Auto Scaling Engine. The Netflix Tech Blog. (2103). Retrieved on: April.
[25]
Pooyan Jamshidi, Aakash Ahmad, and Claus Pahl. 2014. Autonomic Resource Provisioning for Cloud-based Software. In Proceedings of the 9th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS 2014). 95--104.
[26]
Evangelia Kalyvianaki, Themistoklis Charalambous, and Steven Hand. 2009. Self-adaptive and Self-configured CPU Resource Provisioning for Virtualized Servers Using Kalman Filters. In Proceedings of the 6th International Conference on Autonomic Computing (ICAC '09). ACM, New York, NY, USA, 117--126.
[27]
A. Kamra, V. Misra, and E.M. Nahum. 2004. Yaksha: a self-tuning controller for managing the performance of 3-tiered Web sites. In Quality of Service, 2004. IWQOS 2004. Twelfth IEEE International Workshop on. 47--56.
[28]
J. M. Kaplan, W. Forrest, and N Kindler. 2008. Revolutionizing Data Center Energy Efficiency. Technical Report. McKinsey & Company.
[29]
Jacob Barton Leverich. 2014. Future scaling of datacenter power-efficiency. Ph.D. Dissertation. Stanford University.
[30]
Harold C. Lim, Shivnath Babu, and Jeffrey S. Chase. 2010. Automated Control for Elastic Storage. In Proceedings of the 7th International Conference on Autonomic Computing (ICAC '10). ACM, 1--10.
[31]
Huan Liu. 2011. A Measurement Study of Server Utilization in Public Clouds. In Dependable, Autonomic and Secure Computing (DASC), 2011 IEEE Ninth International Conference on. 435--442.
[32]
Tania Lorido-Botran, Jose Miguel-Alonso, and Jose A. Lozano. 2014. A Review of Auto-scaling Techniques for Elastic Applications in Cloud Environments. Journal of Grid Computing 12, 4 (2014), 559--592.
[33]
Diego Lugones, Jordi Arjona Aroca, Yue Jin, Alessandra Sala, and Volker Hilt. 2017. AidOps: A Data-Driven Provisioning of High-Availability Services in Cloud. In Proceedings of the 2017 ACM ACM Symposium on Cloud Computing (SoCC '17). ACM, 13.
[34]
Simon J. Malkowski, Markus Hedwig, Jack Li, Calton Pu, and Dirk Neumann. 2011. Automated Control for Elastic N-tier Workloads Based on Empirical Modeling. In Proceedings of the 8th ACM International Conference on Autonomic Computing (ICAC '11). ACM, New York, NY, USA, 131--140.
[35]
Jason Mars and Lingjia Tang. 2013. Whare-map: Heterogeneity in "Homogeneous" Warehouse-scale Computers. In Proceedings of the 40th Annual International Symposium on Computer Architecture (ISCA '13). 619--630.
[36]
Michael Maurer, Ivona Brandic, and Rizos Sakellariou. 2011. Enacting SLAs in Clouds Using Rules. In Proceedings of the 17th International Conference on Parallel Processing - Volume Part I (Euro-Par'11). 455--466. http://dl.acm.org/citation.cfm?id=2033345.2033393
[37]
Ripal Nathuji, Aman Kansal, and Alireza Ghaffarkhah. 2010. Q-clouds: Managing Performance Interference Effects for QoS-aware Clouds. In Proceedings of the 5th European Conference on Computer Systems (EuroSys '10). ACM, New York, NY, USA, 237--250.
[38]
Hiep Nguyen, Zhiming Shen, Xiaohui Gu, Sethuraman Subbiah, and John Wilkes. 2013. AGILE: Elastic Distributed Resource Scaling for Infrastructure-as-a-Service. In 10th International Conference on Autonomic Computing (ICAC 13). USENIX, San Jose, CA, 69--82. https://www.usenix.org/conference/icac13/technical-sessions/presentation/nguyen
[39]
Pradeep Padala, Kai-Yuan Hou, Kang G. Shin, Xiaoyun Zhu, Mustafa Uysal, Zhikui Wang, Sharad Singhal, and Arif Merchant. 2009. Automated Control of Multiple Virtualized Resources. In Proceedings of the 4th ACM European Conference on Computer Systems (EuroSys '09). ACM, New York, NY, USA, 13--26.
[40]
Shoumik Palkar, Chang Lan, Sangjin Han, Keon Jang, Aurojit Panda, Sylvia Ratnasamy, Luigi Rizzo, and Scott Shenker. 2015. E2: A Framework for NFV Applications. In Proceedings of the 25th Symposium on Operating Systems Principles (SOSP '15). ACM, 121--136.
[41]
R. Ranjan, B. Benatallah, S. Dustdar, and M. P. Papazoglou. 2015. Cloud Resource Orchestration Programming: Overview, Issues, and Directions. IEEE Internet Computing 19, 5 (Sept 2015), 46--56.
[42]
C. Reiss, A. Tumanov, G. R. Ganger, R. H. Katz, and M. A. Kozuch. 2012. Heterogeneity and Dynamicity of Clouds at Scale: Google Trace Analysis. In ACM Symposium on Cloud Computing (SoCC). ACM, Article 7, 13 pages.
[43]
Charles Reiss, John Wilkes, and Joseph L. Hellerstein. 2011. Google cluster-usage traces: format + schema. Technical Report. Google Inc., Mountain View, CA, USA.
[44]
A. Saboori, G. Jiang, and H. Chen. 2008. Autotuning Configurations in Distributed Systems for Performance Improvements Using Evolutionary Strategies. In Distributed Computing Systems, 2008. ICDCS '08. The 28th International Conference on. 769--776.
[45]
P. S. Saikrishna, R. Pasumarthy, and N. P. Bhatt. 2016. Identification and Multivariable Gain-Scheduling Control for Cloud Computing Systems. In IEEE Transactions on Control Systems Technology, Vol. PP. 1--16.
[46]
Vladimir Sobeslav and Ales Komarek. 2015. Proceedings of the 4th International Conference on Computer Engineering and Networks: CENet2014. Springer International Publishing, Cham, Chapter OpenSource Automation in Cloud Computing, 805--812.
[47]
Bhuvan Urgaonkar, Prashant Shenoy, Abhishek Chandra, Pawan Goyal, and Timothy Wood. 2008. Agile Dynamic Provisioning of Multi-tier Internet Applications. ACM Trans. Auton. Adapt. Syst. 3, 1, Article 1 (March 2008), 39 pages.
[48]
Frits Vaandrager. 2017. Model Learning. Commun. ACM 60, 2 (Jan. 2017), 86--95.

Cited By

View all
  • (2024)iOn-Profiler: Intelligent Online Multi-Objective VNF Profiling With Reinforcement LearningIEEE Transactions on Network and Service Management10.1109/TNSM.2024.335282121:2(2339-2352)Online publication date: Apr-2024
  • (2021)Intelligent Performance Prediction: The Use Case of a Hadoop ClusterElectronics10.3390/electronics1021269010:21(2690)Online publication date: 3-Nov-2021
  • (2021)IMITA: Imitation Learning for Generalizing Cloud Orchestration2021 IEEE/ACM 21st International Symposium on Cluster, Cloud and Internet Computing (CCGrid)10.1109/CCGrid51090.2021.00033(237-246)Online publication date: May-2021
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
Middleware '17: Proceedings of the 18th ACM/IFIP/USENIX Middleware Conference
December 2017
268 pages
ISBN:9781450347204
DOI:10.1145/3135974
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

In-Cooperation

  • USENIX Assoc: USENIX Assoc
  • IFIP

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 December 2017

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. automation
  2. cloud control
  3. network services

Qualifiers

  • Research-article

Conference

Middleware '17
Sponsor:
Middleware '17: 18th International Middleware Conference
December 11 - 15, 2017
Nevada, Las Vegas

Acceptance Rates

Middleware '17 Paper Acceptance Rate 20 of 85 submissions, 24%;
Overall Acceptance Rate 203 of 948 submissions, 21%

Upcoming Conference

MIDDLEWARE '25
26th International Middleware Conference
December 15 - 19, 2025
Nashville , TN , USA

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)18
  • Downloads (Last 6 weeks)2
Reflects downloads up to 03 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2024)iOn-Profiler: Intelligent Online Multi-Objective VNF Profiling With Reinforcement LearningIEEE Transactions on Network and Service Management10.1109/TNSM.2024.335282121:2(2339-2352)Online publication date: Apr-2024
  • (2021)Intelligent Performance Prediction: The Use Case of a Hadoop ClusterElectronics10.3390/electronics1021269010:21(2690)Online publication date: 3-Nov-2021
  • (2021)IMITA: Imitation Learning for Generalizing Cloud Orchestration2021 IEEE/ACM 21st International Symposium on Cluster, Cloud and Internet Computing (CCGrid)10.1109/CCGrid51090.2021.00033(237-246)Online publication date: May-2021
  • (2020)Optimized Sampling Strategies to Model the Performance of Virtualized Network FunctionsJournal of Network and Systems Management10.1007/s10922-020-09547-8Online publication date: 29-Jun-2020
  • (2019)MonitorlessProceedings of the 20th International Middleware Conference10.1145/3361525.3361543(149-162)Online publication date: 9-Dec-2019
  • (2019)Profile-Based Resource Allocation for Virtualized Network FunctionsIEEE Transactions on Network and Service Management10.1109/TNSM.2019.294377916:4(1374-1388)Online publication date: Dec-2019
  • (2018)Profiling Service Function Chaining Behavior for NFV Orchestration2018 IEEE Symposium on Computers and Communications (ISCC)10.1109/ISCC.2018.8538657(01020-01025)Online publication date: Jun-2018

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media