skip to main content
10.1145/1555271.1555277acmconferencesArticle/Chapter ViewAbstractPublication PagesicacConference Proceedingsconference-collections
research-article

Elastic management of cluster-based services in the cloud

Published: 19 June 2009 Publication History

Abstract

In this paper we analyze the deployment of generic clustered services on top of a virtualized infrastructure layer that combines a VM manager (the OpenNebula engine) and a cloud resource provider (Amazon EC2). The use of this virtualization layer between the service and the physical infrastructure extends the classical benefits of VM platforms to distributed infrastructures. Additionally, the integration of the cloud in this layer allows us to give additional capacity to the services using an external provider, thus complementing the local infrastructure without notice from the users or affecting the service workload. This flexible approach, which separates the resource provisioning from the service management, provides important benefits: elastic service capacity to adapt it to its dynamic workload; physical infrastructure partitioning to isolate it from other running services; and support for heterogeneous configurations tailored for each service class. The feasibility of the proposed approach is analyzed for two different clustered services: a classical computing cluster and a web server.

References

[1]
Amazon Elastic Compute Cloud. http://aws.amazon.com/ec2.
[2]
A. Fox, S. D. Gribble, Y. Chawathe, E. A. Brewer, and P. Gauthier. Cluster-based scalable network services. SIGOPS Oper. Syst. Rev., 31(5):78--91, 1997.
[3]
OpenNebula. http://opennebula.org.
[4]
B. Sotomayor, R. Montero, I. Llorente, and I. Foster. Capacity Leasing in Cloud Systems using the OpenNebula Engine. In Workshop on Cloud Computing and its Applications (CCA08).
[5]
Sun Grid Engine. http://gridengine.sunsource.net/.
[6]
OpenVPN. http://openvpn.net.
[7]
S. Garfinkel. An Evaluation of Amazon's Grid Computing Services: EC2, S3, and SQS. Technical Report TR-08-07, Center for Research on Computation and Society, Hardvard University, 2007.
[8]
R. F. Van der Wijngaart and M. A. Frumkin. NAS Grid Benchmarks Version 1.0. Technical Report NAS-02-005, NASA Advanced Supercomputing (NAS), 2002.
[9]
M. A. Frumkin and R. F. Van der Wijngaart. NAS Grid Benchmarks: A Tool for Grid Space Exploration. J. Cluster Computing, 5(3):247--255, 2002.
[10]
E. Walker, J. Gardner, V. Litvin, and E. Turner. Creating personal adaptive clusters for managing scientific jobs in a distributed computing environment. In Proceedings of the IEEE Challenges of Large Applications in Distributed Environments, 2006.
[11]
I. Raicu, Y. Zhao, C. Dumitrescu, I. Foster, and M. Wilde. Falkon: a Fast and Light-weight tasK executiON farmework. In Proceedings of the IEEE/ACM SuperComputing, 2007.
[12]
W. Emeneker, D. Jackson, J. Butikofer, and D. Stanzione. Dynamic Virtual Clustering with Xen and Moab. Lecture Notes in Computer Science, 2006.
[13]
M. Rodriguez, D. Tapiador, J. Fontan, E. Huedo, R. Montero, and I. Llorente. Dynamic Provisioning of Virtual Clusters for Grid Computing. In Proceedings of the 3rd Workshop on Virtualization in High-Performance Cluster and Grid Computing (VHPC'08), in conjuction with EuroPar, 2008.
[14]
T. Freeman and K. Keahey. Flying Low: Simple Leases with Workspace Pilot. In Proceedings of the EuroPar, 2008.
[15]
D. Nurmi, R. Wolski, C. Grzegorczyk, G. Obertelli, S. Soman, L. Youseff, and D. Zagorodnov. The Eucalyptus Open-source Cloud-computing System. In Proc. of Cloud Computing and Its Applications, 2008.
[16]
BioTeam. Howto: Unicluster and Amazon EC2. Technical report, BioTeam Lab Summary, 2008.
[17]
I. Llorente, R. Moreno-Vozmediano, and R. Montero. Cloud Computing for on-Demand Grid Resource Provisioning. In Advances in Parallel Computing, IOS Press (in press), 2009.
[18]
J. Fronckowiak. Auto-Scaling Web Sites Using Amazon EC2 and Scalr. In Amazon EC2 Articles and Tutorials, 2008.

Cited By

View all
  • (2022)Elastic cloud servicesProceedings of the 13th Symposium on Cloud Computing10.1145/3542929.3563483(142-157)Online publication date: 7-Nov-2022
  • (2020)The Effect of Information Quality on Social Networking Site (SNS)-Based CommerceJournal of Organizational and End User Computing10.4018/JOEUC.202001010132:1(1-18)Online publication date: 1-Jan-2020
  • (2020)Improving Authentication and Data Sharing Capabilities of Cloud using a Fusion of Kerberos and TTL-based Group Sharing2020 5th International Conference on Communication and Electronics Systems (ICCES)10.1109/ICCES48766.2020.9137934(1401-1405)Online publication date: Jun-2020
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
ACDC '09: Proceedings of the 1st workshop on Automated control for datacenters and clouds
June 2009
64 pages
ISBN:9781605585857
DOI:10.1145/1555271
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 June 2009

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. cloud computing
  2. cluster-based services
  3. virtualization

Qualifiers

  • Research-article

Conference

ICAC '09
Sponsor:

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)5
  • Downloads (Last 6 weeks)1
Reflects downloads up to 17 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2022)Elastic cloud servicesProceedings of the 13th Symposium on Cloud Computing10.1145/3542929.3563483(142-157)Online publication date: 7-Nov-2022
  • (2020)The Effect of Information Quality on Social Networking Site (SNS)-Based CommerceJournal of Organizational and End User Computing10.4018/JOEUC.202001010132:1(1-18)Online publication date: 1-Jan-2020
  • (2020)Improving Authentication and Data Sharing Capabilities of Cloud using a Fusion of Kerberos and TTL-based Group Sharing2020 5th International Conference on Communication and Electronics Systems (ICCES)10.1109/ICCES48766.2020.9137934(1401-1405)Online publication date: Jun-2020
  • (2019)High-Elasticity Virtual Cluster Placement in Multi-Tenant Cloud Data Centers2019 IEEE 21st International Conference on High Performance Computing and Communications; IEEE 17th International Conference on Smart City; IEEE 5th International Conference on Data Science and Systems (HPCC/SmartCity/DSS)10.1109/HPCC/SmartCity/DSS.2019.00143(996-1003)Online publication date: Aug-2019
  • (2019)Instance launch-time analysis of OpenStack virtualization technologies with control plane network errorsComputing10.1007/s00607-018-0626-5101:8(989-1014)Online publication date: 1-Aug-2019
  • (2018)Web Service Usability Analysis Based on User PreferencesJournal of Organizational and End User Computing10.4018/JOEUC.201810010130:4(1-13)Online publication date: 1-Oct-2018
  • (2018)Smart Vehicular System based on the Internet of ThingsJournal of Organizational and End User Computing10.4018/JOEUC.201807010330:3(45-62)Online publication date: 1-Jul-2018
  • (2018)Anomaly Detection Using RFID-Based Information Management in an IoT ContextJournal of Organizational and End User Computing10.4018/JOEUC.201807010130:3(1-23)Online publication date: 1-Jul-2018
  • (2018)Spreadsheet Error Types and Their Prevalence in a Healthcare ContextJournal of Organizational and End User Computing10.4018/JOEUC.201804010230:2(20-42)Online publication date: 1-Apr-2018
  • (2018)Second Order Interactive End User Development Appropriation in the Public SectorJournal of Organizational and End User Computing10.4018/JOEUC.201801010530:1(82-106)Online publication date: 1-Jan-2018
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media