Abstract
As the use of virtual machines (VMs) for scientific applications becomes more common, we encounter the need to integrate VM provisioning models into the existing resource management infrastructure as seamlessly as possible. To address such requirements, we describe an approach to VM management that uses multi-level scheduling to integrate VM provisioning into batch schedulers such as PBS. We then evaluate our approach on the TeraPort cluster at the University of Chicago.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Chase, J., Grit, L., Irwin, D., Moore, J., Sprenkle, S.: Dynamic Virtual Clusters in a Grid Site Manager. In: HPDC-12 (2003)
Amazon Elastic Compute Cloud (EC2), http://www.amazon.com/ec2
Frey, J., Tannenbaum, T., Foster, I., Livny, M., Tuecke, S.: A Computation Management Agent for Multi-Institutional Grids. Cluster Computing 5(3), 237–246 (2002)
Walker, E., Gardner, J., Litvin, V., Turner, E.: Creating Personal Adaptive Clusters for Managing Scientific Jobs in a Distributed Computing Environment. In: CLADE (2006)
Nilsson, P.: Experience from a pilot based system for ATLAS. In: CHEP 2007 (2007)
Raicu, I., Zhao, Y., Dumitrescu, C., Foster, I., Wilde, M.: Falkon: a Fast and Light-weight task execution framework. SuperComputing (2007)
Agarwal, A., Desmarais, R., Gable, I., Norton, A., Sobie, R., Vanderster, D.: Evaluation of Virtual Machines for HEP Grids. In: CHEP 2006 (2006)
Keahey, K., Freeman, T., Lauret, J., Olson, D.: Virtual Workspaces for Scientific Applications. In: SciDAC Conference 2007 (2007)
Freeman, T., Keahey, K., Foster, I., Rana, A., Sotomayor, B., Wuerthwein, F.: Division of Labor: Tools for Growth and Scalability of the Grids. In: ICSOC 2006 (2006)
Keahey, K., Foster, I., Freeman, T., Zhang, X.: Virtual Workspaces: Achieving Quality of Service and Quality of Life in the Grid. Scientific Programming Journal (2005)
Torque, http://www.clusterresources.com/pages/products/torque-resource-manager.php
Sun Grid Engine, http://gridengine.sunsource.net
The TeraPort Cluster, http://www.ci.uchicago.edu/research/detail_teraport.php
Czajkowski, K., Ferguson, D., Foster, I., Frey, J., Graham, S., Sedukhin, I., Snelling, D., Tuecke, S., Vambenepe, W.: The WS-Resource Framework (2004), http://www.globus.org/wsrf
Virtual Workspaces, http://workspace.globus.org
Barham, P., Dragovic, B., Fraser, K., Hand, S., Harris, T., Ho, A., Neugebar, R., Pratt, I., Warfield, A.: Xen and the Art of Virtualization. In: ACM Symposium on Operating Systems Principles (SOSP)
Freeman, T., Keahey, K., Sotomayor, B., Zhang, X., Foster, I., Scheftner, D.: Virtual Clusters for Grid Communities. In: CCGrid (2006)
Bradshaw, R., Desai, N., Freeman, T., Keahey, K.: A Scalable Approach to Deploying and Managing Virtual Appliances. In: TeraGrid 2007 (2007)
Sotomayor, B., Keahey, K., Foster, I.: Overhead Matters: A Model for Virtual Resource Management. In: 1st International Workshop on Virtualization Technology in Distributed Computing (VTDC) (2006)
Emeneker, W., Jackson, D., Butikofer, J., Stanzione, D.: Dynamic Virtual Clustering with Xen and Moab. Workshop on Xen in HPC Cluster and Grid Computing Environments (XHPC) (2006)
The MOAB Workload Manager, http://www.clusterresources.com/pages/products/moab-cluster-suite/workload-manager.php
MOAB Administrator’s Guide: Virtualization and Resource Provisioning, http://www.clusterresources.com/products/mwm/docs/5.6resourceprovisioning.shtml
Fallenbeck, N., Picht, H., Smith, M., Freisleben, B.: Xen and the Art of Cluster Scheduling. In: VTDC (2006)
Irwin, D., Chase, J., Grit, L., Yunerefendi, A., Decker, D., Yocum, K.: Sharing Networked Resources with Brokered Leases. In: USENIX Technical Conference (2006)
Ruth, P., McGachey, P., Xu, D.: VioCluster: Virtualization for Dynamic Computational Domains. In: IEEE Conference on Cluster Computing (2005)
Kiyanclar, N., Koenig, G.A., Yurcik, W.: Maestro-VS: A Paravirtualized Execution Environment for Secure On-Demand Cluster Computing. In: CCGrid (2006)
Nishimura, H., Maruyama, N., Matsuoka, S.: Virtual Clusers on the Fly – Fast, Scalable and Flexible Installation. In: CCGrid (2007)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Freeman, T., Keahey, K. (2008). Flying Low: Simple Leases with Workspace Pilot. In: Luque, E., Margalef, T., Benítez, D. (eds) Euro-Par 2008 – Parallel Processing. Euro-Par 2008. Lecture Notes in Computer Science, vol 5168. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-85451-7_54
Download citation
DOI: https://doi.org/10.1007/978-3-540-85451-7_54
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-85450-0
Online ISBN: 978-3-540-85451-7
eBook Packages: Computer ScienceComputer Science (R0)