Abstract
As larger and larger commodity clusters for high performance computing proliferate at research institutions around the world, challenges in maintaining effective use of these systems also continue to increase. Among the many challenges are maintaining the appropriate software stack for a broad array of applications, and sharing workload across clusters. The Dynamic Virtual Clustering (DVC) system integrates the Xen virtual machine with the Moab scheduler to allow for creation of virtual clusters on a per-job basis. These virtual clusters can provide a unique software environment for a particular application, or can provide a consistent software environment across multiple heterogeneous clusters. In this paper, the overhead of Xen-based DVC vs. native cluster performance is examined for workloads consisting of both serial and MPI-based parallel jobs.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Barham, P., Dragovic, B., Fraser, K., Hand, S., Harris, T., Ho, A., Neugebauer, R., Pratt, I., Warfield, A.: Xen and the art of virtualization. In: SOSP 2003: Proceedings of the nineteenth ACM symposium on Operating systems principles, pp. 164–177. ACM Press, New York (2003)
J. Brooke, M. Foster, S. Pickles, K. Taylor, T. Hewitt. Mini-Grids: Effective Test-Beds for GRID Application. In: Grid Computing - GRID 2000: First IEEE/ACM International Workshop, p. 158 (2000)
Chandy, K.M., Lamport, L.: Distributed snapshots: determining global states of distributed systems. ACM Trans. Comput. Syst. 3(1), 63–75 (1985)
Clark, B., Deshane, T., Dow, E., Evanchik, S., Finlayson, M., Herne, J., Matthews, J.N.: Xen and the Art of Repeated Research. In: Proceedings of the Usenix annual technical conference (July 2004)
Emeneker, W., Stanzione, D.: HPC Cluster Readiness of Xen and UML. In: Proceeding of IEEE International Conference on Cluster Computing (Cluster 2006) (2006)
Jones, W., Pang, L., Stanzione, D., Ligon, W.: Bandwidth-aware Co-allocating Meta-schedulers for Mini-grid Architectures. In: International Conference on Cluster Computing (Cluster 2004) (2004)
Jones, W., Pang, L., Stanzione, D., Ligon III, W.: Characterization of Bandwidth-aware Meta-schedulers for Co-allocating Jobs Across Multiple Clusters. Journal of Supercomputing, Special Issue on the Evaluation of Grid and Cluster Computing (2005)
Kiyanclar, N., Koenig, G.A., Yurcik, W.: Maestro-VC: A Paravirtualized Execution Environment for Secure On-Demand Cluster Computing. ccgrid 2, 28 (2006)
Mattern, F.: Efficient algorithms for distributed snapshots and global virtual time approximation. Journal of Parallel and Distributed Computing 18(4) (1993)
Menon, A., Santos, J.R., Turner, Y., Janakiraman, G.J., Zwaenepoel, W.: Diagnosing performance overheads in the xen virtual machine environment. In: VEE 2005: Proceedings of the 1st ACM/USENIX international conference on Virtual execution environments, pp. 13–23. ACM Press, New York (2005)
Rosenblum, M., Garfinkel, T.: Virtual Machine Monitors: Current Technology and Future Trends. Computer 38(5), 39–47 (2005)
Taesombut, N., Chien, A.A.: Distributed Virtual Computers: Simplifying the Development of High Performance Grid Applications (2004)
Uhlig, R., Neiger, G., Rodgers, D., Santoni, A.L., Martins, F.C.M., Anderson, A.V., Bennett, S.M., Kagi, A., Leung, F.H., Smith, L.: Intel Virtualization Technology. Computer 38, 48–56 (2005)
Zhang, X., Keahey, K.: Evaluation of a Virtual Xen Cluster Using the Pallas MPI Benchmarks Suite (April 2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Emeneker, W., Jackson, D., Butikofer, J., Stanzione, D. (2006). Dynamic Virtual Clustering with Xen and Moab. In: Min, G., Di Martino, B., Yang, L.T., Guo, M., Rünger, G. (eds) Frontiers of High Performance Computing and Networking – ISPA 2006 Workshops. ISPA 2006. Lecture Notes in Computer Science, vol 4331. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11942634_46
Download citation
DOI: https://doi.org/10.1007/11942634_46
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-49860-5
Online ISBN: 978-3-540-49862-9
eBook Packages: Computer ScienceComputer Science (R0)