Abstract
Although multi-site MPI execution has been criticized in the past as being ”impractical” due to limitations in network latency and bandwidth, we believe many of the obstacles can be overcome by various means for wider classes of applications than previously believed. One such technique is transparent dynamic migration of MPI, coupled with aggressively performance-oriented overlay networks, assuming availability of gigabits of bandwidth on future WANs. The problem, of course, is to investigate the exact implications to application performances given the arsenal of such techniques, but such work has been quite sparse. Our current work involves using Xen as the underlying virtual machine layer to implement such migration, along with performance-optimizing migration strategies—this particular paper deals with performance evaluations of MPI on Xen VMs including what are the possible performance hindrances, implications of migrations, as well as the effect of variations in latencies and bandwidth parameters as realized by the overlay network using a software network emulator.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Barham, P., Dragovic, B., Fraser, K., Hand, S., Harris, T., Ho, A., Neugebauery, R., Pratt, I., Warfield, A.: Xen and the art of virtualization. In: SOSP, Bolton Landing, New York (2003)
Jiang, X., Xu, D.: Violin: Virtual internetworking on overlay infrastructure. In: Department of Computer Sciences Technical Report CSD TR 03-027, Purdue University (2003)
VMWare: Esx server architecture and performance implications. White Paper (2005)
Clark, C., Fraser, K., Hand, S., Hanseny, J.G., July, E., Limpach, C., Pratt, I., Warfield, A.: Live migration of virtual machines. In: NSDI (2005)
Gropp, W., Lusk, E., Doss, N., Skjellum, A.: A high-performance, portable implementation of the MPI message passing interface standard. Parallel Computing 22(6), 789–828 (1996)
GridMPI: Gridmpi project (2006), http://www.gridmpi.org/
Karonis, N.T., Toonen, B., Foster, I.: MPICH-G2: A grid-enabled implementation of the message passing interface. Journal of Parallel and Distributed Computing (JPDC) 63(5), 551–563 (2003)
OpenVPN Solutions LLC: Openvpn (2006), http://openvpn.net/
SoftEther Corp.: Packetix (2006), http://www.softether.comn/
Carson, M., Santay, D.: NIST Net: A linux-based network emulation tool. SIGCOMM Comput. Commun. Rev. 33(3), 111–126 (2003)
Kielmann, T., Hofman, R.F.H., Bal, H.E., Plaat, A., Bhoedjang, R.A.F.: Magpie: Mpi’s collective communication operations for clustered wide area systems. In: PPoPP, Atlanta, GA, pp. 131–140 (1999)
Foster, I., Freeman, T., Keahey, K., Cheftner, D., Sotomayor, B., Zhang, X.: Virtual clusters for grid communities. In: CCGRID, pp. 513–520 (2006)
Ruth, P., McGachey, P., Xu, D.: Viocluster: Virtualization for dynamic computational domains. In: IEEE International Conference on Cluster Computing, Boston, MA (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Tatezono, M., Maruyama, N., Matsuoka, S. (2006). Making Wide-Area, Multi-site MPI Feasible Using Xen VM. In: Min, G., Di Martino, B., Yang, L.T., Guo, M., Rünger, G. (eds) Frontiers of High Performance Computing and Networking – ISPA 2006 Workshops. ISPA 2006. Lecture Notes in Computer Science, vol 4331. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11942634_41
Download citation
DOI: https://doi.org/10.1007/11942634_41
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-49860-5
Online ISBN: 978-3-540-49862-9
eBook Packages: Computer ScienceComputer Science (R0)