research-article

Live migration of virtual machine based on full system trace and replay

Authors:

Chen YuAuthors Info & Claims

HPDC '09: Proceedings of the 18th ACM international symposium on High performance distributed computing

Pages 101 - 110

https://doi.org/10.1145/1551609.1551630

Published: 11 June 2009 Publication History

Abstract

Live migration of virtual machines (VM) across distinct physical hosts provides a significant new benefit for administrators of data centers and clusters. Previous migration schemes focused on transferring the runtime memory state of the VM. Those approaches employed memory pre-copy algorithm to synchronize the migrating VM states, which make VM live migration cost much network traffic and application downtime, especially for memory intensive workloads. This paper describes the design and implementation of a novel approach CR/TR-Motion that adopts checkpointing/recovery and trace/replay technology to provide fast, transparent VM migration. With execution trace logged on the source host, a synchronization algorithm is performed to orchestrate the running source and target VM until they get a consistent state. We also give a formalized characterization about the migration evaluation metrics and make a mathematical analysis about our algorithm. Our scheme can greatly reduce the migration downtime and network bandwidth consumption. Experimental measurements show that our approach can drastically reduce migration overheads compared with pre-copy algorithm: up to 72.4% on application observed downtime, up to 31.5% on total migration time and up to 95.9% on the data to synchronize the VM state, while the application performance overhead due to migration is less than 8.54% on average.

References

[1]

http://www.eecs.umich.edu/virtual/software.html

[2]

http://www.tux.org/pub/tux/benchmarks/system/unixbench/

[3]

P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauer, I. Pratt, and A. Warfield. Xen and the Art of Virtualization. In Proceedings of the nineteenth ACM symposium on Operating Systems Principles (SOSP'03), October 19-22, 2003, Lake George, New York, USA, pp.164--177

Digital Library

[4]

G. Bronevetsky, R. Fernandes, D. Marques, K. Pingali, and P. Stodghill. Recent Advances in Checkpoint/Recovery Systems. In Proceedings of 20th International Parallel and Distributed Processing Symposium (IPDPS'06), April 25-29, 2006

Digital Library

[5]

K. Buchacker and V. Sieh. Framework for Testing the Fault-Tolerance of Systems Including OS and Network Aspects, In Proceedings of 6th IEEE International High Assurance Systems Engineering Symposium (HASE'01), October 22-24, 2001, pp.95--105

Digital Library

[6]

R. Bradford, E. Kotsovinos, A. Feldmann, and H. Schioeberg. Live Wide-Area Migration of Virtual Machines Including Local Persistent State. In Proceedings of the third International Conference on Virtual Execution Environments (VEE'07), ACM Press, June 13-15, 2007, San Diego, California, USA, pp.169--179

Digital Library

[7]

C. Clark, K. Fraser, S. Hand, J. G. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfield. Live Migration of Virtual Machines. In Proceedings of 2nd Symposium on Networked Systems Design and Implementation (NSDI'05), May 2-4, 2005, Boston, MA, USA, pp.273--286

Digital Library

[8]

B. Cully, G. Lefebvre, D. T. Meyer, A. Karollil, M. J. Feeley, N. C. Hutchinson, and A. Warfield. Remus: High Availability via Asynchronous Virtual Machine Replication. In Proceedings of 5th Symposium on Networked Systems Design and Implementation (NSDI'08), April 16-18, 2008, San Francisco, CA, USA

Digital Library

[9]

G. W. Dunlap, S. T. King, S. Cinar, M. Basrai, and P. M. Chen. ReVirt: Enabling Intrusion Analysis through Virtual-Machine Logging and Replay. In Proceedings of the 5th Symposium on Operating Systems Design and Implementation (OSDI'02), ACM Press, December 8-11, 2002, Boston, MA, USA, pp.211--224

Digital Library

[10]

W. Huang, Q. Gao, J. Liu, and D. K. Panda. High Performance Virtual Machine Migration with RDMA over Modern Interconnects. In Proceedings of IEEE International Conference on Cluster Computing (Cluster'07), September 17-20, 2007, Austin, Texas, USA

Digital Library

[11]

S. T. King, G. W. Dunlap, and P. M. Chen. Debugging Operating Systems with Time-Traveling Virtual Machines. In Proceedings of the USENIX Annual Technical Conference (USENIX'05), April 10-15, 2005, Anaheim, CA, USA

Digital Library

[12]

S. T. King. Operating System Extensions to Support Host-Based Virtual Machines. Technical Report CSE-TR-465-02, University of Michigan, September 2002

[13]

M. Kozuch and M. Satyanarayanan. Internet Suspend/Resume. In Proceedings of the IEEE Workshop on Mobile Computing Systems and Applications (HotMobile'02), June 20-21, 2002, Callicoon, NY, USA, p.40

Digital Library

[14]

S. Kumar and K. Schwan. Netchannel: A VMM-level Mechanism for Continuous, Transparent Device Access During VM Migration. In Proceedings of the 2008 International Conference on Virtual Execution Environments (VEE'08), March 5-7, 2008, Seattle, WA, USA, pp.31--40

Digital Library

[15]

J. R. Lange and P. A. Dinda. Transparent Network Services via a Virtual Traffic Layer for Virtual Machines. In Proceedings of the 16th IEEE International Symposium on High Performance Distributed Computing (HPDC'07), June 27-29, 2007, Monterey Bay, California, USA

Digital Library

[16]

A. B. Nagarajan, F. Mueller, C. Engelmann, and S. L. Scott. Proactive Fault Tolerance for HPC with Xen Virtualization. In Proceedings of 21st ACM International Conference on Supercomputing (ICS'07), June 16-20, 2007, Seattle, WA, USA, pp.23--32

Digital Library

[17]

M. Nelson, B. H. Lim, and G. Hutchins. Fast Transparent Migration for Virtual Machines. In Proceedings of USENIX Annual Technical Conference (USENIX'05), April 10-15, 2005, Marriott Anaheim, Anaheim, CA, USA, pp.391--394

Digital Library

[18]

R. Nathuji and K. Schwan. Virtual Power: Coordinated Power Management in Virtualized Enterprise Systems. In Proceedings of the 22nd ACM Symposium on Operating Systems Principles (SOSP'07), October 14-17, 2007, Skamania Lodge Stevenson, WA

Digital Library

[19]

D. A. S. de Oliveira, J. R. Crandall, G. Wassermann, S. F. Wu, Z. Su, and F. T. Chong. ExecRecorder: VM-Based Full-System Replay for Attack Analysis and System Recovery. In Proceedings of The 9th Asian Symposium on Information Display (ASID'06), October 21, 2006, San Jose, California, USA, pp.66--71

Digital Library

[20]

C. Perkins, IP Encapsulation within IP, RFC 2003, 1996

Digital Library

[21]

C. P. Sapuntzakis, R. Chandra, B. Pfaff, J. Chow, M. S. Lam, and M. Rosenblum. Optimizing the Migration of Virtual Computers. In Proceedings of the 5th Symposium on Operating Systems Design and Implementation (OSDI'02), December 8-11, 2002, Boston, MA, USA

Digital Library

[22]

A. Surie, H. A. Lagar-Cavilla, E. de Lara, and M. Satyanarayanan. Low-Bandwidth VM Migration via Opportunistic Replay. In Proceedings of the Ninth Workshop on Mobile Computing Systems and Applications (HotMobile'08), February 25-26, 2008, Napa Valley, CA, USA

Digital Library

[23]

F. Travostino, P. Daspit, L. Gommans, C. Jog, C. de Laat, J. Mambretti, I. Monga, B. van Oudenaarde, S. Raghunath, and P. Wang, Seamless Live Migration of Virtual Machines Over the MAN/WAN, Future Generations Computer Systems, Vol.22, No.8, October 2006

Digital Library

[24]

A. Whitaker, R. S. Cox, M. Shaw, and S. D. Gribble. Constructing Services with Interposable Virtual Hardware. In Proceedings of the First Symposium on Networked Systems Design and Implementation (NSDI '04), March 29-31, 2004, San Francisco, USA, pp.169--182

Digital Library

[25]

B. Wellington. Secure DNS Dynamic Update, RFC 3007

[26]

M. Xu, V. Malyugin, J. Sheldon, G. Venkitachalam, and B. Weissman. ReTrace: Collecting Execution Trace with Virtual Machine Deterministic Replay. In Proceedings of the Third Annual Workshop on Modeling, Benchmarking and Simulation, June 10, 2007, California, USA

[27]

M. Zhao and R. J. Figueiredo. Experimental Study of Virtual Machine Migration in Support of Reservation of Cluster Resources. In Proceedings of the 2nd International Workshop on Virtualization Technologies in Distributed Computing (VTDC'07), November 12, 2007, Reno, NV, USA

Digital Library

Cited By

黄庆(2024)A Security Model for Virtual Machine Rollback in Cloud EnvironmentsComputer Science and Application10.12677/csa.2024.14615614:06(196-207)Online publication date: 2024
https://doi.org/10.12677/csa.2024.146156
Soussi WGür GStiller B(2024)Democratizing Container Live Migration for Enhanced Future Networks - A SurveyACM Computing Surveys10.1145/370443657:4(1-37)Online publication date: 14-Nov-2024
https://dl.acm.org/doi/10.1145/3704436
Doan TFitzek FNguyen G(2024)StateOS: Enabling Versatile Network Function Virtualization in Edge CloudsNOMS 2024-2024 IEEE Network Operations and Management Symposium10.1109/NOMS59830.2024.10575285(1-9)Online publication date: 6-May-2024
https://doi.org/10.1109/NOMS59830.2024.10575285
Show More Cited By

Index Terms

Live migration of virtual machine based on full system trace and replay
1. General and reference
  1. Cross-computing tools and techniques
    1. Design
2. Software and its engineering
  1. Software organization and properties
    1. Software system structures
      1. Distributed systems organizing principles

Recommendations

Traffic-sensitive live migration of virtual machines
CCGRID '15: Proceedings of the 15th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing

In this paper we address the problem of network contention between the migration traffic and the Virtual Machine (VM) application traffic for the live migration of co-located Virtual Machines. When VMs are migrated with pre-copy, they run at the source ...
Performance Analysis for Pareto-Optimal Green Consolidation Based on Virtual Machines Live Migration

Huge energy requirement of cloud data centers is prime concern. Dynamic Virtual Machine VM consolidation based on VM live migration to switched-off or put some of the under-loaded host Physical Machines PMs into a low power consumption mode can ...
Improving Total Migration Time in Live Virtual Machine Migration
ICCCT '15: Proceedings of the Sixth International Conference on Computer and Communication Technology 2015

Virtualization is the key underlying technology enabling cloud providers to host services for a large number of customers. Live migration is an essential feature of virtualization that allows transfer of virtual machines from one physical server to ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

HPDC '09: Proceedings of the 18th ACM international symposium on High performance distributed computing

June 2009

237 pages

ISBN:9781605585871

DOI:10.1145/1551609

General Chairs:
Dieter Kranzlmüller
Ludwig-Maximilians-Universität München, Leibniz Supercomputing Centre, Germany
,
Arndt Bode
Technische Universität München, Germany
,
Heinz-Gerd Hegering
Leibniz Supercomputing Centre, Germany
,
Program Chairs:
Henri Casanova
University of Hawaii at Manoa, USA
,
Michael Gerndt
Technische Universität München, Germany

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 June 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

HPDC '09

Sponsor:

HPDC '09: International Symposium on High Performance Distributed Computing

June 11 - 13, 2009

Garching, Germany

Acceptance Rates

Overall Acceptance Rate 166 of 966 submissions, 17%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

171
Total Citations
View Citations
2,701
Total Downloads

Downloads (Last 12 months)47
Downloads (Last 6 weeks)7

Reflects downloads up to 27 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

黄庆(2024)A Security Model for Virtual Machine Rollback in Cloud EnvironmentsComputer Science and Application10.12677/csa.2024.14615614:06(196-207)Online publication date: 2024
https://doi.org/10.12677/csa.2024.146156
Soussi WGür GStiller B(2024)Democratizing Container Live Migration for Enhanced Future Networks - A SurveyACM Computing Surveys10.1145/370443657:4(1-37)Online publication date: 14-Nov-2024
https://dl.acm.org/doi/10.1145/3704436
Doan TFitzek FNguyen G(2024)StateOS: Enabling Versatile Network Function Virtualization in Edge CloudsNOMS 2024-2024 IEEE Network Operations and Management Symposium10.1109/NOMS59830.2024.10575285(1-9)Online publication date: 6-May-2024
https://doi.org/10.1109/NOMS59830.2024.10575285
Sinha ABanerjee PRoy SRathore NSingh NUddin MAbdelhaq MAlsaqour R(2024)Improved Dynamic Johnson Sequencing Algorithm (DJS) in Cloud Computing Environment for Efficient Resource Scheduling for Distributed OverloadingJournal of Systems Science and Systems Engineering10.1007/s11518-024-5606-z33:4(391-424)Online publication date: 24-May-2024
https://doi.org/10.1007/s11518-024-5606-z
Banerjee PRoy SModibbo UPandey SChaudhary PSinha ASingh N(2023)OptiDJS+: A Next-Generation Enhanced Dynamic Johnson Sequencing Algorithm for Efficient Resource Scheduling in Distributed Overloading within Cloud Computing EnvironmentElectronics10.3390/electronics1219412312:19(4123)Online publication date: 2-Oct-2023
https://doi.org/10.3390/electronics12194123
Singh SSingh D(2023)Comprehensive Analysis of VM Migration Trends in Cloud Data CentersRecent Patents on Engineering10.2174/187221211766622112916072617:6Online publication date: Nov-2023
https://doi.org/10.2174/1872212117666221129160726
Bartolo ASabry Aly MMichelogiannakis GMitra S(2023)MC-ELMM: Multi-Chip Endurance-Limited Memory ManagementProceedings of the International Symposium on Memory Systems10.1145/3631882.3631905(1-16)Online publication date: 2-Oct-2023
https://dl.acm.org/doi/10.1145/3631882.3631905
He TBuyya R(2023)A Taxonomy of Live Migration Management in Cloud ComputingACM Computing Surveys10.1145/361535356:3(1-33)Online publication date: 5-Oct-2023
https://dl.acm.org/doi/10.1145/3615353
Li TChandramouli BBurckhardt SMadden S(2023)DARQ Matter Binds Everything: Performant and Composable Cloud Programming via Resilient StepsProceedings of the ACM on Management of Data10.1145/35892621:2(1-27)Online publication date: 20-Jun-2023
https://dl.acm.org/doi/10.1145/3589262
Ramana KAluvalu RGunjan VSingh NPrasadhu M(2022)Multipath Transmission Control Protocol for Live Virtual Machine Migration in the Cloud EnvironmentWireless Communications & Mobile Computing10.1155/2022/20608752022Online publication date: 1-Jan-2022
https://dl.acm.org/doi/10.1155/2022/2060875
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten