Skip to main content

Advertisement

Springer Nature Link
Log in

Introspection-Based Memory Pruning for Live VM Migration

  • Published:
International Journal of Parallel Programming Aims and scope Submit manuscript

Abstract

Virtual Machine (VM) migration is an appealing technique on nowadays cloud platforms to achieve high availability, load balancing and power saving. Unfortunately, migration of VM involves transferring a large amount of data, thereby imposing high overheads on network traffic, and consequently results in significant application performance degradation. In this paper, we propose an introspection-based memory pruning method for fast and effective live VM migration. Firstly, we classify memory pages into five categories including anonymous, inode, kernel, free and cache pages, according to how they are used by OS. Then, upon migration, we drop the free pages which are insignificant and cache pages which are redundant. In this way, a large amount of unnecessary data are precluded, so that the migration time is reduced as well. Our system can classify memory pages into specific categories precisely using introspection. Besides cache pages, we also eliminate the pages that are ever used but are freed later which is different from most of the works that only eliminate free pages which are marked as zero pages by OS. Experiments show that our work achieves preferable reduction (72% on average ) in terms of the total migration time compared with the original pre-copy algorithm within QEMU/KVM.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

Explore related subjects

Discover the latest articles and news from researchers in related subjects, suggested using machine learning.

References

  1. Jin, H., Deng, L., Wu, S., Shi, X., Pan X.: Live virtual machine migration with adaptive, memory compression. In: Proceedings of IEEE International Conference on Cluster Computing, pp. 1–10, New Orleans, LA, USA (2009)

  2. Liu, H., Jin, H., Liao, X., Hu, L., Yu, C.: Live migration of virtual machine based on full system trace and replay. In: Proceedings of the 18th ACM International Symposium on High Performance Distributed Computing, pp. 101–110, New York, NY, USA (2009)

  3. Jo, C., Gustafsson, E., Son, J., Egger, B.: Efficient live migration of virtual machines using shared storage. In: Proceedings of the 9th ACM SIGPLAN/SIGOPS InternationalConference on Virtual Execution Environments, pp. 41–50, Houston, Texas, USA (2013)

  4. Chiang, J.-H., Li, H. -L., Chiueh, T-C.: Introspection-based memory de-duplication and migration. In: Proceedings of the 9th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments, pp. 51-62, Houston, Texas, USA (2013)

  5. Kloster, J., Kristensen, J., Mejlholm A.: Determining the use of inter-domain shareable pages using kernel introspection. Technical report, Aalborg University (2007)

  6. Clark, C., Fraser, K., Hand, S., Hansen, J., Jul, E., Limpach, C., Pratt, I., Warfield, A.: Live migration of virtual machines. In: Proceedings of the 2nd Usenix Conference on Symposium on Networked Systems Design & Implementation, pp. 273–286, Berkeley, CA, USA (2005)

  7. Hines, M., Gopalan, K.: Post-copy based live virtual machine migration using adaptive pre-paging and dynamic self- ballooning. In: Proceedings of the 5th ACM SIGPLAN/SIGOPS International Conference on Virtual execution environments, pp. 51–60, New York, NY, USA (2009)

  8. Svard, P., Hudzia, B., Tordsson, J., Elmroth, E.: Evaluation of delta compression techniques for efficient live migration of large virtual machines. In: Proceedings of the 7th ACM SIG- PLAN/SIGOPS International Conference on Virtual Execution Environments, pp. 111–120, New York, NY, USA (2011)

  9. Zhang, X., Huo, Z., Ma, J., Meng, D.: Exploiting data de-duplication to accelerate live virtual machine migration. In: Proceedings of IEEE International Conference on Cluster Computing, pp. 88–96 (2010)

  10. Song, X., Shi, J ., Liu, R., Yang, J., Chen, H.: Parallelizing live migration of virtual machines. In: Proceedings of the 9th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments, pp. 85–96, Houston, Texas, USA (2013)

  11. Abe, Y., Geambasu, R., Joshi, K., Satyanarayanan, M: Urgent virtual machine eviction with enlightened post-copy. In: Proceedings of the 12th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments, pp. 51–64, Atlanta, GA, USA (2016)

  12. Nathan, S., Bellur, U., Kulkarni, P.:. On selecting the right optimizations for virtual machine migration. In: Proceedings of the12th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments, pp. 37–49, Atlanta, GA, USA (2016)

  13. Garfinkel, T., Rosenblum, M.: A virtual machine introspection based architecture for intrusion detection. In: Proceedings of the 10th Annual Network and Distributed System Security Symposium, pp. 191–206, San Diego, California, USA (2003)

  14. Payne, B., Carbone, M., Lee, W.: Secure and flexible monitoring of virtual machines. In: Proceedings of the 23rd Annual Computer Security Applications Conference, pp. 385–397, Miami Beach, Florida, USA (2007)

  15. Dinaburg, A., Royal, P., Sharif, M., Lee, W.: Ether: malware analysis via hard- ware virtualization extensions. In: Proceedings of the 15th ACM Conference on Computer and Communications Security, pp. 51–62, Alexandria, VA, USA (2008)

  16. Payne, B., Carbone, M., Sharif, M., Lee, W.: Lares: Architecture for secure active monitoring using virtualization. In: Proceedings of the 29th IEEE Symposium on Security and Privacy, pp. 233–247, Oakland, California, USA (2008)

  17. Pham, C., Estrada, Z., Cao, P. et al.: Reliability and security monitoring of virtual machines using hardware architectural invariants. In: Proceedings of the 44th Annual IEEE/IFIP International Conference on Dependable Systems and Networks, pp. 13–24, Atlanta, GA, USA (2014)

  18. Jain, B., Baig, M.B., Zhang, D., Porter, D.E., Sion, R.: SoK: Introspections on trust and the semantic gap. In: Proceedings of the 35th IEEE Symposium on Security and Privacy, pp. 605–620, SAN JOSE, CA, USA (2014)

  19. Wang, C., Yun, X., Hao, Z., Cui, L., Han, Y., Zou, Q.: Exploring efficient and robust virtual machine introspection techniques. In: Proceedings of the 15th International Conference on Algorithms and Architectures for Parallel Processing, pp. 429–448, Zhangjiajie, China (2015)

  20. Bauman, E., Ayoade, G., Lin, Z.: A survey on hypervisor-based monitoring: approaches, applications, and evolutions. ACM Comput. Surv. (CSUR) 48(1), 10 (2015)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China

    Chonghua Wang, Zhiyu Hao, Lei Cui & Xiaochun Yun

  2. University of Chinese Academy of Sciences, Beijing, China

    Chonghua Wang

  3. Purdue University, West Lafayette, USA

    Chonghua Wang & Xiangyu Zhang

Authors
  1. Chonghua Wang
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Zhiyu Hao
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Lei Cui
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Xiangyu Zhang
    View author publications

    You can also search for this author inPubMed Google Scholar

  5. Xiaochun Yun
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Zhiyu Hao.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, C., Hao, Z., Cui, L. et al. Introspection-Based Memory Pruning for Live VM Migration. Int J Parallel Prog 45, 1298–1309 (2017). https://doi.org/10.1007/s10766-016-0471-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10766-016-0471-0

Keywords