Skip to main content
SpringerLink
Log in

WAYFINDER: parallel virtual machine reallocation through A* search

  • Regular Research Paper
  • Published:
Memetic Computing Aims and scope Submit manuscript

Abstract

Modern virtual machine (VM) management software enables consolidation of VMs for power savings or load-balancing for performance. While existing literature provides various methods for computing a better load-balanced, or consolidated goal state, it fails to adequately suggest the best path from the system’s current state to the desired goal allocation. This paper discusses an approach to efficient path finding in VM placement problems for cloud computing environments of moderate scale with results indicating the solution is reasonable for managing hundreds of VMs. We present an overview of known approaches to dynamic VM placement and discuss their shortcomings with respect to dynamic reallocation. We then describe a novel design and implementation of a heuristic search algorithm to determine optimal sequential migration plans to transition from a given VM-to-host allocation to an arbitrary desired allocation state. We then elaborate nuances of A* application to this domain along with our simulation-based validation approach. Finally, this work demonstrates a novel and highly effective technique for exploiting migration parallelism in order to rapidly achieving VM reallocation convergence suitable for continual workload rebalancing in cloud data centers.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

Notes

  1. To enforce co-location and anti-colocation policy, we opted to leverage the concept of VM contracts [18]. Our implementation of co-location and anti-colocation contracts were the addition of small XML stanzas to the existing VM XML definition files. Upon achieving some success with constructing optimal consolidation plans, we then set out to construct an algorithm for high performance live migration plan generation.

References

  1. Campegiani P et al (2009) A general model for VMs resources allocation in multi-tier distributed systems. In: Fifth international conference on autonomic and autonomous systems, 2009. ICAS ’09, pp 162–167, 20–25 April 2009. doi:10.1109/ICAS.2009.49

  2. Lee S, Panigrahy R, Prabhakaran V, Ramasubramanian V, Talwar K, Uyeda L, Wieder U (2011) Validating heuristics for virtual machines consolidation. Microsoft Research, MSR-TR-2011-9. https://www.microsoft.com/en-us/research/publication/validating-heuristics-for-virtual-machines-consolidation/

  3. Dow EM (2016) Decomposed multi-objective bin-packing for virtual machine consolidation. PeerJ Comput Sci 2:e47

    Article  Google Scholar 

  4. Gu et al (2012) A new resource scheduling strategy based on genetic algorithm in cloud computing environment. J Comput 7:1

  5. Campegiani P (2009) A genetic algorithm to solve the virtual machines resources allocation problem in multi-tier distributed systems. In: Second international workshop on virtualization performance: analysis, characterization, and tools (VPACT 2009), Boston, Massachusetts

  6. Lynar T et al (2009) Auction resource allocation mechanisms in grids of heterogeneous computers. WSEAS Trans Comput 8(10):1671–1680

    Google Scholar 

  7. Lo S et al (2013) Design and analysis of schedules for virtual network migration. In: Proceedings of the 11th international IFIP conference on networking, IFIP Networking 2013

  8. Boughzala B et al (2011) OpenFlow supporting interdomain virtual machine migration. In: Proceedings of eighth international conference on wireless and optical communications networks. doi:10.1109/WOCN.2011.5872945

  9. Dow EM et al (2009) A reference implementation architecture for deploying a highly-available networking infrastructure for cloud computing and virtual environments using OSPF. IBM Platform Test-z Systems library

  10. Dow EM et al (2010) Validation of OSPF on IBM Linux on system z at scale. IBM Platform Test-z Systems library

  11. Hyser C, Mckee B, Gardner R, Watson BJ (2007) Autonomic virtual machine placement in the data center. HP Labs Technical Report HPL-2007-189, February 2007

  12. Gulati A et al (2012) VMWare distributed resource management: design, implementation, and lessons learned. VMware Tech J 1(1):45–64

    Google Scholar 

  13. IBM United States Software Announcement 213-590, dated December 10, 2013. Available online: http://www-01.ibm.com/common/ssi/rep_ca/0/897/ENUS213-590/ENUS213-590.PDF

  14. Tantawi AN (2012) A scalable algorithm for placement of virtual clusters in large data centers. In: 2012 IEEE 20th international symposium on modeling, analysis and simulation of computer and telecommunication systems, pp 3–10, 7–9 Aug 2012

  15. Hu W et al (2013) A quantitative study of virtual machine live migration. In: Proceedings of the 2013 ACM cloud and autonomic computing conference (CAC ’13) ACM, New York. doi:10.1145/2494621.2494622

  16. Hart PE et al (1968) A formal basis for the heuristic determination of minimum cost paths. IEEE Trans Syst Sci Cybern SSC4 4(2):100–107

  17. Dow EM, Matthews N (2015) Virtual machine migration plan generation through A* search. In: Cloud networking (CloudNet), 2015 IEEE 4th international conference on cloud networking, pp 71–73, 5–7 Oct 2015. doi:10.1109/CloudNet.2015.7335283

  18. Matthews et al (2009) Virtual machine contracts for datacenter and cloud computing environments. In: Proceedings of the first workshop on automated control for datacenters and clouds (ACDC09), June 2009

  19. Zhou et al (2002) Memory-bounded A* graph search. In: 15th International florida artificial intelligence research society conference, pp 203–209

  20. Stuart Russell (1992) Efficient memory-bounded search methods. In: Bernd Neumann (ed) Proceedings of the 10th European conference on Artificial intelligence (ECAI ’92), pp 1–5, Wiley, New York, USA

  21. Salfner F et al (2012) Dependable estimation of downtime for virtual machine live migration. Int J Adv Syst Meas 5(1):70–88

    Google Scholar 

  22. Isci C et al (2011) Improving server utilization using fast virtual machine migration. IBM J Res Dev 55(6):4:1–4:12

  23. Song X et al (2013) Parallelizing live migration of virtual machines. In: Proceedings of the ACM SIGPLAN/SIGOPS international conference on virtual execution environment, pp 85–96

  24. Wang H et al (2015) Virtual machine migration planning in software-defined networks. Proceedings of the IEEE conference INFOCOM, Apr/May 2015:487–495

    Google Scholar 

  25. Bari MF et al (2014) CQNCR: optimal VM migration planning in cloud data centers. In: 2014 IFIP networking conference, IEEE, pp 1–9

Download references

Author information

Authors and Affiliations

  1. IBM Research, Yorktown Heights, USA

    Eli M. Dow

  2. Clarkson University, Potsdam, NY, USA

    Eli M. Dow & Jeanna N. Matthews

Authors
  1. Eli M. Dow
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jeanna N. Matthews
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Eli M. Dow.

Additional information

IBM, the IBM logo, and ibm.com are trademarks or registered trademarks of International Business Machines Corp., registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Dow, E.M., Matthews, J.N. WAYFINDER: parallel virtual machine reallocation through A* search. Memetic Comp. 8, 255–267 (2016). https://doi.org/10.1007/s12293-016-0205-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12293-016-0205-2

Keywords

Search

Navigation