Skip to main content
SpringerLink
Log in

Support for spot virtual machine purchasing simulation

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

With the rapid progress of cloud computing technology, a growing number of big data application providers begin to deploy applications on virtual machines rented from infrastructure as a service providers. Current infrastructure as a service provider offers diverse purchasing options for the application providers. There are mainly three types of purchasing options: reserved virtual machine, on-demand virtual machine and spot virtual machine. The spot virtual machine is a specific type of virtual machine that employs a dynamic pricing model. Because can be stopped by the infrastructure as a service providers without notice, the spot virtual machine is suitable for large-scale divisible applications, such as big data analysis. Therefore, spot virtual machine is chosen by many big data application providers for its low rental cost per hour. When spot virtual machine is chosen, a major issue faced by the big data application providers is how to minimize the virtual machine rental cost while meet service requirements. Many optimal spot virtual machine purchasing approaches have been presented by the researchers. However, there is a shortage of simulators that enable researchers to evaluate their newly proposed spot virtual machine purchasing approach. To fill this gap, in this paper, we propose SpotCloudSim to support for dynamic virtual machine pricing model simulation. SpotCloudSim provides an extensible interface to help researchers implement new spot virtual machine purchasing approach. In addition, SpotCloudSim can also study the behavior of the newly proposed spot virtual machine purchasing approaches. We demonstrate the capabilities of SpotCloudSim by using three spot virtual machine purchasing approaches. The results indicate the benefits of our proposed simulation system.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18

Similar content being viewed by others

References

  1. Shabeera, T. P., Madhu Kumar, S. D., Salam, S. M., Murali Krishnan, K.: Optimizing VM allocation and data placement for data-intensive applications in cloud using ACO metaheuristic algorithm. Engineering Science and Technology, an International Journal, published online, pp. 1-13(2016)

  2. Wang, S., Zhou, A., Hsu, C.H., Xiao, X., Yang, F.: Provision of data-intensive services through energy- and QoS-aware virtual machine placement in national cloud data centers. IEEE Trans. Emerg. Top. Comput. 4(2), 290–300 (2016)

    Article  Google Scholar 

  3. Dastjerdi, A.V., Buyya, R.: Compatibility-aware cloud service composition under fuzzy preferences of users. IEEE Trans. Cloud Comput. 2(1), 1–13 (2014)

    Article  Google Scholar 

  4. Xiao, Z., Song, W., Chen, Q.: Dynamic resource allocation using virtual machines for cloud computing environment. IEEE Trans. Parallel Distrib. Syst. 24(6), 1107–1117 (2013)

    Article  Google Scholar 

  5. Fox, A., Griffith, R., Joseph, A., Katz, R., Konwinski, A., Lee, G., Patterson, D., Rabkin, A., Stoica, I.: Above the Clouds: A Berkeley View of Cloud Computing, vol. 28, pp. 13. Dept. Electrical Eng. and Comput. Sciences, University of California, Berkeley, Rep. UCB/EECS, (2009)

  6. Li, H., Dong, M., Ota, K., Guo, M.: Pricing and repurchasing for big data processing in multi-clouds. IEEE Trans. Emerg. Top. Comput. 4(2), 266–277 (2016)

    Article  Google Scholar 

  7. Liu, Z., Wang, S., Sun, Q., Zou, H., Yang, F.: Cost-aware cloud service request scheduling for SaaS providers. Comput. J. 57(2), 291–301 (2014)

    Article  Google Scholar 

  8. Zhang, W.Z., Xie, H.C., Hsu, C.H.: Automatic memory control of multiple virtual machines on a consolidated server. IEEE Trans. Cloud Comput. 5(1), 2–14 (2017)

    Article  Google Scholar 

  9. Li, H., Dong, M., Ota, K.: Radio access network virtualization for the social internet of things. IEEE Cloud Comput. 2(6), 42–50 (2015)

    Article  Google Scholar 

  10. Dong, M., Li, H., Ota, K., Yang, L.T., Zhu, H.: Multicloud-based evacuation services for emergency management. IEEE Cloud Comput. 1(4), 50–59 (2014)

    Article  Google Scholar 

  11. Agmon Ben-Yehuda, O., Ben-Yehuda, M., Schuster, A., Tsafrir, D.: Deconstructing amazon EC2 spot instance pricing. ACM Trans. Econ. Comput. 1(3), 16 (2013)

    Article  Google Scholar 

  12. Stokely, M., Winget, J., Keyes, E., Grimes, C. and Yolken, B.: Using a market economy to provision compute resources across planet-wide clusters. Parallel and Distributed Processing, 2009. IPDPS 2009. IEEE International Symposium on, IEEE, pp. 1–8 (2009)

  13. Wang, Q., Ren, K., Meng, X.: When, cloud meets eBay: Towards effective pricing for cloud computing. INFOCOM, 2012 Proceedings IEEE, IEEE, pp. 936–944, (2012)

  14. Chen, J., Wang, C., Zhou, B. B., Sun, L., Lee, Y. C. and Zomaya, A. Y.: Tradeoffs between profit and customer satisfaction for service provisioning in the cloud. Proceedings of the 20th international symposium on High performance distributed computing, pp. 229–238. ACM, New York (2011)

  15. Zhou, A., Sun, Q., Sun, L., Li, J. and Yang, F. ’Maximizing the profits of cloud service providers via dynamic virtual resource renting approach’, EURASIP Journal on Wireless Communications and Networking, Vol.2015, No.1, pp.71(2015)

  16. Guo, W., Chen, K., Wu, Y., Zheng, W.: Bidding for highly available services with low price in spot instance market. Proceedings of the 24th International Symposium on High-Performance Parallel and Distributed Computing, pp. 191–202. ACM, New York (2015)

  17. He, X., Shenoy, P., Sitaraman, R. and Irwin, D.: Cutting the cost of hosting online services using cloud spot markets. The 25th International ACM Symposium on High-Performance Parallel and Distributed Computing (HPDC), pp. 1–12 (2015)

  18. Legrand, A., Marchal, L., Casanova, H.: Scheduling distributed applications: the SimGrid simulation framework. CCGrid 2003. 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid, 2003. Proceedings., pp. 138–145 (2003)

  19. Buyya, R., Murshed, M.: GridSim: a toolkit for the modeling and simulation of distributed resource management and scheduling for grid computing. Concurr. Comput. Pract. Exp. 14(13–15), 1175–1220 (2002)

    Article  MATH  Google Scholar 

  20. Calheiros, R. N., Ranjan, R., De Rose, C. A., Buyya, R.: Cloudsim: A novel framework for modeling and simulation of cloud computing infrastructures and services, arXiv preprint arXiv:0903.2525 (2009)

  21. Calheiros, R.N., Ranjan, R., Beloglazov, A., De Rose, C.A., Buyya, R.: CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Softw. Pract. Exp. 41(1), 23–50 (2011)

    Article  Google Scholar 

  22. cloud2sim. “https://sourceforge.net/projects/cloud2sim/.”

  23. Chen, W., Deelman, E.: WorkflowSim: a toolkit for simulating scientific workflows in distributed environments. 2012 IEEE 8th International Conference on E-Science. pp. 1–8 (2012)

  24. AuctionSim. “http://www.cloudbus.org/cloudsim/CloudAuctionV2.0.zip.”

  25. Bux, M., Leser, U.: Dynamiccloudsim: simulating heterogeneity in computational clouds’. Proceedings of the 2nd ACM SIGMOD Workshop on Scalable Workflow Execution Engines and Technologies(SWEET), pp. 1–12. ACM, New York (2013)

  26. Gupta, S.K.S., Banerjee, A., Abbasi, Z., Varsamopoulos, G., Jonas, M., Ferguson, J., Gilbert, R.R., Mukherjee, T.: GDCSim: a simulator for green data center design and analysis. ACM Trans. Model. Comput. Simul. 24(1), 1–27 (2014)

    Article  MathSciNet  Google Scholar 

  27. Tighe, M., Keller, G., Bauer, M., Lutfiyya, H.: DCSim: a data centre simulation tool for evaluating dynamic virtualized resource management. 2012 8th International Conference on Network and Service Management (cnsm) and 2012 workshop on systems virtualiztion management (svm), pp. 385–392 (2012)

  28. Zafer, M., Song, Y., Lee, K.-W.: Optimal bids for spot VMs in a cloud for deadline constrained jobs. Cloud Computing (CLOUD), 2012 IEEE 5th International Conference on IEEE, pp. 75–82 (2012)

  29. Javadi, B., Thulasiram, R.K., Buyya, R.: Characterizing spot price dynamics in public cloud environments. Future Gener. Comput. Syst. 29(4), 988–999 (2013)

    Article  Google Scholar 

  30. Yi, S., Andrzejak, A., Kondo, D.: Monetary cost-aware checkpointing and migration on amazon cloud spot instances. IEEE Trans. Serv. Comput. 5(4), 512–524 (2012)

    Article  Google Scholar 

  31. Jung, D., Chin, S., Chung, K., Yu, H., Gil, J.: An efficient checkpointing scheme using price history of spot instances in cloud computing environment. Network and Parallel Computing, pp. 185–200. Springer, Berlin (2011)

    Chapter  Google Scholar 

Download references

Acknowledgements

This work is supported by NSFC (61602054), NSFC (61472047), and Beijing Natural Science Foundation (4174100). This work is supported by Macao FDCT-MOST Grant 001/2015/AMJ and Macao FDCT Grant 104/2014/A3.

Author information

Authors and Affiliations

  1. State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, Beijing, China

    Ao Zhou, Shangguang Wang, Qibo Sun, Jinglin Li & Fangchun Yang

  2. Faculty of Information Technology, Macau University of Science and Technology, Avenida Wei Long, Taipa, Macau, China

    Qinglin Zhao

Authors
  1. Ao Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shangguang Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Qibo Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jinglin Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Qinglin Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Fangchun Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ao Zhou.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Research involving animal and human rights

This article does not contain any studies with animals performed by any of the authors.

Informed consent

Informed consent was obtained from all individual participants included in the study.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhou, A., Wang, S., Sun, Q. et al. Support for spot virtual machine purchasing simulation. Cluster Comput 21, 1–13 (2018). https://doi.org/10.1007/s10586-017-0882-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10586-017-0882-8

Keywords

Search

Navigation