Abstract
In recent years, the parallel computing community has shown increasing interest in leveraging cloud resources for executing parallel applications. Clouds exhibit several fundamental features of economic value, like on-demand resource provisioning and a pay-per-use model. Additionally, several cloud providers offer their resources with significant discounts; however, possessing limited availability. Such volatile resources are an auspicious opportunity to reduce the costs arising from computations, thus achieving higher cost efficiency. In this paper, we propose a cost model for quantifying the monetary costs of executing parallel applications in cloud environments, leveraging volatile resources. Using this cost model, one is able to determine a configuration of a cloud-based parallel system that minimizes the total costs of executing an application.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Availability of H-series VMs in Microsoft Azure. https://azure.microsoft.com/en-us/blog/availability-of-h-series-vms-in-microsoft-azure/
ElasticHPC. http://www.elastichpc.org/
HPC Cloud Hits Petaflop. https://www.schrodinger.com/news/schrodinger-partners-cycle-computing-accelerate-materials-simulation-using-cloud
Microsoft Azure Low-Priority VMs. https://docs.microsoft.com/en-us/azure/batch/batch-low-pri-vms
Spotinst HPC. https://spotinst.com/solutions/hpc/
Amazon: Amazon EC2 Spot Instances (2014). https://aws.amazon.com/ec2/spot/
Da Rosa Righi, R., Rodrigues, V.F., Da Costa, C.A., Galante, G., De Bona, L.C.E., Ferreto, T.: AutoElastic: automatic resource elasticity for high performance applications in the cloud. IEEE Trans. Cloud Comput. 4(1), 6–19 (2016)
Deelman, E., Singh, G., Livny, M., Berriman, B., Good, J.: The cost of doing science on the cloud: the montage example. In: Proceedings of the ACM/IEEE Conference on Supercomputing (2008)
Google Cloud: Preemptible VMs. https://cloud.google.com/preemptible-vms/
Grama, A., Kumar, V., Karypis, G., Gupta, A.: Introduction to Parallel Computing, 2nd edn. Addison-Wesley, Boston (2003)
Gupta, A., Milojicic, D.: Evaluation of HPC applications on cloud. In: Proceedings of the 6th Open Cirrus Summit. IEEE (2012)
Haussmann, J., Blochinger, W., Kuechlin, W.: Cost-efficient parallel processing of irregularly structured problems in cloud computing environments. Cluster Comput. (2018). https://doi.org/10.1007/s10586-018-2879-3
Kehrer, S., Blochinger, W.: A survey on cloud migration strategies for high performance computing. In: Proceedings of the 13th Advanced Summer School on Service-Oriented Computing. IBM Research Division (2019)
Kehrer, S., Blochinger, W.: TASKWORK: a cloud-aware runtime system for elastic task-parallel HPC applications. In: Proceedings of 9th International Conference on Cloud Computing and Services Science (2019)
Rajan, D., Canino, A., Izaguirre, J.A., Thain, D.: Converting a high performance application to an elastic cloud application. In: Proceedings of the 3rd IEEE International Conference on Cloud Computing Technology and Science (2011)
Taifi, M.: Banking on decoupling: budget-driven sustainability for HPC applications on auction-based clouds. ACM SIGOPS Oper. Syst. Rev. 47(2), 41–50 (2013)
Taifi, M., Shi, J.Y., Khreishah, A.: SpotMPI: a framework for auction-based HPC computing using Amazon spot instances. In: Xiang, Y., Cuzzocrea, A., Hobbs, M., Zhou, W. (eds.) ICA3PP 2011. LNCS, vol. 7017, pp. 109–120. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-24669-2_11
Viana, V., De Oliveira, D., Mattoso, M.: Towards a cost model for scheduling scientific workflows activities in cloud environments. In: Proceedings of the IEEE World Congress on Services (2011)
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Haussmann, J., Blochinger, W., Kuechlin, W. (2019). Cost-Optimized Parallel Computations Using Volatile Cloud Resources. In: Djemame, K., Altmann, J., Bañares, J., Agmon Ben-Yehuda, O., Naldi, M. (eds) Economics of Grids, Clouds, Systems, and Services. GECON 2019. Lecture Notes in Computer Science(), vol 11819. Springer, Cham. https://doi.org/10.1007/978-3-030-36027-6_4
Download citation
DOI: https://doi.org/10.1007/978-3-030-36027-6_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-36026-9
Online ISBN: 978-3-030-36027-6
eBook Packages: Computer ScienceComputer Science (R0)