Abstract
The goal of cloud federation strategies is to define a mechanism for resources sharing among federation collaborators. Those mechanisms must be fair to guaranty the common benefits of all the federation members. This paper focuses on intermediate data allocation cost in federated cloud storage. Through a federation mechanism, we propose a mixed integer linear programming model (MILP) to assist multiple data centers hosting intermediate data generated from a scientific community. Under the constraints of the problem, an exact algorithm is proposed to minimize intermediate data allocation cost over the federated data centers storage, taking into account scientific users requirements, intermediate data dependency and data size. Experimental results show the cost-efficiency and scalability of the proposed federated cloud storage model.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Dean, J., Ghemawat, S.: MapReduce: simplified data processing on large clusters. Commun. ACM 51(1), 107–113 (2008)
Google Cloud Platform. https://cloud.google.com/bigtable/
Workflow Engines. https://wiki.openstack.org/wiki/NovaOrchestration/WorkflowEngines
Apache Hadoop Core. http://hadoop.apache.org/core
Swift-Open Stack. http://docs.openstack.org/developer/swift/
Amazon Web Services. https://aws.amazon.com/fr/
Kyriazis, D. (ed.): Data Intensive Storage Services for Cloud Environments. IGI Global, Hershey (2013)
Yuan, D., Yang, Y., Liu, X., Zhang, G., Chen, J.: A data dependency based strategy for intermediate data storage in scientific cloud workflow systems. Concurrency Comput. Pract. Experience 24(9), 956–976 (2012)
Yuan, D., Yang, Y., Liu, X., Chen, J.: A data placement strategy in scientific cloud workflows. Future Gener. Comput. Syst. 26(8), 1200–1214 (2010)
Zhao, Q., Xiong, C., Zhao, X., Yu, C., Xiao, J.: A data placement strategy for data-intensive scientific workflows in cloud. In: 2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid), pp. 928–934. IEEE, May 2015
Ruiz-Alvarez, A., Humphrey, M.: A model and decision procedure for data storage in cloud computing. In: 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid), pp. 572–579. IEEE, May 2012
Agarwala, S., Jadav, D., Bathen, L.A.: iCostale: adaptive cost optimization for storage clouds. In: IEEE International Conference on Cloud Computing (CLOUD), pp. 436–443. IEEE (2011)
Negru, C., Pop, F., Cristea, V.: Cost optimization for data storage in public clouds: a user perspective. In: Proceedings of 13th International Conference on Informatics in Economy (2014)
Toosi, A.N., Calheiros, R.N., Thulasiram, R.K., Buyya, R.: Resource provisioning policies to increase IaaS provider’s profit in a federated cloud environment. In: 2011 IEEE 13th International Conference on High Performance Computing and Communications (HPCC), pp. 279–287. IEEE, September 2011
Tarification Amazon S3. https://aws.amazon.com/fr/s3/pricing/
Tarification - Microsoft Azure. https://azure.microsoft.com/fr-fr/pricing/details/storage/
B2 Cloud Storage Tarification. https://www.backblaze.com/b2/cloud-storage.html
Google Cloud Storage Pricing. https://cloud.google.com/storage/pricing
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing AG
About this paper
Cite this paper
Ikken, S., Renault, E., Barkat, A., Kechadi, M.T., Tari, A. (2016). Efficient Intermediate Data Placement in Federated Cloud Data Centers Storage. In: Boumerdassi, S., Renault, É., Bouzefrane, S. (eds) Mobile, Secure, and Programmable Networking. MSPN 2016. Lecture Notes in Computer Science(), vol 10026. Springer, Cham. https://doi.org/10.1007/978-3-319-50463-6_1
Download citation
DOI: https://doi.org/10.1007/978-3-319-50463-6_1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-50462-9
Online ISBN: 978-3-319-50463-6
eBook Packages: Computer ScienceComputer Science (R0)