Skip to main content

Efficient Intermediate Data Placement in Federated Cloud Data Centers Storage

  • Conference paper
  • First Online:
Mobile, Secure, and Programmable Networking (MSPN 2016)

Part of the book series: Lecture Notes in Computer Science ((LNCCN,volume 10026))

  • 650 Accesses

Abstract

The goal of cloud federation strategies is to define a mechanism for resources sharing among federation collaborators. Those mechanisms must be fair to guaranty the common benefits of all the federation members. This paper focuses on intermediate data allocation cost in federated cloud storage. Through a federation mechanism, we propose a mixed integer linear programming model (MILP) to assist multiple data centers hosting intermediate data generated from a scientific community. Under the constraints of the problem, an exact algorithm is proposed to minimize intermediate data allocation cost over the federated data centers storage, taking into account scientific users requirements, intermediate data dependency and data size. Experimental results show the cost-efficiency and scalability of the proposed federated cloud storage model.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    Example of this platforms: Hadoop-MapReduce [1], NoSQL [2], OpenStack-NovaOrchestration [3] etc.

References

  1. Dean, J., Ghemawat, S.: MapReduce: simplified data processing on large clusters. Commun. ACM 51(1), 107–113 (2008)

    Article  Google Scholar 

  2. Google Cloud Platform. https://cloud.google.com/bigtable/

  3. Workflow Engines. https://wiki.openstack.org/wiki/NovaOrchestration/WorkflowEngines

  4. Apache Hadoop Core. http://hadoop.apache.org/core

  5. Swift-Open Stack. http://docs.openstack.org/developer/swift/

  6. Amazon Web Services. https://aws.amazon.com/fr/

  7. Kyriazis, D. (ed.): Data Intensive Storage Services for Cloud Environments. IGI Global, Hershey (2013)

    Google Scholar 

  8. Yuan, D., Yang, Y., Liu, X., Zhang, G., Chen, J.: A data dependency based strategy for intermediate data storage in scientific cloud workflow systems. Concurrency Comput. Pract. Experience 24(9), 956–976 (2012)

    Article  Google Scholar 

  9. Yuan, D., Yang, Y., Liu, X., Chen, J.: A data placement strategy in scientific cloud workflows. Future Gener. Comput. Syst. 26(8), 1200–1214 (2010)

    Article  Google Scholar 

  10. Zhao, Q., Xiong, C., Zhao, X., Yu, C., Xiao, J.: A data placement strategy for data-intensive scientific workflows in cloud. In: 2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid), pp. 928–934. IEEE, May 2015

    Google Scholar 

  11. Ruiz-Alvarez, A., Humphrey, M.: A model and decision procedure for data storage in cloud computing. In: 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid), pp. 572–579. IEEE, May 2012

    Google Scholar 

  12. Agarwala, S., Jadav, D., Bathen, L.A.: iCostale: adaptive cost optimization for storage clouds. In: IEEE International Conference on Cloud Computing (CLOUD), pp. 436–443. IEEE (2011)

    Google Scholar 

  13. Negru, C., Pop, F., Cristea, V.: Cost optimization for data storage in public clouds: a user perspective. In: Proceedings of 13th International Conference on Informatics in Economy (2014)

    Google Scholar 

  14. Toosi, A.N., Calheiros, R.N., Thulasiram, R.K., Buyya, R.: Resource provisioning policies to increase IaaS provider’s profit in a federated cloud environment. In: 2011 IEEE 13th International Conference on High Performance Computing and Communications (HPCC), pp. 279–287. IEEE, September 2011

    Google Scholar 

  15. Tarification Amazon S3. https://aws.amazon.com/fr/s3/pricing/

  16. Tarification - Microsoft Azure. https://azure.microsoft.com/fr-fr/pricing/details/storage/

  17. B2 Cloud Storage Tarification. https://www.backblaze.com/b2/cloud-storage.html

  18. Google Cloud Storage Pricing. https://cloud.google.com/storage/pricing

  19. http://ampl.com/products/solvers/solvers-we-sell/cplex/

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sonia Ikken .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing AG

About this paper

Cite this paper

Ikken, S., Renault, E., Barkat, A., Kechadi, M.T., Tari, A. (2016). Efficient Intermediate Data Placement in Federated Cloud Data Centers Storage. In: Boumerdassi, S., Renault, É., Bouzefrane, S. (eds) Mobile, Secure, and Programmable Networking. MSPN 2016. Lecture Notes in Computer Science(), vol 10026. Springer, Cham. https://doi.org/10.1007/978-3-319-50463-6_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-50463-6_1

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-50462-9

  • Online ISBN: 978-3-319-50463-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics