Skip to main content

Optimizing Data Placement in Multi-cloud Environments Considering Data Temperature

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12737))

Abstract

Most data in the real world have spatial and temporal attributes, and some other essential data attributes also have temporal and spatial variability. In the research field of cloud and edge computing, these features always have great impact on data placement and task scheduling. However, these critical spatiotemporal features have been largely ignored by existing studies. To this end, this work firstly synthesizes data popularity, geographical location distribution and other spatiotemporal features to abstract the definition of data temperature, and a temperature calculation model is proposed to reflect the spatiotemporal correlation and variation trend. Then, we put forward a multi-cloud dynamic storage strategy considering data temperature to improve service quality and reflect the value of data temperature. Experiments are performed to evaluate the proposed strategy, which can effectively reduce the total cost and improve data availability.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Wu, Z., Butkiewicz, M., Perkins, D., et al.: Spanstore: cost-effective geo-replicated storage spanning multiple cloud services. In: 24th ACM Symposium on Operating Systems Principles, pp. 292–308. ACM, New York (2013)

    Google Scholar 

  2. Zhang, Q., Li, S., Li, Z., et al.: CHARM: A cost-efficient multi-cloud data hosting scheme with high availability. IEEE Trans. Cloud Comput. 3(3), 372–386 (2015)

    Article  Google Scholar 

  3. Gill, N.K., Singh, S.: A dynamic, cost-aware, optimized data replication strategy for heterogeneous cloud data centers. Future Gener. Comput. Syst. 65, 10–32 (2016)

    Article  Google Scholar 

  4. Wang, P., Zhao, C., Zhang, Z.: An ant colony algorithm-based approach for cost-effective data hosting with high availability in multi-cloud environments. In: 2018 IEEE 15th International Conference on Networking, Sensing and Control (ICNSC). IEEE, NJ (2018)

    Google Scholar 

  5. Wang, P., Zhao, C., Wei, Y., et al.: An adaptive data placement architecture in multi-cloud environments. Sci. Program. 2020(1), 1–12 (2020)

    Google Scholar 

  6. Oh, K., Qin, N., Chandra, A., Weissman, J.: Wiera: Policy-driven multi-tiered geo-distributed cloud storage system. IEEE Trans. Parallel Distrib. Syst. 31(2), 294–305 (2020)

    Article  Google Scholar 

  7. Mu, S., Chen, K., Gao, P., et al.: μlibcloud: providing high available and uniform accessing to multiple cloud storages. In: the 2012 ACM/IEEE 13th International Conference on Grid Computing, pp. 201–208. IEEE, NJ (2012)

    Google Scholar 

  8. Chen, S., Li, Y.: Visual modeling and representations of spatiotemporal transportation data: An object-oriented approach. In: 2011 International Symposium on Computer Science and Society, pp. 218–222. IEEE, NJ (2011)

    Google Scholar 

  9. Li, S.: An improved DBSCAN algorithm based on the neighbor similarity and fast nearest neighbor query. IEEE Access 8, 47468–47476 (2020)

    Article  Google Scholar 

  10. Viswanathan, G., Schneider, M.: The objects interaction graticule for cardinal direction querying in moving objects data warehouses. In: Catania, B., Ivanović, M., Thalheim, B. (eds.) ADBIS 2010. LNCS, vol. 6295, pp. 520–532. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-15576-5_39

    Chapter  Google Scholar 

  11. Yan, H., Liu, J., Li, Y., et al.: Spatial popularity and similarity of watching videos in large-scale urban environment. IEEE Trans. Netw. Serv. Manage. 15(2), 797–810 (2018)

    Article  MathSciNet  Google Scholar 

  12. Li, C., Liu, J., Ouyang, S.: Characterizing and predicting the popularity of online videos. IEEE Access 4, 1630–1641 (2016)

    Article  Google Scholar 

  13. Li, Y., Luo, J., Jin, J., et al.: An effective model for edge-side collaborative storage in data-intensive edge computing. In: 2018 IEEE 22nd International Conference on Computer Supported Cooperative Work in Design (CSCWD), pp. 92–97. IEEE, NJ (2018)

    Google Scholar 

  14. SNAP: Network datasets Gowalla. http://snap.stanford.edu/data/loc-gowalla.html. Accessed 21 July 2020

  15. Mansouri, Y., Buyya, R.: To move or not to move: Cost optimization in a dual cloud-based storage architecture. J. Netw. Comput. Appl. 75, 223–235 (2016)

    Article  Google Scholar 

  16. Wu, Y., Wu, C., Li, B., et al.: Scaling social media applications into geo-distributed clouds. IEEE/ACM Trans. Netw. (TON) 23(3), 689–702 (2015)

    Article  Google Scholar 

  17. CloudHarmony. http://www.cloudharmony.com. Accessed 21 July 2020

  18. Dorigo, M., Maniezzo, V., Colorni, A.: Ant system: optimization by a colony of cooperating agents. IEEE Trans. Syst. Man. Cybern. Part B (Cybern.) 26(1), 29–41 (1996)

    Google Scholar 

  19. Liu, W., Wang, P., Meng, Y., et al.: A novel algorithm for optimizing selection of cloud instance types in Multi-cloud Environment. In 2019 IEEE 25th International Conference on Parallel and Distributed Systems (ICPADS), pp. 167–170. IEEE, NJ (2019)

    Google Scholar 

  20. Liu, W., Wang, P., Meng, Y., et al.: A novel model for optimizing selection of cloud instance types. IEEE Access 7, 120508–120521 (2019)

    Article  Google Scholar 

  21. Wang, P., Zhao, C., Liu, W., et al.: Optimizing data placement for cost effective and high available multi-cloud storage. Comput. Inform. 39(1–2), 51–89 (2020)

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Pengwei Wang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Wang, P., Wei, Y., Zhang, Z. (2021). Optimizing Data Placement in Multi-cloud Environments Considering Data Temperature. In: Sun, X., Zhang, X., Xia, Z., Bertino, E. (eds) Artificial Intelligence and Security. ICAIS 2021. Lecture Notes in Computer Science(), vol 12737. Springer, Cham. https://doi.org/10.1007/978-3-030-78612-0_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-78612-0_14

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-78611-3

  • Online ISBN: 978-3-030-78612-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics