Skip to main content
Springer Nature Link
Log in

Distributed resource allocation in federated clouds

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

Cloud computing is an emerging technology which relies on virtualization techniques to achieve the elasticity of shared resources for providing on-demand services. When the service demand increases, more resources are required to satisfy the service demand. Single cloud generally cannot provide unlimited services with limited physical resources; therefore, the federation of multiple clouds may be one possible solution. In such environment, different cloud providers may own different pricing and resource allocating strategies. Thus, how to select the most appropriate provider to host applications becomes an important issue for clients. However, as the requests of accessing distributed resources increase, the occurrences of competing the same resource may also increase. In this study, a Distributed Resource Allocation (DRA) approach is proposed to solve resource competition in the federated cloud environment. Each job is supposed to consist of one or more tasks, and the communication behavior between tasks could be profiled. The proposed approach groups tasks according to communication behavior to minimize communication overhead, and tries to allocate grouped tasks to achieve equilibrium when resource competition occurs. Experimental results show that the cloud provider could obtain more profits by outsourcing resources in the federated cloud with enough resources.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Ghodsi A, Zaharia M, Hindman B, Konwinski A, Shenker S, Stoica I (2011) Dominant resource fairness: fair allocation of multiple resource types. In: Proceedings of the 8th USENIX Conference on Networked Systems Design and Implementation (NSDI’11). Berkeley, CA, pp 323–336

  2. Parkes DC, Procaccia AD, Shah N (2015) Beyond dominant resource fairness: extensions, limitations, and indivisibilities. ACM Trans Econ Comput 3(1):3 (Article No. 3)

  3. Erdil DC (2013) Autonomic cloud resource sharing for intercloud federations. Future Gen Comput Syst 29(7):1700–1708

    Article  Google Scholar 

  4. Ye D, Chen J (2013) Non-cooperative games on multidimensional resource allocation. Future Gen Comput Syst 29(6):1345–1352

    Article  MathSciNet  Google Scholar 

  5. Li D, Chen C, Guan J, Zhang Y, Zhu J, Ruozhou Y (2016) DCloud: Deadline-Aware Resource Allocation for Cloud Computing Jobs. IEEE Trans Parallel Distrib Syst 27(8):2248–2260

    Article  Google Scholar 

  6. Google data center. https://www.google.com/about/datacenters/inside/locations/index.html

  7. Han Z, Chu R, Mi H, Wang H (2014) Elastic Allocator: An Adaptive Task Scheduler for Streaming Query in the Cloud. In: Proceedings of IEEE 8th International Symposium on Service Oriented System Engineering, pp 284–289

  8. Hussain H et al (2013) A survey on resource allocation in high performance distributed computing systems. Parallel Comput 39(11):709–736

    Article  MathSciNet  Google Scholar 

  9. Lucas-Simarro JL, Moreno-Vozmediano R, Montero RS, Llorente IM (2013) Scheduling strategies for optimal service deployment across multiple clouds. Future Gen Comput Syst 29(6):1431–1441

    Article  Google Scholar 

  10. Hassan M, Song B, Huh EN (2011) Game-based distributed resource allocation in horizontal dynamic cloud federation platform. In: Xiang Y, Cuzzocrea A, Hobbs M, Zhou W (eds) Algorithms and Architectures for Parallel Processing, vol 7016., Lecture Notes in Computer ScienceSpringer, New York, pp 194–205

    Chapter  Google Scholar 

  11. Malik S, Huet F, Caromel D (2012) Latency based Dynamic Grouping aware Cloud Scheduling. In: Proceedings of 26th International Conference on Advanced Information Networking and Applications Workshops, pp 1190–1195

  12. Maui. http://docs.adaptivecomputing.com/maui/

  13. Mell P, Grance T (2011) The NIST Definition of Cloud Computing. NIST Special Publication, USA, pp 800–145

    Google Scholar 

  14. Wooldridge M (2012) Does Game Theory Work? IEEE Intell Syst 27:76–80

    Article  Google Scholar 

  15. Moreno-Vozmediano R, Montero RS, Llorente IM (2012) IaaS Cloud Architecture: From Virtualized Datacenters to Federated Cloud Infrastructures. IEEE Comput 45(12):65–72

    Article  Google Scholar 

  16. Murugesan S (2013) Cloud computing: the new normal? IEEE Comput 46(1):77–79

    Article  Google Scholar 

  17. Palmieri F, Buonanno L, Venticinque S, Aversa R, Martino BD (2013) A distributed scheduling framework based on selfish autonomous agents for federated cloud environments. Future Gen Comput Syst 29(6):1461–1472

    Article  Google Scholar 

  18. Trent Robert J, Monczka Robert M (2003) Cost-driven pricing: an innovative approach for managing supply chain costs. Supply Chain Forum 4(1):2–10

    Google Scholar 

  19. Calheiros RN, Toosi AN, Vecchiola C, Buyya R (2012) A Coordinator for Scaling Elastic Applications across Multiple Clouds. Future Gen Comput Syst 28(8):1350–1362

    Article  Google Scholar 

  20. Sedaghat M, Hernandez-Rodriguez F, Elmroth E (2013) A virtual machine re-packing approach to the horizontal vs. vertical elasticity trade-off for cloud autoscaling. In: Proceedings of the 2013 ACM Cloud and Autonomic Computing (Article No. 6)

  21. Liu S, Ren K, Deng K, Song J (2016) A dynamic resource allocation and task scheduling strategy with uncertain task runtime on IaaS clouds. In: Sixth International Conference on Information Science and Technology (ICIST)

  22. Malik S, Huet F, Caromel D (2012) Latency based Dynamic Grouping aware Cloud Scheduling. In: 26th International Conference on Advanced Information Networking and Applications Workshops, pp 1190–1195

  23. Shie MR, Liu CY, Lee YF, Lin YC, Lai KC (2014) Distributed Scheduling Approach Based on Game Theory in the Federated Cloud. In: IEEE Proceedings of 2014 International Conference on Information Science & Applications (ICISA), pp 1–4

  24. Lan T, Kao D, Chiang M, Sabharwal A (2010) An axiomatic theory of fairness in network resource allocation. In: Proceedings of the Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE INFOCOM ’10), pp 1–9

  25. Wei X, Li H, Yang K, Zou L (2014) Topology-aware Partial Virtual Cluster Mapping Algorithm on Shared Distributed Infrastructures. IEEE Trans Parallel Distrib Syst 25(10):2721–2730

    Article  Google Scholar 

  26. Chung WC, Shih PC, Lai KC, Li KC, Lee CR, Chou J, Hsu CH, Chung YC (2014) Taiwan UniCloud: A Cloud Testbed with Collaborative Cloud Services. In: IEEE International Conference on Cloud Engineering (IC2E). Boston

  27. Mao Z, Yang J, Shang Y, Liu C, Chen J (2013) A game theory of cloud service deployment. In: IEEE World Congress on Services (SERVICES), pp 436–443

Download references

Acknowledgements

This study was sponsored by the Ministry of Science and Technology, Taiwan, R.O.C., under contract numbers: MOST 103-2218-E-007-021 and MOST 103-2221-E-142-001-MY3.

Author information

Authors and Affiliations

  1. Department of Computer Science, National Taichung University of Education, Taichung, Taiwan, ROC

    Yi-Hsuan Lee, Kuo-Chan Huang, Meng-Ru Shieh & Kuan-Chou Lai

Authors
  1. Yi-Hsuan Lee
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Kuo-Chan Huang
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Meng-Ru Shieh
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Kuan-Chou Lai
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Kuan-Chou Lai.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lee, YH., Huang, KC., Shieh, MR. et al. Distributed resource allocation in federated clouds. J Supercomput 73, 3196–3211 (2017). https://doi.org/10.1007/s11227-016-1918-1

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-016-1918-1

Keywords