skip to main content
10.1145/3558481.3591314acmconferencesArticle/Chapter ViewAbstractPublication PagesspaaConference Proceedingsconference-collections
abstract

Brief Announcement: Dynamic Vector Bin Packing for Online Resource Allocation in the Cloud

Published: 17 June 2023 Publication History

Abstract

Several cloud-based applications, such as cloud gaming, rent servers to execute jobs which arrive in an online fashion. Each job has a resource demand, such as GPU requirement, and must be dispatched to a cloud server which has enough resources to execute the job, which departs after its completion. Under the "pay-as-you-go'' billing model, the server rental cost is proportional to the total time that servers are actively running jobs. The problem of efficiently allocating a sequence of online jobs to servers without exceeding the resource capacity of any server while minimizing total server usage time can be modelled as a variant of the dynamic bin packing problem (DBP), called MinUsageTime DBP [10].
In this work, we initiate the study of the problem with multi-dimensional resource demands (e.g. CPU/GPU usage, memory requirement, bandwidth usage, etc.), called MinUsageTime Dynamic Vector Bin Packing (DVBP). We study the competitive ratio (CR) of Any Fit packing algorithms for this problem. We show almost-tight bounds on the CR of three specific Any Fit packing algorithms, namely First Fit, Next Fit, and Move To Front. We prove that the CR of Move To Front is at most (2 μ + + 1)d + 1, where μ is the ratio of the max/min item durations. For d=1, this implies a significant improvement over the previously known upper bound of 6 μ + 7 [8]. We then prove the CR of First Fit and Next Fit are bounded by (μ + 2)d + 1 and 2 μ d + 1, respectively. Next, we prove a lower bound of (μ + 1)d on the CR of any Any Fit packing algorithm, an improved lower bound of 2 μ d for Next Fit, and a lower bound of 2 & #956; for Move To Front in the 1-D case. All our bounds improve or match the best-known bounds for the 1-D case. Finally, we experimentally study the average-case performance of these algorithms on randomly generated synthetic data, and observe that Move To Front outperforms other Any Fit packing algorithms.

References

[1]
Yossi Azar and Danny Vainstein. 2019. Tight Bounds for Clairvoyant Dynamic Bin Packing. ACM Trans. Parallel Comput., Vol. 6, 3, Article 15 (oct 2019), 21 pages. https://doi.org/10.1145/3364214
[2]
Allan Borodin and Ran El-Yaniv. 1998. Online computation and competitive analysis.
[3]
Niv Buchbinder, Yaron Fairstein, Konstantina Mellou, Ishai Menache, and Joseph (Seffi) Naor. 2021. Online Virtual Machine Allocation with Lifetime and Load Predictions. In Abstract Proceedings of the 2021 ACM SIGMETRICS / International Conference on Measurement and Modeling of Computer Systems (Virtual Event, China) (SIGMETRICS '21). Association for Computing Machinery, New York, NY, USA, 9--10. https://doi.org/10.1145/3410220.3456278
[4]
Henrik I. Christensen, Arindam Khan, Sebastian Pokutta, and Prasad Tetali. 2017. Approximation and online algorithms for multidimensional bin packing: A survey. Computer Science Review, Vol. 24 (2017), 63--79. https://doi.org/10.1016/j.cosrev.2016.12.001
[5]
Edward G. Coffman Jr., János Csirik, Gábor Galambos, Silvano Martello, and Daniele Vigo. 2013. Bin Packing Approximation Algorithms: Survey and Classification. Springer New York, New York, NY, 455--531. https://doi.org/10.1007/978-1-4419-7997-1_35
[6]
Gaikai. https://en.wikipedia.org/wiki/Gaikai.
[7]
Ori Hadary, Luke Marshall, Ishai Menache, Abhisek Pan, David Dion, Esaias E Greeff, Star Dorminey, Shailesh Joshi, Yang Chen, Mark Russinovich, and Thomas Moscibroda. 2020. Protean: VM Allocation Service at Scale. In OSDI. USENIX. https://www.microsoft.com/en-us/research/publication/protean-vm-allocation-service-at-scale/
[8]
Shahin Kamali and Alejandro López-Ortiz. 2015. Efficient Online Strategies for Renting Servers in the Cloud. In SOFSEM 2015: Theory and Practice of Computer Science, Giuseppe F. Italiano, Tiziana Margaria-Steffen, Jaroslav Pokorný, Jean-Jacques Quisquater, and Roger Wattenhofer (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 277--288.
[9]
Ragini Karwayun. 2018. A Dynamic Energy efficient Resource Allocation Scheme for Heterogeneous clouds using Bin-Packing Heuristics. Algorithms, Vol. 9 (2018), 15--24.
[10]
Yusen Li, Xueyan Tang, and Wentong Cai. 2014. On Dynamic Bin Packing for Resource Allocation in the Cloud. In Proceedings of the 26th ACM Symposium on Parallelism in Algorithms and Architectures (Prague, Czech Republic) (SPAA '14). Association for Computing Machinery, New York, NY, USA, 2--11. https://doi.org/10.1145/2612669.2612675
[11]
Yusen Li, Xueyan Tang, and Wentong Cai. 2016. Dynamic Bin Packing for On-Demand Cloud Resource Allocation. IEEE Transactions on Parallel and Distributed Systems, Vol. 27, 1 (2016), 157--170. https://doi.org/10.1109/TPDS.2015.2393868
[12]
Minghong Lin, Adam Wierman, Lachlan L. H. Andrew, and Eno Thereska. 2013. Dynamic Right-Sizing for Power-Proportional Data Centers. IEEE/ACM Transactions on Networking, Vol. 21, 5 (2013), 1378--1391. https://doi.org/10.1109/TNET.2012.2226216
[13]
Aniket Murhekar, David Arbour, Tung Mai, and Anup Rao. 2023. Dynamic Vector Bin Packing for Online Resource Allocation in the Cloud. arxiv: 2304.08648 [cs.DS]
[14]
OnLive. https://en.wikipedia.org/wiki/OnLive.
[15]
Rina Panigrahy, Kunal Talwar, Lincoln Uyeda, and Udi Wieder. 2011. Heuristics for Vector Bin Packing. (January 2011). https://www.microsoft.com/en-us/research/publication/heuristics-for-vector-bin-packing/
[16]
Amazon EC2 Pricing. Accessed 2022-01-08. https://aws.amazon.com/ec2/pricing/
[17]
Runtian Ren and Xueyan Tang. 2016. Clairvoyant Dynamic Bin Packing for Job Scheduling with Minimum Server Usage Time. In Proceedings of the 28th ACM Symposium on Parallelism in Algorithms and Architectures (Pacific Grove, California, USA) (SPAA '16). Association for Computing Machinery, New York, NY, USA, 227--237. https://doi.org/10.1145/2935764.2935775
[18]
Runtian Ren, Xueyan Tang, Yusen Li, and Wentong Cai. 2017. Competitiveness of Dynamic Bin Packing for Online Cloud Server Allocation. IEEE/ACM Transactions on Networking, Vol. 25, 3 (2017), 1324--1331. https://doi.org/10.1109/TNET.2016.2630052
[19]
Alexander L. Stolyar and Yuan Zhong. 2013. A Large-Scale Service System with Packing Constraints: Minimizing the Number of Occupied Servers. SIGMETRICS Perform. Eval. Rev., Vol. 41, 1 (jun 2013), 41--52. https://doi.org/10.1145/2494232.2465547
[20]
StreamMyGame. https://en.wikipedia.org/wiki/StreamMyGame.
[21]
Xueyan Tang, Yusen Li, Runtian Ren, and Wentong Cai. 2016. On First Fit Bin Packing for Online Cloud Server Allocation. In 2016 IEEE International Parallel and Distributed Processing Symposium (IPDPS). 323--332. https://doi.org/10.1109/IPDPS.2016.42
[22]
Gerhard J Woeginger. 1997. There is no asymptotic PTAS for two-dimensional vector packing. Inform. Process. Lett., Vol. 64, 6 (1997), 293--297.

Cited By

View all
  • (2025)Renting Servers for Multi-Parameter Jobs in the CloudProceedings of the 26th International Conference on Distributed Computing and Networking10.1145/3700838.3700850(36-45)Online publication date: 4-Jan-2025
  • (2024)Reinforcement Learning-Assisted Genetic Programming Hyper Heuristic Approach to Location-Aware Dynamic Online Application Deployment in CloudsProceedings of the Genetic and Evolutionary Computation Conference10.1145/3638529.3654058(988-997)Online publication date: 14-Jul-2024
  • (2024)An online dynamic dual bin packing with lookahead approach for server-to-cell assignment in computer server industryComputers & Industrial Engineering10.1016/j.cie.2024.110404(110404)Online publication date: Jul-2024
  • Show More Cited By

Index Terms

  1. Brief Announcement: Dynamic Vector Bin Packing for Online Resource Allocation in the Cloud

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      SPAA '23: Proceedings of the 35th ACM Symposium on Parallelism in Algorithms and Architectures
      June 2023
      504 pages
      ISBN:9781450395458
      DOI:10.1145/3558481
      Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 17 June 2023

      Check for updates

      Author Tags

      1. cloud server allocation
      2. competitive ratio
      3. dynamic bin packing
      4. multi-dimensional resources
      5. online algorithms

      Qualifiers

      • Abstract

      Conference

      SPAA '23
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 447 of 1,461 submissions, 31%

      Upcoming Conference

      SPAA '25
      37th ACM Symposium on Parallelism in Algorithms and Architectures
      July 28 - August 1, 2025
      Portland , OR , USA

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)43
      • Downloads (Last 6 weeks)2
      Reflects downloads up to 05 Mar 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2025)Renting Servers for Multi-Parameter Jobs in the CloudProceedings of the 26th International Conference on Distributed Computing and Networking10.1145/3700838.3700850(36-45)Online publication date: 4-Jan-2025
      • (2024)Reinforcement Learning-Assisted Genetic Programming Hyper Heuristic Approach to Location-Aware Dynamic Online Application Deployment in CloudsProceedings of the Genetic and Evolutionary Computation Conference10.1145/3638529.3654058(988-997)Online publication date: 14-Jul-2024
      • (2024)An online dynamic dual bin packing with lookahead approach for server-to-cell assignment in computer server industryComputers & Industrial Engineering10.1016/j.cie.2024.110404(110404)Online publication date: Jul-2024
      • (2023)Multicriteria Task Distribution Problem for Resource-Saving Data ProcessingParallel Computing Technologies10.1007/978-3-031-41673-6_13(166-176)Online publication date: 21-Aug-2023

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media