skip to main content
10.1145/2896377.2901481acmconferencesArticle/Chapter ViewAbstractPublication PagesmetricsConference Proceedingsconference-collections
poster

Freestyle Dancing: Randomized Algorithms for Dynamic Storage Load-Balancing

Published: 14 June 2016 Publication History

Abstract

In this work, we study a challenging research problem that arises in minimizing the cost of storing customer data online for reliable accesses in a cloud. It is how to near-perfectly balance the remaining capacities of all disks across the cloud system while adding new file blocks so that the inevitable event of capacity expansion can be postponed as much as possible. The challenges of solving this problem are twofold. First, new file blocks are added to the cloud concurrently by many dispatchers (computing servers) that have no communication or coordination among themselves. Though each dispatcher is updated with information on disk occupancies, the update is infrequent and not synchronized. Second, for fault-tolerance purposes, a combinatorial constraint has to be satisfied in distributing the blocks of each new file across the cloud system. We propose a randomized algorithm, in which each dispatcher independently samples a blocks-to-disks assignment according to a probability distribution on a set of assignments conforming to the aforementioned combinatorial requirement. We show that this algorithm allows a cloud system to near-perfectly balance the remaining disk capacities as rapidly as theoretically possible, when starting from any unbalanced state that is correctable mathematically.

References

[1]
Birkhoff, D. Tres observaciones sobre el algebra lineal. Universidad Nacional de Tucuman Revista, Serie A 5 (1946), 147--151.
[2]
Chang, C.-S., Chen, W.-J., and Huang, H.-Y. Birkhoff-von neumann input buffered crossbar switches. In INFOCOM 2000. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies. Proceedings. IEEE (Mar 2000), vol. 3, pp. 1614--1623 vol.3.
[3]
Goel, A., Kapralov, M., and Khanna, S. Perfect matchings in O(nłog n) time in regular bipartite graphs. CoRR abs/0909.3346 (2009).
[4]
Huang, C., Simitci, H., Xu, Y., Ogus, A., Calder, B., Gopalan, P., Li, J., and Yekhanin, S. Erasure coding in windows azure storage. In Presented as part of the 2012 USENIX Annual Technical Conference (USENIX ATC 12) (Boston, MA, 2012), USENIX, pp. 15--26.
[5]
Mendelsohn, N. S., and Dulmage, A. L. The convex hull of sub-permutation matrices. Proceedings of the American Mathematical Society 9 (1958), 253--254.
[6]
Microsoft Azure Storage Team. Introducing zone redundant storage. bit.ly/1LFsA44, 2014.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGMETRICS '16: Proceedings of the 2016 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Science
June 2016
434 pages
ISBN:9781450342667
DOI:10.1145/2896377
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 June 2016

Check for updates

Author Tags

  1. birkhoff decomposition
  2. capacity distribution
  3. load balance
  4. load distribution

Qualifiers

  • Poster

Funding Sources

  • National Science Foundation

Conference

SIGMETRICS '16
Sponsor:

Acceptance Rates

SIGMETRICS '16 Paper Acceptance Rate 28 of 208 submissions, 13%;
Overall Acceptance Rate 459 of 2,691 submissions, 17%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 192
    Total Downloads
  • Downloads (Last 12 months)7
  • Downloads (Last 6 weeks)0
Reflects downloads up to 17 Jan 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media