Loading web-font TeX/Math/Italic
Semi-Distributed Coflow Scheduling in Datacenters | IEEE Journals & Magazine | IEEE Xplore

Abstract:

With the advent of big data applications, coflow scheduling has become a cornerstone for the engineering of traffic in datacenters. Minimizing the average weighted Coflow...Show More

Abstract:

With the advent of big data applications, coflow scheduling has become a cornerstone for the engineering of traffic in datacenters. Minimizing the average weighted Coflow Completion Times (CCT) is a crucial step to minimize the execution time of jobs running in distributed computing frameworks. In this paper, we present a new \sigma -order coflow scheduling solution, ONE-PARIS, an online semi-clairvoyant and semi-distributed implementation suitable to minimize the weighted CCT in production environments. We achieves this through ONE-PARIS scheduler for ordering coflows and a decentralized resource allocation mechanism, called Sync-Rate, enabling to respect the order of priority of coflows provided by ONE-PARIS and ensuring efficient synchronization between flows of the same coflow in order to free up bandwidth for low-priority flows. Extensive simulations on both synthetic and real traffics show that our proposed coflow scheduler outperforms other state-of-art schemes.
Published in: IEEE Transactions on Network and Service Management ( Volume: 21, Issue: 4, August 2024)
Page(s): 4268 - 4281
Date of Publication: 02 May 2024

ISSN Information:


Contact IEEE to Subscribe

References

References is not available for this document.