ABSTRACT
Organizational clusters are often shared among users who compete over resources, but the organization's goal is to increase the overall utility gathered from the cluster. That is, to maximize the aggregate benefit drawn from the cluster. To overcome this problem, we enhanced SLURM with an auctioning system. We evaluated our work on several real cluster traces. Our auctioning scheduler reduces the weight of the queued jobs by 3X-33X compared with backfilling.
- Dror G Feitelson, Dan Tsafrir, and David Krakov. 2014. Experience with using the parallel workloads archive. J. Parallel and Distrib. Comput. 74, 10 (2014), 2967--2982.Google ScholarCross Ref
- Andy B Yoo, Morris A Jette, and Mark Grondona. 2003. Slurm: Simple linux utility for resource management. In Workshop on Job Scheduling Strategies for Parallel Processing. Springer, 44--60.Google ScholarCross Ref
Index Terms
- Auctioning cluster resources
Recommendations
Auctioning Cluster Resources
HPDC '22: Proceedings of the 31st International Symposium on High-Performance Parallel and Distributed ComputingOrganizational clusters are often shared among users who compete over resources, but the organization's goal is to increase the overall utility produced by the cluster. That is, to increase the aggregate benefit drawn from the cluster. To overcome this ...
An auctioning reputation system based on anomaly
CCS '05: Proceedings of the 12th ACM conference on Computer and communications securityExisting reputation systems used by online auction houses do not address the concern of a buyer shopping for commodities - finding a good bargain. These systems do not provide information on the practices adopted by sellers to ensure profitable ...
Integer programming based heterogeneous CPU-GPU cluster schedulers for SLURM resource manager
We present two integer programming based heterogeneous CPU-GPU cluster schedulers, called IPSCHED and AUCSCHED, for the widely used SLURM resource manager. Our scheduler algorithms take windows of jobs and solve allocation problems in which free CPU ...
Comments