Backfilling HPC Jobs with a Multimodal-Aware Predictor.

Lamar, Kenneth; Goponenko, Alexander; Peterson, Christina; Allan, Benjamin; Brandt, James; Dechev, Dechev

doi:10.1109/Cluster48925.2021.00093

Title: Backfilling HPC Jobs with a Multimodal-Aware Predictor.

Conference · Thu Jul 01 00:00:00 EDT 2021

DOI:https://doi.org/10.1109/Cluster48925.2021.00093· OSTI ID:1889001

Lamar, Kenneth; Goponenko, Alexander; Peterson, Christina; Allan, Benjamin; Brandt, James; Dechev, Dechev

Abstract not provided.

View Conference

Cite

Export

Save

Research Organization:: Sandia National Lab. (SNL-NM), Albuquerque, NM (United States); Sandia National Laboratories, SNL California

Sponsoring Organization:: USDOE National Nuclear Security Administration (NNSA), Office of Defense Nuclear Nonproliferation

DOE Contract Number:: NA0003525

OSTI ID:: 1889001

Report Number(s):: SAND2021-9246C; 699977

Resource Relation:: Conference: Proposed for presentation at the Workshop on Monitoring and Analysis for HPC Systems Plus Applications (HPCMASPA) in , .

Country of Publication:: United States

Language:: English

References (14)

Technical Note—Minimizing Average Flow Time with Parallel Machines Horn, W. A. Operations Research, Vol. 21, Issue 3 https://doi.org/10.1287/opre.21.3.846	journal	June 1973
Utilization, predictability, workloads, and user runtime estimates in scheduling the IBM SP2 with backfilling Mu'alem, A. W.; Feitelson, D. G. IEEE Transactions on Parallel and Distributed Systems, Vol. 12, Issue 6 https://doi.org/10.1109/71.932708	journal	June 2001
Backfilling Using System-Generated Predictions Rather than User Runtime Estimates Tsafrir, Dan; Etsion, Yoav; Feitelson, Dror G. IEEE Transactions on Parallel and Distributed Systems, Vol. 18, Issue 6 https://doi.org/10.1109/TPDS.2007.70606	journal	June 2007
Analyzing and adjusting user runtime estimates to improve job scheduling on the Blue Gene/P Tang, Wei; Desai, Narayan; Buettner, Daniel 2010 IEEE International Symposium on Parallel & Distributed Processing (IPDPS) https://doi.org/10.1109/IPDPS.2010.5470474	conference	January 2010
Estimating job runtime for CMS analysis jobs Sfiligoi, I. Journal of Physics: Conference Series, Vol. 513, Issue 3 https://doi.org/10.1088/1742-6596/513/3/032087	journal	June 2014
Improving HPC System Performance by Predicting Job Resources via Supervised Machine Learning Tanash, Mohammed; Dunn, Brandon; Andresen, Daniel Proceedings of the Practice and Experience in Advanced Research Computing on Rise of the Machines (learning) https://doi.org/10.1145/3332186.3333041	conference	July 2019
A Novel Two-Step Job Runtime Estimation Method Based on Input Parameters in HPC System Wang, Qiqi; Li, Jing; Wang, Shuo 2019 IEEE 4th International Conference on Cloud Computing and Big Data Analysis (ICCCBDA) https://doi.org/10.1109/ICCCBDA.2019.8725643	conference	April 2019
Runtime prediction of parallel applications with workload-aware clustering Park, Ju-Won; Kim, Eunhye The Journal of Supercomputing, Vol. 73, Issue 11 https://doi.org/10.1007/s11227-017-2038-2	journal	April 2017
Improving backfilling by using machine learning to predict running times Gaussier, Eric; Glesser, David; Reis, Valentin Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis on - SC '15 https://doi.org/10.1145/2807591.2807646	conference	January 2015
Experience with using the Parallel Workloads Archive Feitelson, Dror G.; Tsafrir, Dan; Krakov, David Journal of Parallel and Distributed Computing, Vol. 74, Issue 10 https://doi.org/10.1016/j.jpdc.2014.06.013	journal	October 2014
Trade-Off Between Prediction Accuracy and Underestimation Rate in Job Runtime Estimates Fan, Yuping; Rich, Paul; Allcock, William E. 2017 IEEE International Conference on Cluster Computing (CLUSTER) https://doi.org/10.1109/CLUSTER.2017.11	conference	September 2017
Predicting application run times with historical information Smith, Warren; Foster, Ian; Taylor, Valerie Journal of Parallel and Distributed Computing, Vol. 64, Issue 9 https://doi.org/10.1016/j.jpdc.2004.06.008	journal	September 2004
On the Use of Machine Learning to Predict the Time and Resources Consumed by Applications Matsunaga, Andréa; Fortes, José A. B. 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing https://doi.org/10.1109/CCGRID.2010.98	conference	May 2010
Job fairness in non-preemptive job scheduling Sabin, G.; Kochhar, G.; Sadayappan, P. International Conference on Parallel Processing, 2004. ICPP 2004. https://doi.org/10.1109/ICPP.2004.1327920	conference	January 2004

Similar Records

Lessons From Examining Repetitive Job Behavior and I/O Performance Variability on a Production HPC System Emily Costa Northeastern University, USA Tirthak Patel Northeastern University, USA Benjamin Schwaller.

Conference · Sun Aug 01 00:00:00 EDT 2021 · OSTI ID:1889001

Costa, Emily; Patel, Tirthak; Schwaller, Benjamin; +2 more

Metrics for Packing Efficiency and Fairness of HPC Cluster Batch Job Scheduling .

Conference · Sat Oct 01 00:00:00 EDT 2022 · OSTI ID:1889001

Goponenko, Alexander; Lamar, Kenneth; Peterson, Christina; +3 more

Metrics for Packing Efficiency and Fairness of HPC Cluster Batch Job Scheduling.

Conference · Thu Sep 01 00:00:00 EDT 2022 · OSTI ID:1889001

Goponenko, Alexander V.; Lamar, Kenneth; Peterson, Christina; +3 more

Title: Backfilling HPC Jobs with a Multimodal-Aware Predictor.

Citation Formats

References (14)

Similar Records

Related Subjects