research-article

Designing an Energy-Efficient HPC Supercomputing Center

Authors:

Mike Strevell,

David Lambiaso,

Adam Brendamour,

Tom SquilloAuthors Info & Claims

ICPP Workshops '19: Workshop Proceedings of the 48th International Conference on Parallel Processing

Article No.: 7, Pages 1 - 8

https://doi.org/10.1145/3339186.3339212

Published: 05 August 2019 Publication History

Get Access

Abstract

This paper presents design considerations that drive the development of an energy-efficient, high performance computing (HPC) data center facility. Key electrical and mechanical design considerations will be presented that maximize facility efficiency, both in construction and in ongoing operations. A case study is provided that applies these design decisions to multiple development alternatives for Los Alamos National Laboratory (LANL).

We evaluated alternatives ranging from 20 MW to 80 MW of power and cooling, and compared new buildings to upgrading the existing HPC Super Computer Center.

The four principles guiding the design decisions are flexibility to support future systems, sustainability, lifecycle costs and initial cost.

References

[1]

Thermosyphon Cooler Hybrid System for Water Savings in an Energy-Efficient HPC Data Center, Results from 24 Months and Impact on Water Usage Effectiveness, David Sickinger, et. al., NREL/TP-2C00-72196, September 2018.

Google Scholar

[2]

Guntner Adiabatic Dry Coolers; https://www.guntnerus.com/products/adiabatic/

Google Scholar

[3]

High-Efficiency AC Power Distribution for Data Centers. Revision 2, Schneider White Paper 128, Neil Rasmussen

Google Scholar

[4]

Liquid Cooling Guidelines, Patterson, Michael, https://eehpcwg.llnl.gov/assets/06_patterson_liquid_cooling.pdf

Google Scholar

[5]

Energy Efficient HPC Working Group, Computing Systems, HPC and Grid Integration, https://eehpcwg.llnl.gov/compsys_grid.html

Google Scholar

[6]

National Electric Code (NEC), Figure 310.60

Google Scholar

[7]

Oak Ridge National Laboratory Summit, https://www.olcf.ornl.gov/summit/

Google Scholar

Cited By

View all

Silva CVilaça RPereira ABessa R(2024)A review on the decarbonization of high-performance computing centersRenewable and Sustainable Energy Reviews10.1016/j.rser.2023.114019189(114019)Online publication date: Jan-2024
https://doi.org/10.1016/j.rser.2023.114019
Tanwar SPopat ABhattacharya PGupta RKumar N(2021)A taxonomy of energy optimization techniques for smart cities: Architecture and future directionsExpert Systems10.1111/exsy.1270339:5Online publication date: 22-Apr-2021
https://doi.org/10.1111/exsy.12703
Zhang DPanwar GKotra JDeBardeleben NBlanchard SJian XMartínez JDuato JJohn L(2021)Quantifying server memory frequency margin and using it to improve performance in HPC systemsProceedings of the 48th Annual International Symposium on Computer Architecture10.1109/ISCA52012.2021.00064(748-761)Online publication date: 14-Jun-2021
https://dl.acm.org/doi/10.1109/ISCA52012.2021.00064
Show More Cited By

Recommendations

An Edge Service for Managing HPC Workflows
HUST'17: Proceedings of the Fourth International Workshop on HPC User Support Tools

Large experimental collaborations, such as those at the Large Hadron Collider at CERN, have developed large job management systems running hundreds of thousands of jobs across worldwide computing grids. HPC facilities are becoming more important to ...
Challenges on the road to exascale computing
ICS '08: Proceedings of the 22nd annual international conference on Supercomputing

Supercomputing systems have made great strides in recent years as the extensive computing needs of cutting-edge engineering work and scientific discovery have driven the development of more powerful systems. The first teraflop computer, ASCI Red, came ...
Enabling Workflow-Aware Scheduling on HPC Systems
HPDC '17: Proceedings of the 26th International Symposium on High-Performance Parallel and Distributed Computing

Scientific workflows are increasingly common in the workloads of current High Performance Computing (HPC) systems. However, HPC schedulers do not incorporate workflow-specific mechanisms beyond the capacity to declare dependencies between their jobs. ...

Comments

Information & Contributors

Information

Published In

ICPP Workshops '19: Workshop Proceedings of the 48th International Conference on Parallel Processing

August 2019

241 pages

ISBN:9781450371964

DOI:10.1145/3339186

© 2019 Association for Computing Machinery. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of the United States government. As such, the United States Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

In-Cooperation

University of Tsukuba: University of Tsukuba

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 August 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

ICPP 2019

ICPP 2019: Workshops

August 5 - 8, 2019

Kyoto, Japan

Acceptance Rates

Overall Acceptance Rate 91 of 313 submissions, 29%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
198
Total Downloads

Downloads (Last 12 months)19
Downloads (Last 6 weeks)0

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Silva CVilaça RPereira ABessa R(2024)A review on the decarbonization of high-performance computing centersRenewable and Sustainable Energy Reviews10.1016/j.rser.2023.114019189(114019)Online publication date: Jan-2024
https://doi.org/10.1016/j.rser.2023.114019
Tanwar SPopat ABhattacharya PGupta RKumar N(2021)A taxonomy of energy optimization techniques for smart cities: Architecture and future directionsExpert Systems10.1111/exsy.1270339:5Online publication date: 22-Apr-2021
https://doi.org/10.1111/exsy.12703
Zhang DPanwar GKotra JDeBardeleben NBlanchard SJian XMartínez JDuato JJohn L(2021)Quantifying server memory frequency margin and using it to improve performance in HPC systemsProceedings of the 48th Annual International Symposium on Computer Architecture10.1109/ISCA52012.2021.00064(748-761)Online publication date: 14-Jun-2021
https://dl.acm.org/doi/10.1109/ISCA52012.2021.00064
Terai MShoji FTsukamoto TYamochi Y(2020)A Study of Operational Impact on Power Usage Effectiveness using Facility Metrics and Server Operation Logs in the K Computer2020 IEEE International Conference on Cluster Computing (CLUSTER)10.1109/CLUSTER49012.2020.00072(509-513)Online publication date: Sep-2020
https://doi.org/10.1109/CLUSTER49012.2020.00072

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Recommendations

An Edge Service for Managing HPC Workflows

Challenges on the road to exascale computing

Enabling Workflow-Aware Scheduling on HPC Systems

Comments

Information

Published In

In-Cooperation

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations