Understanding Energy Performance of Containers Deployment on HPC-Based post-Moore Platforms
Authors: 
Pablo Josue Rojas Yepes, 
Carlos Jaime Barrios Hernandez, Luiz Angelo SteffenelAuthors Info & Claims
Pablo Josue Rojas Yepes, Carlos Jaime Barrios Hernandez, Luiz Angelo SteffenelAuthors Info & ClaimsPages 147 - 154
Abstract
HPC platforms seek to ensure peak computing performance with minimal energy cost searching sustainability. Considering different cases of use and implementation, both post-Moore hardware elements and software deployment (as virtualization or containerization) are incorporated. However, as the number of devices proliferates, managing applications has become intricate, prompting the adoption of containerization methods for simplification. Then, understanding the performance of the deployment strategy to propose an adequate implementation and integration of HPC-based post-Moore architectures is important to guarantee efficiency. This study evaluates the containerization strategies on a cost-effective post-Moore device suitable for an HPC platform. Factors like ease of use, reproducibility, and compatibility examine the deployment methods. The evaluation process employs metrics establishment and stress tests to appraise application-specific aspects. The obtained insights are categorized to address deployment mechanisms, performance implications, execution duration, and energy consumption impacts.
Supplemental Material
MP4 File
Recording of "Understanding Energy Performance of Containers Deployment on HPC-Based post-Moore Platforms" presentation at CANOPIE-HPC 2023.
- Download
- 97.29 MB
References
[1]
F. Altschuler and J. Gallmeier. 2023. Heterogeneous system architecture: Multicore image processing using a mix of CPU and GPU elements. Retrieved August 10, 2023 from https://www.embeddedcomputing.com/application/misc/heterogeneous-system-architecture-multicore-image-processing-using-a-mix-of-cpu-and-gpu-elements
[2]
K.J. Barker, A. Benner, R. Hoare, A. Hoisie, A.K. Jones, D.K. Kerbyson, D. Li, R. Melhem, R. Rajamony, E. Schenfeld, S. Shao, C. Stunkel, and P. Walker. 2005. On the Feasibility of Optical Circuit Switching for High Performance Computing Systems. In SC ’05: Proceedings of the 2005 ACM/IEEE Conference on Supercomputing. 16–16. https://doi.org/10.1109/SC.2005.48
[3]
Chih-Ying Chen, Nan-Ching Yeh, Yao-Chung Chuang, and Chuan-Yao Lin. 2022. Development of a Low-Cost Portable Cluster for Numerical Weather Prediction. Electronics 11, 17 (2022). https://doi.org/10.3390/electronics11172769
[4]
Y. Inadomi, T. Patki, K. Inoue, M. Aoyagi, B. Rountree, M. Schulz, D. Lowenthal, Y. Wada, K. Fukazawa, M. Ueda, M. Kondo, and I. Miyoshi. 2015. Analyzing and mitigating the impact of manufacturing variability in power-constrained supercomputing. In SC ’15: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis. 1–12. https://doi.org/10.1145/2807591.2807638
[5]
Docker Inc. 2023. Docker. Retrieved August 10, 2023 from https://www.docker.com
[6]
Khronos® Group Inc. 2023. OpenCL. Retrieved January 31, 2023 from https://www.khronos.org/opencl/
[7]
Sylabs™ Inc. 2023. SingularityCE. Retrieved August 10, 2023 from https://sylabs.io/singularity/
[8]
Nicholas James, Lee-Yeng Ong, and Meng-Chew Leow. 2022. Exploring Distributed Deep Learning Inference Using Raspberry Pi Spark Cluster. Future Internet 14, 8 (2022). https://doi.org/10.3390/fi14080220
[9]
Javier Garcia-Blas Jesus Carretero and Raimondas Ciegis. 2016. Introduction to sustainable ultrascale computing systems and applications. Journal of Supercomputing 72 (2016), 4043––4046. https://doi.org/10.1007/s11227-016-1822-8
[10]
T. Kagami, H. Matsutani, M. Koibuchi, Y. Take, T. Kuroda, and H. Amano. 2016. Efficient 3-D Bus Architectures for Inductive-Coupling ThruChip Interfaces. IEEE Transactions on Very Large Scale Integration (VLSI) Systems 24, 2 (2016), 493–506. https://doi.org/10.1109/TVLSI.2015.2418216
[11]
Pilsung Kang and Sungmin Lim. 2020. A Taste of Scientific Computing on the GPU-Accelerated Edge Device. IEEE Access 8 (01 2020), 208337–208347. https://doi.org/10.1109/ACCESS.2020.3038714
[12]
C. King and A. Waterland. 2018. Ubuntu Manuals, Stress-ng. Retrieved February 10, 2021 from http://manpages.ubuntu.com/manpages/bionic/man1/stress-ng.1.html
[13]
Ákos Kovács. 2017. Comparison of different Linux containers. In 2017 40th International Conference on Telecommunications and Signal Processing (TSP). 47–51. https://doi.org/10.1109/TSP.2017.8075934
[14]
Andy Kuszyk and Mohammad Hammoudeh. 2018. Contemporary Alternatives to Traditional Processor Design in the Post Moore’s Law Era(ICFNDS ’18). Association for Computing Machinery, New York, NY, USA, Article 46, 5 pages. https://doi.org/10.1145/3231053.3231099
[15]
A. Madonna L. Benedicic, F. A. Cruz and K. Mariotti. 2017. Portable, high-performance containers for HPC. Distributed, Parallel, and Cluster Computing (cs.DC) (2017).
[16]
Satoshi Matsuoka. 2018. Cambrian Explosion of Computing and Big Data in the Post-Moore Era(HPDC ’18). Association for Computing Machinery, New York, NY, USA, 105. https://doi.org/10.1145/3208040.3225055
[17]
Satoshi Matsuoka, Hideharu Amano, Kengo Nakajima, Koji Inoue, Tomohiro Kudoh, Naoya Maruyama, Kenjiro Taura, Takeshi Iwashita, Takahiro Katagiri, Toshihiro Hanawa, and Toshio Endo. 2016. From FLOPS to BYTES: Disruptive Change in High-Performance Computing towards the Post-Moore Era. In Proceedings of the ACM International Conference on Computing Frontiers (Como, Italy) (CF ’16). Association for Computing Machinery, New York, NY, USA, 274–281. https://doi.org/10.1145/2903150.2906830
[18]
Nvidia. 2023. CUDA Toolkit Documentation 12.2. Retrieved July 31, 2023 from https://docs.nvidia.com/cuda/
[19]
Vitaly Petrov, Dmitri Moltchanov, Maria Komar, Alexander Antonov, Pavel Kustarev, Shaloo Rakheja, and Yevgeni Koucheryavy. 2017. Terahertz Band Intra-Chip Communications: Can Wireless Links Scale Modern x86 CPUs?IEEE Access 5 (2017), 6095–6109. https://doi.org/10.1109/ACCESS.2017.2689077
[20]
C. Ruiz, E. Jeanvoine, and L. Nussbaum. 2015. Performance Evaluation of Containers for HPC. In Euro-Par 2015: Parallel Processing Workshops. Springer International Publishing, Cham, 813–824.
[21]
Sogand Shirinbab, Lars Lundberg, and Emiliano Casalicchio. 2020. Performance evaluation of containers and virtual machines when running Cassandra workload concurrently. Concurrency and Computation: Practice and Experience 32, 17 (2020), e5693. https://doi.org/10.1002/cpe.5693
[22]
W. Silva-de Souza, A. Iranfar, A. Bráulio, M. Zapater, S. Xavier-de Souza, K. Olcoz, and D. Atienza. 2020. Containergy—A Container-Based Energy and Performance Profiling Tool for Next Generation Workloads. Energies 13, 9 (2020). https://doi.org/10.3390/en13092162
[23]
Yasuhiro Take, Hiroki Matsutani, Daisuke Sasaki, Michihiro Koibuchi, Tadahiro Kuroda, and Hideharu Amano. 2014. 3D NoC with Inductive-Coupling Links for Building-Block SiPs. IEEE Trans. Comput. 63, 3 (2014), 748–763. https://doi.org/10.1109/TC.2012.249
[24]
Jeffrey S. Vetter, Erik P. DeBenedictis, and Thomas M. Conte. 2017. Architectures for the Post-Moore Era. IEEE Micro 37, 4 (2017), 6–8. https://doi.org/10.1109/MM.2017.3211127
[25]
VTA. 2021. VTA-84630, User Manual. Retrieved February 15, 2021 from https://www.manualslib.es/manual/346126/Vta-84630.html
[26]
Andrew J. Younge, Kevin Pedretti, Ryan E. Grant, and Ron Brightwell. 2017. A Tale of Two Systems: Using Containers to Deploy HPC Applications on Supercomputers and Clouds. In 2017 IEEE International Conference on Cloud Computing Technology and Science (CloudCom). 74–81. https://doi.org/10.1109/CloudCom.2017.40
Index Terms
- Understanding Energy Performance of Containers Deployment on HPC-Based post-Moore Platforms
Index terms have been assigned to the content through auto-classification.
Recommendations
Survey of adaptive containerization architectures for HPC
SC-W '23: Proceedings of the SC '23 Workshops of the International Conference on High Performance Computing, Network, Storage, and AnalysisContainers offer an array of advantages that benefit research reproducibility and portability. As container tools mature, container security improves, and high-performance computing (HPC) and cloud system tools converge, supercomputing centers are ...
Energy consumption comparison between macro-micro and public femto deployment in a plausible LTE network
e-Energy '11: Proceedings of the 2nd International Conference on Energy-Efficient Computing and NetworkingWe study the energy consumptions of two strategies that increase the capacity of an LTE network: (1) the deployment of redundant macro and micro base stations by the operator at locations where the traffic is high, and (2) the deployment of publicly ...
Containers in HPC: a survey
AbstractOS-level virtualization (containers) has become a popular alternative to hypervisor-based virtualization. From a system-administration point-of-view, containers enable support for user-defined software stacks, thus freeing users of restrictions ...
Comments
Information & Contributors
Information
Published In
November 2023
2180 pages
ISBN:9798400707858
DOI:10.1145/3624062
Copyright © 2023 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 12 November 2023
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
SC-W 2023
SC-W 2023: Workshops of The International Conference on High Performance Computing, Network, Storage, and Analysis
November 12 - 17, 2023
CO, Denver, USA
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 50Total Downloads
- Downloads (Last 12 months)29
- Downloads (Last 6 weeks)2
Reflects downloads up to 07 Mar 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format