ABSTRACT
Supercomputing platforms have developed over the years to maximize performance and scalability and to minimize any abstractions that could result in slowdowns and performance variability. Largescale supercomputing systems traditionally tightly integrate hardware and software stacks, for instance, light weight operating systems, vertically integrated communication layers and tightly coupled parallel file systems. Consequently, these environments do not lend themselves for portability expected for web and ISV applications as well as emerging data science workflows. This poster will present abstractions that are introduced in Piz Daint, a hybrid and heterogeneous Cray XC50 and XC40 platform with Nvidia P100 GPU devices, in order to enable Large Hadron Collider (LHC) computing grid workflows. This transition is completely transparent to the end users and existing workflows for experiments including ATLAS, CMS and LHCb. The technologies and solutions that have been exploited in creating abstractions include containerization, file system virtualization and other configuration changes. Incidentally, these abstractions have proven to be highly effective in leveraging execution of other complex workflows, for instance, Apache Spark, often with performance and productivity gains. Piz Daint hybrid and heterogeneous supercomputing platform has therefore enabled the Swiss National Supercomputing Centre (CSCS) in consolidating a range of services including computing, data analysis and visualization for its diverse and growing user communities.
Index Terms
- Abstractions for supercomputing platforms to facilitate consolidation of services: poster
Recommendations
DEISA--Distributed European Infrastructure for Supercomputing Applications
The paper presents an overview of the current research and achievements of the DEISA project, with a focus on the general concept of the infrastructure, the operational model, application projects and science communities, the DEISA Extreme Computing ...
Hungarian Supercomputing Grid
ICCS '02: Proceedings of the International Conference on Computational Science-Part IIThe main objective of the paper is to describe the main goals and activities within the newly formed Hungarian Supercomputing Grid (H-SuperGrid) which will be used as a high-performance and highthroughput Grid. In order to achieve these two features ...
GPU-accelerated molecular visualization on petascale supercomputing platforms
UltraVis '13: Proceedings of the 8th International Workshop on Ultrascale VisualizationPetascale supercomputers create new opportunities for the study of the structure and function of large biomolecular complexes such as viruses and photosynthetic organelles, permitting all-atom molecular dynamics simulations of tens to hundreds of ...
Comments