Article

The BlueGene/L supercomputer and quantum ChromoDynamics

Authors:

James C. SextonAuthors Info & Claims

SC '06: Proceedings of the 2006 ACM/IEEE conference on Supercomputing

Pages 50 - es

https://doi.org/10.1145/1188455.1188507

Published: 11 November 2006 Publication History

Get Access

Abstract

We describe our methods for performing quantum chromodynamics (QCD) simulations that sustain up to 20% of the peak performance on BlueGene supercomputers. We present our methods, scaling properties, and first cutting edge results relevant to QCD. We show how this enables unprecedented computational scale that brings lattice QCD to the next generation of calculations. We present our QCD simulation that achieved 12.2 Teraflops sustained performance with perfect speedup to 32K CPU cores. Among other things, these calculations are critical for cosmology, for the heavy ion experiments at RHIC-BNL, and for the upcoming experiments at CERN-Geneva. Furthermore, we demonstrate how QCD dramatically exposes memory and network latencies inherent in any computer system and propose that QCD should be used as a new, powerful HPC benchmark. Our sustained performance demonstrates the excellent properties of the BlueGene/L system.

References

[1]

IBM Journal of R&D 2005. Vol 49, Number 2/3, March/May 2005.

Google Scholar

[2]

CreutzM. 1986. Quarks Gluons and lattices, Cambridge Monographs in Mathematical Physics.

Google Scholar

[3]

Monvay I. and Munster G. 1993. Quantum Fields on a Lattice, Cambridge Monographs in Mathematical Physics.

Google Scholar

[4]

The Columbia Physics System. http://www.epcc.ed.ac.uk/~ukqcd/cps/

Google Scholar

[5]

Nielsen H. B., Ninomiya M. 1981. The no-go theorem for chiral lattice fermions. Nucl. Phys. B185, 20.

Crossref

Google Scholar

[6]

Wilson K. G. 1975. New Phenomena in Subnuclear Physics. ed. A Zichichi (Plenum Press, New York), Part A, 69.

Google Scholar

[7]

Kogut J., Susskind L. 1975. Staggered lattice fermions. Phys. Rev. D11, 395.

Google Scholar

[8]

Kaplan D. B. 1992. Five dimensional lattice fermions. Phys. Lett. B288, 342.

Crossref

Google Scholar

[9]

Vranas P. M. 1998. Chiral Symmetry Restoration in the Schwinger Model with Domain Wall Fermions. Phys. Rev. D57, 1415.

Google Scholar

[10]

Salapura V., Walkup R. and Gara A. 2005. Exploiting Workload Parallelism for Performance and Power Optimization. IBM Research report RC23724, September.

Google Scholar

[11]

Gonzalez R., Gordon B., and Horowitz M. 1997. Supply and threshold voltage scaling for low power CMOS. IEEE Journal of Solid State Circuits, 32(8):1210--1216, August.

Crossref

Google Scholar

[12]

Martin A., Nystroem M., and Penzes P. 2001. ET2: a metric for time and energy efficiency of computation. Power-Aware Computing. Kluwer Academic Publishers.

Digital Library

Google Scholar

Cited By

View all

Maurya ANicolae BGuliani IRafique MVoznak MCalafate CDe Rango F(2020)CoSimProceedings of the IEEE/ACM 24th International Symposium on Distributed Simulation and Real Time Applications10.5555/3451906.3451931(167-174)Online publication date: 14-Sep-2020
https://dl.acm.org/doi/10.5555/3451906.3451931
Zhang ZLuan ZXu CGong MXu S(2018)Accelerating Lattice QCD on Sunway Many-Core Processor2018 IEEE Intl Conf on Parallel & Distributed Processing with Applications, Ubiquitous Computing & Communications, Big Data & Cloud Computing, Social Computing & Networking, Sustainable Computing & Communications (ISPA/IUCC/BDCloud/SocialCom/SustainCom)10.1109/BDCloud.2018.00094(605-612)Online publication date: Dec-2018
https://doi.org/10.1109/BDCloud.2018.00094
Kumar SMamidala AHeidelberger PChen DFaraj D(2014)Optimization of MPI collective operations on the IBM Blue Gene/Q supercomputerThe International Journal of High Performance Computing Applications10.1177/109434201455208628:4(450-464)Online publication date: 7-Nov-2014
https://doi.org/10.1177/1094342014552086
Show More Cited By

Index Terms

Recommendations

Massively parallel quantum chromodynamics

Quantum chromodynamics (QCD), the theory of the strong nuclear force, can be numerically simulated on massively parallel supercomputers using the method of lattice gauge theory. We describe the special programming requirements of lattice QCD (LQCD) as ...
An efficient CELL library for lattice quantum chromodynamics

Quantum chromodynamics (QCD) is the theory of subnuclear physics, aiming at modeling the strong nuclear force, which is responsible for the interactions of nuclear particles. Numerical QCD studies are performed through a discrete formalism called LQCD (...
Parallelizing the QUDA Library for Multi-GPU Calculations in Lattice Quantum Chromodynamics
SC '10: Proceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis

Graphics Processing Units (GPUs) are having a transformational effect on numerical lattice quantum chromo- dynamics (LQCD) calculations of importance in nuclear and particle physics. The QUDA library provides a package of mixed precision sparse matrix ...

Comments

Information & Contributors

Information

Published In

SC '06: Proceedings of the 2006 ACM/IEEE conference on Supercomputing

November 2006

746 pages

ISBN:0769527000

DOI:10.1145/1188455

Conference Chair:
Barbara Horner-Miller
Arctic Region Supercomputing Center

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 November 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

SC '06

Sponsor:

SIGARCH
IEEE-CS

SC '06: International Conference for High Performance Computing, Networking, Storage and Analysis

November 11 - 17, 2006

Florida, Tampa

Acceptance Rates

SC '06 Paper Acceptance Rate 54 of 239 submissions, 23%;

Overall Acceptance Rate 1,516 of 6,373 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
333
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)0

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Maurya ANicolae BGuliani IRafique MVoznak MCalafate CDe Rango F(2020)CoSimProceedings of the IEEE/ACM 24th International Symposium on Distributed Simulation and Real Time Applications10.5555/3451906.3451931(167-174)Online publication date: 14-Sep-2020
https://dl.acm.org/doi/10.5555/3451906.3451931
Zhang ZLuan ZXu CGong MXu S(2018)Accelerating Lattice QCD on Sunway Many-Core Processor2018 IEEE Intl Conf on Parallel & Distributed Processing with Applications, Ubiquitous Computing & Communications, Big Data & Cloud Computing, Social Computing & Networking, Sustainable Computing & Communications (ISPA/IUCC/BDCloud/SocialCom/SustainCom)10.1109/BDCloud.2018.00094(605-612)Online publication date: Dec-2018
https://doi.org/10.1109/BDCloud.2018.00094
Kumar SMamidala AHeidelberger PChen DFaraj D(2014)Optimization of MPI collective operations on the IBM Blue Gene/Q supercomputerThe International Journal of High Performance Computing Applications10.1177/109434201455208628:4(450-464)Online publication date: 7-Nov-2014
https://doi.org/10.1177/1094342014552086
Doi JHollingsworth J(2012)Peta-scale lattice quantum chromodynamics on a blue gene/Q supercomputerProceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis10.5555/2388996.2389058(1-10)Online publication date: 10-Nov-2012
https://dl.acm.org/doi/10.5555/2388996.2389058
Smelyanskiy MVaidyanathan KChoi JJoó BChhugani JClark MDubey PLathrop SCosta JKramer W(2011)High-performance lattice QCD for multi-core based parallel systems using a cache-friendly hybrid threaded-MPI approachProceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis10.1145/2063384.2063477(1-11)Online publication date: 12-Nov-2011
https://dl.acm.org/doi/10.1145/2063384.2063477
Ibrahim K(2010)Bridging the gap between complex software paradigms and power-efficient parallel architecturesProceedings of the International Conference on Green Computing10.1109/GREENCOMP.2010.5598285(417-424)Online publication date: 15-Aug-2010
https://dl.acm.org/doi/10.1109/GREENCOMP.2010.5598285
Ibrahim KBodin F(2009)Efficient SIMDization and data management of the Lattice QCD computation on the Cell Broadband EngineScientific Programming10.1155/2009/63475617:1-2(153-172)Online publication date: 1-Jan-2009
https://dl.acm.org/doi/10.1155/2009/634756
Vranas PBhanot G(2009)Quantum Chromodynamics on the BlueGene/L SupercomputerAdvanced Computational Infrastructures for Parallel and Distributed Adaptive Applications10.1002/9780470558027.ch8(131-148)Online publication date: 9-Dec-2009
https://doi.org/10.1002/9780470558027.ch8
Ibrahim KBodin FPapatheodorou TBanerjee UMendelson AGallivan K(2008)Implementing Wilson-Dirac operator on the cell broadband engineProceedings of the 22nd annual international conference on Supercomputing10.1145/1375527.1375532(4-14)Online publication date: 7-Jun-2008
https://dl.acm.org/doi/10.1145/1375527.1375532
Moreira JSalapura VAlmasi GArcher CBellofatto RBergner PBickford RBlumrich MBrunheroto JBright ABrutman MCastaños JChen DCoteus PCrumley PEllis SEngelsiepen TGara AGiampapa MGooding THall SHaring RHaskin RHeidelberger PHoenicke DInglett TKopcsay GLieber DLimpert DMcCarthy PMegerian MMundy MOhmacht MParker JRand RReed DSahoo RSanomiya AShok RSmith BStewart GTakken TVranas PWallenfelt BBlocksome MRatterman J(2007)The Blue Gene/L Supercomputer: A Hardware and Software StoryInternational Journal of Parallel Programming10.1007/s10766-007-0037-235:3(181-206)Online publication date: 1-Jun-2007
https://dl.acm.org/doi/10.1007/s10766-007-0037-2

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Cited By

Index Terms

Recommendations

Massively parallel quantum chromodynamics

An efficient CELL library for lattice quantum chromodynamics

Parallelizing the QUDA Library for Multi-GPU Calculations in Lattice Quantum Chromodynamics

Comments

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Qualifiers

Conference

Acceptance Rates

Upcoming Conference

Other Metrics

Article Metrics

Other Metrics

Cited By

Login options

Full Access

PDF

eReader

HTML Format

Abstract

References

Cited By

Index Terms

Recommendations

Massively parallel quantum chromodynamics

An efficient CELL library for lattice quantum chromodynamics

Parallelizing the QUDA Library for Multi-GPU Calculations in Lattice Quantum Chromodynamics

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Qualifiers

Conference

Acceptance Rates

Upcoming Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

HTML Format

Share

Share this Publication link

Share on social media

Affiliations