skip to main content
10.1145/2792745.2792775acmotherconferencesArticle/Chapter ViewAbstractPublication PagesxsedeConference Proceedingsconference-collections
research-article

Bridges: a uniquely flexible HPC resource for new communities and data analytics

Published: 26 July 2015 Publication History

Abstract

In this paper, we describe Bridges, a new HPC resource that will integrate advanced memory technologies with a uniquely flexible, user-focused, data-centric environment to empower new research communities, bring desktop convenience to HPC, connect to campuses, and drive complex workflows. Bridges will differ from traditional HPC systems and support new communities through extensive interactivity, gateways (convenient web interfaces that hide complex functionality and ease access to HPC resources) and tools for gateway building, persistent databases and web servers, high-productivity programming languages, and virtualization. Bridges will feature three tiers of processing nodes having 128GB, 3TB, and 12TB of hardware-enabled coherent shared memory per node to support memory-intensive applications and ease of use, together with persistent database and web nodes and nodes for logins, data transfer, and system management. State-of-the-art Intel® Xeon® CPUs and NVIDIA Tesla GPUs will power Bridges' compute nodes. Multiple filesystems will provide optimal handling for different data needs: a high-performance, parallel, shared filesystem, node-local filesystems, and memory filesystems. Bridges' nodes and parallel filesystem will be interconnected by the Intel Omni-Path Fabric, configured in a topology developed by PSC to be optimal for the anticipated data-centric workload. Bridges will be a resource on XSEDE, the NSF Extreme Science and Engineering Discovery Environment, and will interoperate with other advanced cyberinfrastructure resources. Through a pilot project with Temple University, Bridges will develop infrastructure and processes for campus bridging, consisting of offloading jobs at periods of unusually high load to the other site and facilitating cross-site data management. Education, training, and outreach activities will raise awareness of Bridges and data-intensive science across K-12 and university communities, industry, and the general public.

References

[1]
Jockers, M. L. 2013. Macroanalysis: Digital Methods and Literary History. University of Illinois Press, Urbana, IL.
[2]
Koedinger, K. R., Baker, R. S. J.d., Cunningham, K., Skogsholm, A., Leber, B., Stamper, J. 2010. A Data Repository for the EDM community: The PSLC DataShop. In Romero, C., Ventura, S., Pechenizkiy, M., Baker, R. S. J.d. (Eds.) Handbook of Educational Data Mining. CRC Press, Boca Raton, FL.
[3]
Ramsey, J. D., Sanchez-Romero, R., and Glymour, C. 2014. Non-Gaussian Methods and High-Pass Filters in the Estimation of Effective Connections. NeuroImage 84 (Jan. 2014), 986--1006, ISSN 1053-8119. DOI=http://dx.doi.org/10.1016/j.neuroimage.2013.09.062.
[4]
Center for Causal Discovery, 2015. Retrieved April 6, 2015, from http://www.ccd.pitt.edu/.
[5]
Jewell, P. R. 2000. The Green Bank Telescope. Proc. SPIE 4015, Radio Telescopes, 136 (July 3, 2000). DOI=http://dx.doi.org/10.1117/12.390406.
[6]
Stewart, C. A., et al. 2015. Jetstream: A Self-Provisioned, Scalable Science and Engineering Cloud Environment. In Proceedings of the 2015 Annual Conference on Extreme Science and Engineering Discovery Environment (St. Louis, MO, July 26--30, 2015). XSEDE15. ACM, New York, NY, USA. DOI= http://dx.doi.org/10.1145/2792745.2792774.
[7]
Moore, R. L., et al. 2014. Gateways to Discovery: Cyberinfrastructure for the Long Tail of Science. In Proceedings of the 2014 Annual Conference on Extreme Science and Engineering Discovery Environment (Atlanta, July 13--18, 2014). XSEDE14. ACM, New York, NY, USA. DOI=http://dl.acm.org/10.1145/2616498.2616540.
[8]
Stampede. Retrieved from https://www.tacc.utexas.edu/systems/stampede.
[9]
Wrangler. Retrieved from https://www.tacc.utexas.edu/systems/wrangler.
[10]
The Data Exacell. Retrieved from http://www.psc.edu/index.php/data-exacell.
[11]
Nystrom, N., Welling, J., Blood, P., and Goh, E. L. 2013. Blacklight: Coherent Shared Memory for Enabling Science. In Contemporary High Performance Computing: From Petascale Toward Exascale, J. S. Vetter, Ed., CRC Computational Science Series, Taylor and Francis, Boca Raton, 2013, 431--450.
[12]
Nowoczynski, P., Sommerfield, S., Yanovich, J., Scott, J. R., Zhang, Z., and Levine, M. 2012. The Data Supercell. In Proceedings of the 1st Conference of the Extreme Science and Engineering Discovery Environment: Bridging from the Extreme to the Campus and Beyond (Chicago, July 16--20, 2012). XSEDE12. ACM, New York, NY, USA. DOI= http://dl.acm.org/10.1145/2335755.2335805.
[13]
Nowoczynski, P., Stone, N., Yanovich, J., and Sommerfield, J., "High efficiency, high performance system for writing data from applications to a safe file system," U.S. Patent 8,316,288, Nov. 20, 2012.
[14]
Nowoczynski, P., Stone, N., Yanovich, J., and Sommerfield, J. 2008. Zest Checkpoint Storage System for Large Supercomputers. In Proceedings of the 3rd International Petascale Data Storage Workshop (Austin, November 17, 2008). PDSW '08. IEEE, Piscataway, NJ, USA. DOI= http://dx.doi.org/10.1109/PDSW.2008.4811883.
[15]
Gropp, W., Lusk, E, and Skjellum, A. 1996. A High-Performance, Portable Implementation of the MPI Message Passing Interface. Parallel Computing 22 (Sept. 1996), 789--828. DOI=http://dx.doi.org/10.1016/0167-8191(96)00024-5.
[16]
Velusamy, V. and Rao, C. 2003. Programming the Infiniband Network Architecture for High Performance Message Passing Systems. In Proceedings of the 30th International Symposium on Computer Architecture (San Diego, June 9--11, 2003). ISCA '03. ACM, New York, NY, USA. Science DMZ: A Scalable Network Design Model for Optimizing Science Data Transfers. http://fasterdata.es.net/science-dmz/.

Cited By

View all
  • (2024)Text-Inductive Graphone-Based Language Adaptation for Low-Resource Speech SynthesisIEEE/ACM Transactions on Audio, Speech, and Language Processing10.1109/TASLP.2024.336953732(1829-1844)Online publication date: 2024
  • (2024)DISTRI: Development and Integration of Simulation Tools for Resilient Infrastructure2024 IEEE International Conference on Big Data (BigData)10.1109/BigData62323.2024.10825783(4167-4177)Online publication date: 15-Dec-2024
  • (2024)Gluon helicity from global analysis of experimental data and lattice QCD Ioffe time distributionsPhysical Review D10.1103/PhysRevD.109.036031109:3Online publication date: 27-Feb-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
XSEDE '15: Proceedings of the 2015 XSEDE Conference: Scientific Advancements Enabled by Enhanced Cyberinfrastructure
July 2015
296 pages
ISBN:9781450337205
DOI:10.1145/2792745
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

  • San Diego Super Computing Ctr: San Diego Super Computing Ctr
  • HPCWire: HPCWire
  • Omnibond: Omnibond Systems, LLC
  • SGI
  • Internet2
  • Indiana University: Indiana University
  • CASC: The Coalition for Academic Scientific Computation
  • NICS: National Institute for Computational Sciences
  • Intel: Intel
  • DDN: DataDirect Networks, Inc
  • DELL
  • CORSA: CORSA Technology
  • ALLINEA: Allinea Software
  • Cray
  • RENCI: Renaissance Computing Institute

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 July 2015

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. GPU
  2. HPC
  3. Hadoop
  4. applications
  5. architecture
  6. big data
  7. data analytics
  8. database
  9. research
  10. usability

Qualifiers

  • Research-article

Conference

XSEDE '15
Sponsor:
  • San Diego Super Computing Ctr
  • HPCWire
  • Omnibond
  • Indiana University
  • CASC
  • NICS
  • Intel
  • DDN
  • CORSA
  • ALLINEA
  • RENCI

Acceptance Rates

XSEDE '15 Paper Acceptance Rate 49 of 70 submissions, 70%;
Overall Acceptance Rate 129 of 190 submissions, 68%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)19
  • Downloads (Last 6 weeks)2
Reflects downloads up to 07 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Text-Inductive Graphone-Based Language Adaptation for Low-Resource Speech SynthesisIEEE/ACM Transactions on Audio, Speech, and Language Processing10.1109/TASLP.2024.336953732(1829-1844)Online publication date: 2024
  • (2024)DISTRI: Development and Integration of Simulation Tools for Resilient Infrastructure2024 IEEE International Conference on Big Data (BigData)10.1109/BigData62323.2024.10825783(4167-4177)Online publication date: 15-Dec-2024
  • (2024)Gluon helicity from global analysis of experimental data and lattice QCD Ioffe time distributionsPhysical Review D10.1103/PhysRevD.109.036031109:3Online publication date: 27-Feb-2024
  • (2024)Universal Inference Meets Random Projections: A Scalable Test for Log-ConcavityJournal of Computational and Graphical Statistics10.1080/10618600.2024.234733834:1(267-279)Online publication date: 31-May-2024
  • (2024) Turning on Low-Temperature Catalytic Conversion of Biomass Derivatives through Teaming Pd 1 and Mo 1 Single-Atom Sites Journal of the American Chemical Society10.1021/jacs.4c07075Online publication date: 14-Nov-2024
  • (2024)Interfacial Enrichment of Lauric Acid Assisted by Long-Chain Fatty Acids, Acidity and Salinity at Sea Spray Aerosol SurfacesThe Journal of Physical Chemistry A10.1021/acs.jpca.4c03335128:34(7195-7207)Online publication date: 6-Aug-2024
  • (2023)Learning to speak from textProceedings of the Thirty-Second International Joint Conference on Artificial Intelligence10.24963/ijcai.2023/575(5179-5187)Online publication date: 19-Aug-2023
  • (2023)Software Design and User Interface of ESPnet-SE++: Speech Enhancement for Robust Speech ProcessingJournal of Open Source Software10.21105/joss.054038:91(5403)Online publication date: Nov-2023
  • (2023)VxH: A Systematic Determination of Efficient Hierarchical Voxel StructuresACM Transactions on Spatial Algorithms and Systems10.1145/363240410:1(1-34)Online publication date: 11-Dec-2023
  • (2023)Rebuilding BridgesPractice and Experience in Advanced Research Computing 2023: Computing for the Common Good10.1145/3569951.3597589(324-327)Online publication date: 23-Jul-2023
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media