research-article

Publishing and consuming GLUE v2.0 resource information in XSEDE

Authors:

Sudhakar Pamidighantam,

John-Paul NavarroAuthors Info & Claims

XSEDE '15: Proceedings of the 2015 XSEDE Conference: Scientific Advancements Enabled by Enhanced Cyberinfrastructure

Article No.: 25, Pages 1 - 8

https://doi.org/10.1145/2792745.2792770

Published: 26 July 2015 Publication History

Abstract

XSEDE users, science gateways, and services need a variety of accurate information about XSEDE resources so that they can use those resources effectively. They need information to decide which resources to use, to track their usage of resources, and to provide services to their users. To support this, XSEDE is deploying a new system to gather and publish static and dynamic resource information. This paper gives an overview of the resource information available with this new system, describes the design and performance of the software and services that make up this system, and finally provides examples of how to use this new resource information.

References

[1]

S. Aiyagari et al. AMQP: Advanced Message Queuing Protocol Specification Version 0.9.1. Technical Report 0.9.1, AMQP Working Group, November 2008.

[2]

AMQP: Advanced Message Queuing Protocol. http://www.amqp.org.

[3]

S. Andreozzi, S. Burke, F. Ehm, L. Field, G. Galang, B. Konya, M. Litmaath, P. Millar, and J. Navarro. GLUE Specification v. 2.0. Technical Report GFD-R-P.147, The Open Grid Forum, March 2009.

[4]

S. Burke, S. Andreozzi, and L. Field. Experiences with the GLUE Information Schema in the LCG/EGEE Production Grid. In Proceedings of the International Conference on Computing in High Energy and Nuclear Physics (CHEP 2007), 2007.

[5]

Charlie Catlett. The Philosophy of TeraGrid: Building an Open, Extensible, Distributed TeraScale Facility. In Proceedings of the 2nd International Symposium on Cluster Computing and the Grid, 2002.

Digital Library

[6]

R. Dooley, K. Milfeld, C. Guiang, S. Pamidighantam, and G. Allen. From Proposal to Production Lessons Learned Developing the Computational Chemistry Grid Cyberinfrastructure. Journal of Grid Computing, 4:195--208, 2006.

[7]

European Grid Infrastructure -- towards a sustainable infrastructure. http://www.egi.eu.

[8]

Y. Fan, S. Pamidighantam, and W. Smith. Incorporating Job Predictions into the SEAGrid Science Gatewa. In Proceedings of the XSEDE'14 Conference, July 2014.

Digital Library

[9]

L. Field and M. W. Schulz. Grid Deployment Experiences: The path to a production quality LDAP based grid information system. In Proceedings of the Conference for Computing in High-Energy and Nuclear Physics, pages 723--726, 2004.

[10]

G. Garzoglio, T. Levshina, P. Mhashilkar, and S. Timm. ReSS: A Resource Selection Service for the Open Science Grid. Technical report, Fermilab, 2008.

[11]

Gratia. https://www.opensciencegrid.org/bin/view/Accounting/WebHome.

[12]

Gstat 2.0. http://gstat2.grid.sinica.edu.tw.

[13]

M. Hanlon, W. Smith, and S. Mock. Providing Resource Information to Users of a National Computing Center. In Proceedings of the XSEDE13 conference, July 2013.

Digital Library

[14]

The Information Publishing Framework. https://bitbucket.org/wwsmith/ipf.

[15]

Introducing JSON. http://www.json.org.

[16]

JSON Java examples from the Open Grid Forum Glue working group. https://github.com/OGF-GLUE/JSON/tree/master/examples/java.

[17]

Generate Plain Old Java Objects from JSON or JSON-Schema. http://www.jsonschema2pojo.org.

[18]

L. Liming et al. TeraGrid's integrated information service. In Proceedings of the 5th Grid Computing Environments Workshop, GCE '09, pages 8:1--8:10, New York, NY, USA, 2009. ACM.

Digital Library

[19]

Nagios - The Industry Standard In IT Infrastructure Monitoring. http://www.nagios.org.

[20]

Open Grid Forum. http://www.ogf.org.

[21]

The Open Science Grid. http://www.opensciencegrid.org.

[22]

R. Pordes et al. The Open Science Grid. Journal of Physics: Conference Series, 78, 2007.

[23]

PRACE Research Infrastructure - The top level of the European HPC ecosystem. http://www.prace-project.eu.

[24]

First Annual Operations Report of the Tier-1 Service. http://www.prace-ri.eu/IMG/pdf/D6-1\_2ip.pdf.

[25]

RabbitMQ: Messaging that just works. http://www.rabbitmq.com.

[26]

RabbitMQ Performance Measurements, part 2. http://www.rabbitmq.com/blog/2012/04/25/rabbitmq-performance-measurements-part-2/.

[27]

RabbitMQ SSl Support. https://www.rabbitmq.com/ssl.html.

[28]

The Resource and Service Validation (RSV) Service. http//www.opensciencegrid.org/bin/view/Documentation/Release3/RsvOverview.

[29]

J. M. Schopf, L. Pearlman, N. Miller, C. Kesselman, and A. Chervenak. Monitoring the grid with the Globus Toolkit MDS4. Journal of Physics: Conference Series, 46, 2006.

[30]

N. Shen, Y. Fan, and S. Pamidighantam. E-science infrastructures for molecular modeling and parametrization. Journal of Computational Science, 5(4):576--589, 2014.

[31]

W. Smith. A Service for Queue Prediction and Job Statistics. In Proceedings of the 6th Gateway Computing Environments Workshop (GCE '10), November 2010.

[32]

W. Smith and S. Smallen. Building an Information System for a Distributed Testbed. In Proceedings of the XSEDE'14 conference, July 2014.

Digital Library

[33]

The Karnak Prediction Service. http://www.karnak.xsede.org.

[34]

N. Wilkins-Diehr, D. Gannon, G. Klimeck, S. Oster, and S. Pamidighantam. TeraGrid Science Gateways and Their Impact on Science. IEEE Computer, 41(11):32--41, 2008.

Digital Library

[35]

XSEDE: eXtreme Science and Engineering Discovery Environment. http://www.xsede.org.

Cited By

Zhang ZLei YMao XYan MXu LWen J(2021)Improving deep‐learning‐based fault localization with resamplingJournal of Software: Evolution and Process10.1002/smr.231233:3Online publication date: 3-Mar-2021
https://dl.acm.org/doi/10.1002/smr.2312
Khan AHussain IZamir M(2021)Analytic hierarchy process‐based prioritization framework for vendor's reliability challenges in global software developmentJournal of Software: Evolution and Process10.1002/smr.231033:3Online publication date: 3-Mar-2021
https://dl.acm.org/doi/10.1002/smr.2310
Sablis ASmite DMoe N(2021)Team‐external coordination in large‐scale software development projectsJournal of Software: Evolution and Process10.1002/smr.229733:3Online publication date: 3-Mar-2021
https://dl.acm.org/doi/10.1002/smr.2297
Show More Cited By

Index Terms

Publishing and consuming GLUE v2.0 resource information in XSEDE

Recommendations

Homogenizing OSG and XSEDE: Providing Access to XSEDE Allocations through OSG Infrastructure
PEARC '18: Proceedings of the Practice and Experience on Advanced Research Computing: Seamless Creativity

We present a system that allows individual researchers and virtual organizations (VOs) to access allocations on Stampede2 and Bridges through the Open Science Grid (OSG), a national grid infrastructure for running high throughput computing (HTC) tasks. ...
UNICORE in XSEDE: Through Development, Integration, Deployment and beyond
XSEDE '14: Proceedings of the 2014 Annual Conference on Extreme Science and Engineering Discovery Environment

In this paper we discuss the implementation of UNICORE in XSEDE. UNICORE is a Grid middleware tool that was identified by XSEDE to further the areas of remote job submission, campus bridging and workflows. We talk about the overall architecture of ...
Comprehensive job level resource usage measurement and analysis for XSEDE HPC systems
XSEDE '13: Proceedings of the Conference on Extreme Science and Engineering Discovery Environment: Gateway to Discovery

This paper presents a methodology for comprehensive job level resource use measurement and analysis and applications of the analyses to planning for HPC systems and a case study application of the methodology to the XSEDE Ranger and Lonestar4 systems at ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

XSEDE '15: Proceedings of the 2015 XSEDE Conference: Scientific Advancements Enabled by Enhanced Cyberinfrastructure

July 2015

296 pages

ISBN:9781450337205

DOI:10.1145/2792745

General Chair:
Gregory D. Peterson
National Institute of Computational Sciences

Copyright © 2015 ACM.

Publication rights licensed to ACM. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of the United States government. As such, the Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

Sponsors

San Diego Super Computing Ctr: San Diego Super Computing Ctr
HPCWire: HPCWire
Omnibond: Omnibond Systems, LLC
SGI
Internet2
Indiana University: Indiana University
CASC: The Coalition for Academic Scientific Computation
NICS: National Institute for Computational Sciences
Intel: Intel
DDN: DataDirect Networks, Inc
DELL
CORSA: CORSA Technology
ALLINEA: Allinea Software
Cray
RENCI: Renaissance Computing Institute

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 July 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Conference

XSEDE '15

Sponsor:

San Diego Super Computing Ctr
HPCWire
Omnibond
Indiana University
CASC
NICS
Intel
DDN
CORSA
ALLINEA
RENCI

XSEDE '15: Extreme Science Engineering Discovery Environment 2015 Conference

July 26 - 30, 2015

Missouri, St. Louis

Acceptance Rates

XSEDE '15 Paper Acceptance Rate 49 of 70 submissions, 70%;

Overall Acceptance Rate 129 of 190 submissions, 68%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
53
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Zhang ZLei YMao XYan MXu LWen J(2021)Improving deep‐learning‐based fault localization with resamplingJournal of Software: Evolution and Process10.1002/smr.231233:3Online publication date: 3-Mar-2021
https://dl.acm.org/doi/10.1002/smr.2312
Khan AHussain IZamir M(2021)Analytic hierarchy process‐based prioritization framework for vendor's reliability challenges in global software developmentJournal of Software: Evolution and Process10.1002/smr.231033:3Online publication date: 3-Mar-2021
https://dl.acm.org/doi/10.1002/smr.2310
Sablis ASmite DMoe N(2021)Team‐external coordination in large‐scale software development projectsJournal of Software: Evolution and Process10.1002/smr.229733:3Online publication date: 3-Mar-2021
https://dl.acm.org/doi/10.1002/smr.2297
Navarro JStewart CKnepper RLiming LLifka DDahan MHart D(2017)The Community Software Repository from XSEDEPractice and Experience in Advanced Research Computing 2017: Sustainability, Success and Impact10.1145/3093338.3093373(1-8)Online publication date: 9-Jul-2017
https://dl.acm.org/doi/10.1145/3093338.3093373
Nakandala SPamidighantam SYodage SDoshi NAbeysinghe EKankanamalage CMarru SPierce MGaither K(2016)Anatomy of the SEAGrid Science GatewayProceedings of the XSEDE16 Conference on Diversity, Big Data, and Science at Scale10.1145/2949550.2949591(1-8)Online publication date: 17-Jul-2016
https://dl.acm.org/doi/10.1145/2949550.2949591
Pamidighantam SNakandala SAbeysinghe EWimalasena CYodage SMarru SPierce M(2016)Community Science Exemplars in SEAGrid Science GatewayProcedia Computer Science10.1016/j.procs.2016.05.53580:C(1927-1939)Online publication date: 1-Jun-2016
https://dl.acm.org/doi/10.1016/j.procs.2016.05.535
Smari WBakhouya MFiore SAloisio G(2016)New advances in High Performance Computing and simulationConcurrency and Computation: Practice & Experience10.1002/cpe.377428:7(2024-2030)Online publication date: 1-May-2016
https://dl.acm.org/doi/10.1002/cpe.3774
Singh KSmallen STilak SSaul L(2016)Failure analysis and prediction for the CIPRES science gatewayConcurrency and Computation: Practice & Experience10.1002/cpe.371528:7(1971-1981)Online publication date: 1-May-2016
https://dl.acm.org/doi/10.1002/cpe.3715
Brookes EKapoor APatra PMarru SSingh RPierce M(2016)GSoC 2015 student contributions to GenApp and AiravataConcurrency and Computation: Practice & Experience10.1002/cpe.368928:7(1960-1970)Online publication date: 1-May-2016
https://dl.acm.org/doi/10.1002/cpe.3689
Saha TAl Hasan M(2015)FS3Statistical Analysis and Data Mining10.1002/sam.112778:4(245-261)Online publication date: 1-Aug-2015
https://dl.acm.org/doi/10.1002/sam.11277
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten