The Technology Audit Service has developed, XDMoD, a resource management tool. This paper utilizes XDMoD and the XDMoD data warehouse that it draws from to provide a broad overview of several aspects of XSEDE users and their usage. Some important trends include: 1) in spite of a large yearly turnover, there is a core of users persisting over many years, 2) user job submission has changed from primarily faculty members to students and postdocs, 3) increases in usage in Molecular Biosciences and Materials Research has outstripped that of other fields of science, 4) the distribution of user external funding is bimodal with one group having a large ratio of external funding to internal XSEDE funding (ie, CPU cycles) and a second group having a small ratio of external to internal (CPU cycle) funding, 5) user job efficiency is also bimodal with a group of presumably new users running mainly small inefficient jobs and another group of users running larger more efficient jobs, 6) finally, based on an analysis of citations of published papers, the scientific impact of XSEDE coupled with the service providers is demonstrated in the statistically significant advantage it provides to the research of its users.

References

[1]

Furlani, T. R., Jones, M. D., Gallo, S. M., Bruno, A. E., Lu, C.-D., Ghadersohi, A., Gentner, R. J., Patra, A., DeLeon, R. L., von Laszewski, G., Wang, F., and Zimmerman, A., "Performance metrics and auditing framework using application kernels for high performance computer systems," Concurrency and Computation: Practice and Experience, Vol 25, Issue 7, p 918, (2013), {Online}. Available: http://dx.doi.org/10.1002/cpe.2871 XDMoD: http://xdmod.ccr.buffalo.edu;

Crossref

Google Scholar

[2]

Furlani, T. R., Schneider, B. I., Jones, M. D., Towns, T., Hart, D. L., Gallo, S. M., DeLeon, R. L., Lu, C-D., Ghadersohi, A., Gentner, R. J., Patra, A. K., von Laszewski, G., Wang, F., Palmer, J. T., Simakov, N., 2013. "Using XDMoD to facilitate XSEDE operations, planning and analysis", In Proceedings of the Conference on Extreme Science and Engineering Discovery Environment: Gateway to Discovery (XSEDE '13). ACM, New York, NY, USA, Article 46, 8 pages.DOI=10.1145/2484762.2484763

Digital Library

Google Scholar

[3]

C. D. Lu, J. Browne, R. L. DeLeon, J. Hammond, W. Barth, T. R. Furlani, S. M. Gallo, M. D. Jones, and A. K. Patra. 2013. "Comprehensive job level resource usage measurement and analysis for XSEDE HPC systems.", In Proceedings of the Conference on Extreme Science and Engineering Discovery Environment: Gateway to Discovery (XSEDE '13). ACM, New York, NY, USA, Article 50, 8 pages. DOI=10.1145/2484762.2484781 http://doi.acm.org/10.1145/2484762.2484781

Digital Library

Google Scholar

[4]

Hart, David L. 2012 "Longitudinal User and Usage Patterns in the XSEDE User Community" In Proceedings of the Conference on Extreme Science and Engineering Discovery Environment: Gateway to Discovery (XSEDE '12). ACM, New York, NY, USA, Article 53, 7 pages DOI= 10.1145/2335755.2335851

Digital Library

Google Scholar

[5]

SU value ($0.05/SU); https://kb.iu.edu/d/bapq

Google Scholar

[6]

C. Browne, R. L. DeLeon, C. D. Lu, M. D. Jones, S. M. Gallo, A. Ghadersohi, A. K. Patra, W. L. Barth, J. Hammond, T. R. Furlani, R. T. McLay, "Enabling Comprehensive Data-Driven System Management for Large Computational Facilities", In Proceedings of SC13: International Conference for High Performance Computing, Networking, Storage and Analysis (SC '13). ACM, New York, NY, USA, Article 86, 11 pages. DOI=10.1145/2503210.2503230 http://doi.acm.org/10.1145/2503210.2503230

Digital Library

Google Scholar

[7]

Hammond, J. "TACC_stats: I/O performance monitoring for the intransigent" In 2011 Workshop for Interfaces and Architectures for Scientific Data Storage (IASDS 2011)

Google Scholar

[8]

http://github.com/TACCProjects/tacc_stats

Google Scholar

[9]

Wang, Fugang, von Laszewski, Gregor, Fox, Geoffery C., Furlani, Thomas R., DeLeon, Robert L., Gallo, Steven M. 2014 "Towards a Scientific Impact Measuring Faramework for Large Computing Facilities- a Case Study on XSEDE " In Proceedings of the Conference on Extreme Science and Engineering Discovery Environment: Gateway to Discovery (XSEDE '14). ACM, New York, NY, USA, Article 25, 8 pages, DOI = 10.1145/2616498.2616507

Digital Library

Google Scholar

[10]

Wang, Fugang, von Laszewski, Gregor, Fox, Geoffery C., Furlani, Thomas R., DeLeon, Robert L., Gallo, Steven M. 2015, to be submitted to XSEDE15.

Google Scholar

Cited By

View all

von Laszewski GWang FFox GStrande SIrving CCooper TMishin DNorman MStewart C(2019)Human in the Loop Virtual Machine Management on CometProceedings of the Humans in the Loop: Enabling and Facilitating Research on Cloud Computing10.1145/3355738.3355751(1-7)Online publication date: 29-Jul-2019
https://dl.acm.org/doi/10.1145/3355738.3355751
Stewart CHancock DWernert JFurlani TLifka DSill ABerente NMcMullen DCheatham TApon APayne RSlavin SFurlani T(2019)Assessment of financial returns on investments in cyberinfrastructure facilitiesPractice and Experience in Advanced Research Computing 2019: Rise of the Machines (learning)10.1145/3332186.3332228(1-8)Online publication date: 28-Jul-2019
https://dl.acm.org/doi/10.1145/3332186.3332228
Sperhac JDeLeon RFurlani TGallo SInnus MJones MPalmer JPatra APlessinger BRathsam RSimakov NWhite JChakraborty RDean G(2019)Managing computational gateway resources with XDMoDFuture Generation Computer Systems10.1016/j.future.2019.03.02998:C(154-166)Online publication date: 1-Sep-2019
https://dl.acm.org/doi/10.1016/j.future.2019.03.029
Show More Cited By

Index Terms

TAS view of XSEDE users and usage

Recommendations

Using XDMoD to facilitate XSEDE operations, planning and analysis
XSEDE '13: Proceedings of the Conference on Extreme Science and Engineering Discovery Environment: Gateway to Discovery

The XDMoD auditing tool provides, for the first time, a comprehensive tool to measure both utilization and performance of high-end cyberinfrastructure (CI), with initial focus on XSEDE. Here, we demonstrate, through several case studies, its utility for ...
Comprehensive, open-source resource usage measurement and analysis for HPC systems

The important role high-performance computing HPC resources play in science and engineering research, coupled with its high cost capital, power and manpower, short life and oversubscription, requires us to optimize its usage - an outcome that is only ...
Comprehensive job level resource usage measurement and analysis for XSEDE HPC systems
XSEDE '13: Proceedings of the Conference on Extreme Science and Engineering Discovery Environment: Gateway to Discovery

This paper presents a methodology for comprehensive job level resource use measurement and analysis and applications of the analyses to planning for HPC systems and a case study application of the methodology to the XSEDE Ranger and Lonestar4 systems at ...

Comments

Information & Contributors

Information

Published In

XSEDE '15: Proceedings of the 2015 XSEDE Conference: Scientific Advancements Enabled by Enhanced Cyberinfrastructure

July 2015

296 pages

ISBN:9781450337205

DOI:10.1145/2792745

General Chair:
Gregory D. Peterson
National Institute of Computational Sciences

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 July 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

XSEDE '15

Sponsor:

San Diego Super Computing Ctr
HPCWire
Omnibond
Indiana University
CASC
NICS
Intel
DDN
CORSA
ALLINEA
RENCI

XSEDE '15: Extreme Science Engineering Discovery Environment 2015 Conference

July 26 - 30, 2015

Missouri, St. Louis

Acceptance Rates

XSEDE '15 Paper Acceptance Rate 49 of 70 submissions, 70%;

Overall Acceptance Rate 129 of 190 submissions, 68%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
44
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

von Laszewski GWang FFox GStrande SIrving CCooper TMishin DNorman MStewart C(2019)Human in the Loop Virtual Machine Management on CometProceedings of the Humans in the Loop: Enabling and Facilitating Research on Cloud Computing10.1145/3355738.3355751(1-7)Online publication date: 29-Jul-2019
https://dl.acm.org/doi/10.1145/3355738.3355751
Stewart CHancock DWernert JFurlani TLifka DSill ABerente NMcMullen DCheatham TApon APayne RSlavin SFurlani T(2019)Assessment of financial returns on investments in cyberinfrastructure facilitiesPractice and Experience in Advanced Research Computing 2019: Rise of the Machines (learning)10.1145/3332186.3332228(1-8)Online publication date: 28-Jul-2019
https://dl.acm.org/doi/10.1145/3332186.3332228
Sperhac JDeLeon RFurlani TGallo SInnus MJones MPalmer JPatra APlessinger BRathsam RSimakov NWhite JChakraborty RDean G(2019)Managing computational gateway resources with XDMoDFuture Generation Computer Systems10.1016/j.future.2019.03.02998:C(154-166)Online publication date: 1-Sep-2019
https://dl.acm.org/doi/10.1016/j.future.2019.03.029
Stewart CHancock DWernert JLink MWilkins-Diehr NMiller TGaither KSnapp-Childs W(2018)Return on Investment for Three Cyberinfrastructure Facilities: A Local Campus Supercomputer, the NSF-Funded Jetstream Cloud System, and XSEDE (the eXtreme Science and Engineering Discovery Environment)2018 IEEE/ACM 11th International Conference on Utility and Cloud Computing (UCC)10.1109/UCC.2018.00031(223-236)Online publication date: Dec-2018
https://doi.org/10.1109/UCC.2018.00031

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Using XDMoD to facilitate XSEDE operations, planning and analysis

Comprehensive, open-source resource usage measurement and analysis for HPC systems

Comprehensive job level resource usage measurement and analysis for XSEDE HPC systems

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations