research-article

Connecting the non-traditional user-community to the national CyberInfrastructure

Authors:

Ritu Arora,

Jessica TreloganAuthors Info & Claims

XSEDE '15: Proceedings of the 2015 XSEDE Conference: Scientific Advancements Enabled by Enhanced Cyberinfrastructure

Article No.: 16, Pages 1 - 5

https://doi.org/10.1145/2792745.2792761

Published: 26 July 2015 Publication History

Get Access

Abstract

This paper reports on a hands-on workshop that was organized to promote the usage of the national CyberInfrastructure (CI) amongst non-traditional High Performance Computing (HPC) users. The majority of the workshop participants were students and professionals who had never used the CI before but were interested in leveraging it for conducting computationally-intensive Big Data management activities. With the support from the National Science Foundation (NSF), students from underrepresented groups were also funded to participate in the workshop, where they learnt about both the CI and Big Data management. The workshop itself was an outcome of an XSEDE Extended Collaborative Support Service (ECSS) project that involved non-traditional HPC users from the archaeology domain.

References

[1]

XSEDE website, accessed on March 16, 2015: https://www.xsede.org/

Google Scholar

[2]

Texas Advanced Computing Center website, accessed on March 19, 2015: https://www.tacc.utexas.edu/

Google Scholar

[3]

Extreme Science and engineering Discovery Environment, accessed on March 16, 2015: https://www.xsede.org/

Google Scholar

[4]

Extended Collaborative Support Service, accessed on March 19, 2015: https://www.xsede.org/ecss

Google Scholar

[5]

Ritu Arora, Maria Esteva, Jessica Trelogan, "Leveraging High Performance Computing for Managing Large and Evolving Data Collections", International Journal of digital Curation, Vol. 9. No. 2, (2014), accessed on March 19, 2015: http://www.ijdc.net/index.php/ijdc/article/viewFile/9.2.17/366

Crossref

Google Scholar

[6]

First Hands-On Workshop on Leveraging High Performance Computing for Managing Large Datasets, accessed on March 16, 2015: https://www.tacc.utexas.edu/news/events/2014/ieee/managing-large-datasets

Google Scholar

[7]

2014 IEEE International Conference on Big Data website, accessed on March 19, 2015: http://cci.drexel.edu/bigdata/bigdata2014/

Google Scholar

[8]

National Energy Research Scientific Computing Center, accessed on March 19, 2015: https://www.nersc.gov/

Google Scholar

[9]

Agenda of the "First Hands-On Workshop on Leveraging High Performance Computing for Managing Large Datasets", accessed on March 19, 2016: https://www.tacc.utexas.edu/news/events/2014/ieee/agenda

Google Scholar

[10]

Improvscience website, accessed on March 19, 2015: http://improvscience.org/

Google Scholar

[11]

Globus Connect Personal website, accessed on March 19, 2015: https://www.globus.org/globus-connect-personal

Google Scholar

Cited By

View all

Falk Olesen JHalskov KWakkary RAndersen KOdom WDesjardins APetersen M(2020)10 Years of Research With and On HackathonsProceedings of the 2020 ACM Designing Interactive Systems Conference10.1145/3357236.3395543(1073-1088)Online publication date: 3-Jul-2020
https://dl.acm.org/doi/10.1145/3357236.3395543

Index Terms

Connecting the non-traditional user-community to the national CyberInfrastructure

Recommendations

Enabling dynamic and intelligent workflows for HPC, data analytics, and AI convergence
Abstract
The evolution of High-Performance Computing (HPC) platforms enables the design and execution of progressively larger and more complex workflow applications in these systems. The complexity comes not only from the number of elements that compose ...
Highlights
- Analysis of the HPC, Big Data and AI convergence in complex scientific workflows.
- Description of use cases where complex workflows combining HPC, DA and AI are required.
- Present challenges of delivering a new workflow platform to ...
Big data analytics on traditional HPC infrastructure using two-level storage
DISCS '15: Proceedings of the 2015 International Workshop on Data-Intensive Scalable Computing Systems

Data-intensive computing has become one of the major workloads on traditional high-performance computing (HPC) clusters. Currently, deploying data-intensive computing software framework on HPC clusters still faces performance and scalability issues. In ...
Spark on the ARC: Big data analytics frameworks on HPC clusters
PEARC '17: Practice and Experience in Advanced Research Computing 2017: Sustainability, Success and Impact

In this paper we document our approach to overcoming service discovery and configuration of Apache Hadoop and Spark frameworks with dynamic resource allocations in a batch oriented Advanced Research Computing (ARC) High Performance Computing (HPC) ...

Comments

Information & Contributors

Information

Published In

XSEDE '15: Proceedings of the 2015 XSEDE Conference: Scientific Advancements Enabled by Enhanced Cyberinfrastructure

July 2015

296 pages

ISBN:9781450337205

DOI:10.1145/2792745

General Chair:
Gregory D. Peterson
National Institute of Computational Sciences

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 July 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

XSEDE '15

Sponsor:

San Diego Super Computing Ctr
HPCWire
Omnibond
Indiana University
CASC
NICS
Intel
DDN
CORSA
ALLINEA
RENCI

XSEDE '15: Extreme Science Engineering Discovery Environment 2015 Conference

July 26 - 30, 2015

Missouri, St. Louis

Acceptance Rates

XSEDE '15 Paper Acceptance Rate 49 of 70 submissions, 70%;

Overall Acceptance Rate 129 of 190 submissions, 68%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
70
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Falk Olesen JHalskov KWakkary RAndersen KOdom WDesjardins APetersen M(2020)10 Years of Research With and On HackathonsProceedings of the 2020 ACM Designing Interactive Systems Conference10.1145/3357236.3395543(1073-1088)Online publication date: 3-Jul-2020
https://dl.acm.org/doi/10.1145/3357236.3395543

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Enabling dynamic and intelligent workflows for HPC, data analytics, and AI convergence

Big data analytics on traditional HPC infrastructure using two-level storage

Spark on the ARC: Big data analytics frameworks on HPC clusters

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations