skip to main content
10.1145/2616498.2616554acmotherconferencesArticle/Chapter ViewAbstractPublication PagesxsedeConference Proceedingsconference-collections
research-article

UNICORE in XSEDE: Through Development, Integration, Deployment and beyond

Published: 13 July 2014 Publication History

Abstract

In this paper we discuss the implementation of UNICORE in XSEDE. UNICORE is a Grid middleware tool that was identified by XSEDE to further the areas of remote job submission, campus bridging and workflows. We talk about the overall architecture of UNICORE, a typical HPC environment at XSEDE and why UNICORE is a good fit for this environment. We also discuss the initial efforts made by the UNICORE development team as well as XSEDE's Software development team to integrate UNICORE into the XSEDE landscape. We detail how UNICORE went through the XSEDE engineering process and highlight deployment details at XSEDE. We touch upon how UNICORE is beneficial to the HPC user community. In our final section we talk about future efforts to better integrate UNICORE within XSEDE.

References

[1]
A. Streit, P. Bala, A. Beck-Ratzka, K. Benedyczak, S. Bergmann, R. Breu, J. Daivandy, B. Demuth, A. Eifer, A. Giesler, B. Hagemeier, S. Holl, V. Huber, N. Lamla, D. Mallmann, A. Memon, M. Memon, M. Rambadt, M. Riedel, M. Romberg, B. Schuller, T. Schlauch, A. Schreiber, T. Soddemann, and W. Ziegler, "Unicore 6 - recent and future advancements," annals of telecommunications - annales des télécommunications, vol. 65, no. 11--12, pp. 757--762, 2010. {Online}. Available: http://dx.doi.org/10.1007/s12243-010-0195-x
[2]
J. Towns, "Evolving from TeraGrid to XSEDE," in APS Southeastern Section Meeting Abstracts, vol. 1, 2011.
[3]
D. Talia, "The Open Grid Services Architecture," Grid Computing, 2002.
[4]
T. Banks, "Web services resource framework (wsrf)-primer v1. 2," OASIS Committee Draft, 2006.
[5]
A. Savva, "JSDL SPMD Application Extension," OGF, 2007.
[6]
M. Drescher and et al., "JSDL Parameter Sweep Extension," OGF, May 2009.
[7]
I. Foster and et al., "OGSA Basic Execution Service (BES), Version 1.0," OGF, Nov 2008.
[8]
M. Riedel, F. Wolf, D. Kranzlmüller, A. Streit, and T. Lippert, "Research advances by using interoperable e-science infrastructures," Cluster Computing, vol. 12, no. 4, pp. 357--372, 2009. {Online}. Available: http://dx.doi.org/10.1007/s10586-009-0102-2
[9]
M. Riedel, B. Schuller, M. Rambadt, M. Memon, A. Memon, A. Streit, T. Lippert, S. Zasada, S. Manos, P. Coveney, F. Wolf, and D. Kranzlmüller, "Exploring the potential of using multiple e-science infrastructures with emerging open standards-based e-health research tools," in Cluster, Cloud and Grid Computing (CCGrid), 2010 10th IEEE/ACM International Conference on, May 2010, pp. 341--348.
[10]
M. S. Memon, M. Riedel, A. S. Memon, F. Wolf, A. Streit, T. Lippert, M. Plociennik, M. Owsiak, D. Tskhakaya, and C. Konz, "Lessons learned from jointly using htc- and hpc-driven e-science infrastructures in fusion science," in Proceedings of the International Conference on Information and Emerging Technologies (ICIET 2010), June 14-16, 2010, Karachi, Pakistan. IEEE, 2010.
[11]
P. Hallam-Baker, "Security assertions markup language," 2001.
[12]
T. Moses et al., "Extensible access control markup language (xacml) version 2.0," Oasis Standard, vol. 200502, 2005.
[13]
C. Sosa and A. S. Grimshaw, "Bringing the Grid home," in Proceedings of the 2008 9th IEEE/ACM International Conference on Grid Computing. IEEE Computer Society, 2008, pp. 152--159.
[14]
J. Basney, M. Humphrey, and V. Welch, "The MyProxy online credential repository," Software: Practice and Experience, vol. 35, no. 9, pp. 801--816, 2005.
[15]
M. Morgan and A. Grimshaw, "Genesis ii - standards based grid computing," in Seventh IEEE International Symposium on Cluster Computing and the Grid, 2007., 2007, pp. 611--618.
[16]
P. Benedyczak, K. and Bala, S. van den Berghe, R. Menday, and B. Schuller, "Key aspects of the {UNICORE} 6 security model," Future Generation Computer Systems, vol. 27, no. 2, pp. 195--201, 2011.
[17]
Juelich Supercomputing Centre. {Online}. Available: http://www.fz-juelich.de
[18]
Kraken - NICS. {Online}. Available: http://www.nics.tennessee.edu/computing-resources/kraken
[19]
National Institute for Computational Sciences. {Online}. Available: http://www.nics.tennessee.edu
[20]
Pittsburgh Supercomputing Center. {Online}. Available: https://www.psc.edu
[21]
San Diego Supercomputer Center. {Online}. Available: https://www.sdsc.edu
[22]
B. Schuller and T. Pohlmann, "Uftp: High-performance data transfer for unicore," in UNICORE Summit 2011, Proceedings, 7-8 July 2011, Torun, Poland, ed.:/ M. Romberg, P. Bala, R. M§ller-Pfefferkorn, D.Mallmann, Forschungszentrum J§lich, 2011, IAS Series Vol. 9. - 978-3-89336-750-4. - S. 135--142, 2011, record converted from VDB: 12.11.2012. {Online}. Available: http://juser.fz-juelich.de/record/17790
[23]
W. Allcock, J. Bresnahan, R. Kettimuthu, M. Link, C. Dumitrescu, I. Raicu, and I. Foster, "The globus striped gridftp framework and server," in Proceedings of the 2005 ACM/IEEE conference on Supercomputing. IEEE Computer Society, 2005, p. 54.
[24]
XSEDE Certificates Repository. {Online}. Available: https://software.xsede.org/security/
[25]
S. Marru and et al., "Apache airavata: a framework for distributed applications and computational workflows," in Proceedings of the 2011 ACM workshop on Gateway computing environments, ser. GCE '11. New York, NY, USA: ACM, 2011, pp. 21--28. {Online}. Available: http://doi.acm.org/10.1145/2110486.2110490
[26]
S. Memon, N. Attig, G. Gorbet, L. Gunathilake, M. Riedel, T. Lippert, S. Marru, A. Grimshaw, F. Janetzko, B. Demeler, R. Singh, and M. Riedel, "Improvements of the ultrascan scientific gateway to enable computational jobs on large-scale and open-standards based cyberinfrastructures," in Proceedings of the Conference on Extreme Science and Engineering Discovery Environment: Gateway to Discovery, ser. XSEDE '13. New York, NY, USA: ACM, 2013, pp. 39:1--39:7. {Online}. Available: http://doi.acm.org/10.1145/2484762.2484800
[27]
"UltraScan-III version 2.0: A comprehensive data analysis software package for analytical ultracentrifugation experiments," http://www.ultrascan3.uthscsa.edu/, The University of Texas Health Science Center at San Antonio, Department of Biochemistry, {Online; accessed 19-March-2014}.
[28]
S. Gesing, R. Grunzke, J. Kr§ger, G. Birkenheuer, M. Wewior, P. SchŁSfer, B. Schuller, J. Schuster, S. Herres-Pawlis, S. Breuers, ç. BalaskŮ, M. Kozlovszky, A. Fabri, L. Packschies, P. Kacsuk, D. Blunk, T. Steinke, A. Brinkmann, G. Fels, R. M§ller-Pfefferkorn, R. JŁkel, and O. Kohlbacher, "A single sign-on infrastructure for science gateways on a use case for structural bioinformatics," Journal of Grid Computing, vol. 10, no. 4, pp. 769--790, 2012. {Online}. Available: http://dx.doi.org/10.1007/s10723-012-9247-y
[29]
T. Fieseler and W. G§rich, "Core d-grid infrastructure," in Grid Computing, S. Lin and E. Yen, Eds. Springer US, 2009, pp. 153--162.
[30]
I. Foster, "Globus Online: Accelerating and Democratizing Science through Cloud-Based Services," IEEE Internet Computing, vol. 15, no. 3, pp. 70--73, 2011.
[31]
I. Foster, C. Kesselman, C. Lee, B. Lindell, K. Nahrstedt, and A. Roy, "A distributed resource management architecture that supports advance reservations and co-allocation," in Quality of Service, 1999. IWQoS'99. 1999 Seventh International Workshop on. IEEE, 1999, pp. 27--36.
[32]
M. J. Litzkow, M. Livny, and M. W. Mutka, "Condor-a hunter of idle workstations," in Distributed Computing Systems, 1988., 8th International Conference on. IEEE, 1988, pp. 104--111.
[33]
J. Frey, "Condor dagman: Handling inter-job dependencies," 2002.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
XSEDE '14: Proceedings of the 2014 Annual Conference on Extreme Science and Engineering Discovery Environment
July 2014
445 pages
ISBN:9781450328937
DOI:10.1145/2616498
  • General Chair:
  • Scott Lathrop,
  • Program Chair:
  • Jay Alameda
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

  • NSF: National Science Foundation
  • Drexel University
  • Indiana University: Indiana University

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 July 2014

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Data Management
  2. Globus
  3. Grid middleware
  4. Remote Job Submission
  5. Software Engineering
  6. UNICORE
  7. XSEDE

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

XSEDE '14

Acceptance Rates

XSEDE '14 Paper Acceptance Rate 80 of 120 submissions, 67%;
Overall Acceptance Rate 129 of 190 submissions, 68%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 51
    Total Downloads
  • Downloads (Last 12 months)1
  • Downloads (Last 6 weeks)0
Reflects downloads up to 01 Mar 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media