UNICORE in XSEDE: Through Development, Integration, Deployment and beyond
Article No.: 64, Pages 1 - 8
Abstract
In this paper we discuss the implementation of UNICORE in XSEDE. UNICORE is a Grid middleware tool that was identified by XSEDE to further the areas of remote job submission, campus bridging and workflows. We talk about the overall architecture of UNICORE, a typical HPC environment at XSEDE and why UNICORE is a good fit for this environment. We also discuss the initial efforts made by the UNICORE development team as well as XSEDE's Software development team to integrate UNICORE into the XSEDE landscape. We detail how UNICORE went through the XSEDE engineering process and highlight deployment details at XSEDE. We touch upon how UNICORE is beneficial to the HPC user community. In our final section we talk about future efforts to better integrate UNICORE within XSEDE.
References
[1]
A. Streit, P. Bala, A. Beck-Ratzka, K. Benedyczak, S. Bergmann, R. Breu, J. Daivandy, B. Demuth, A. Eifer, A. Giesler, B. Hagemeier, S. Holl, V. Huber, N. Lamla, D. Mallmann, A. Memon, M. Memon, M. Rambadt, M. Riedel, M. Romberg, B. Schuller, T. Schlauch, A. Schreiber, T. Soddemann, and W. Ziegler, "Unicore 6 - recent and future advancements," annals of telecommunications - annales des télécommunications, vol. 65, no. 11--12, pp. 757--762, 2010. {Online}. Available: http://dx.doi.org/10.1007/s12243-010-0195-x
[2]
J. Towns, "Evolving from TeraGrid to XSEDE," in APS Southeastern Section Meeting Abstracts, vol. 1, 2011.
[3]
D. Talia, "The Open Grid Services Architecture," Grid Computing, 2002.
[4]
T. Banks, "Web services resource framework (wsrf)-primer v1. 2," OASIS Committee Draft, 2006.
[5]
A. Savva, "JSDL SPMD Application Extension," OGF, 2007.
[6]
M. Drescher and et al., "JSDL Parameter Sweep Extension," OGF, May 2009.
[7]
I. Foster and et al., "OGSA Basic Execution Service (BES), Version 1.0," OGF, Nov 2008.
[8]
M. Riedel, F. Wolf, D. Kranzlmüller, A. Streit, and T. Lippert, "Research advances by using interoperable e-science infrastructures," Cluster Computing, vol. 12, no. 4, pp. 357--372, 2009. {Online}. Available: http://dx.doi.org/10.1007/s10586-009-0102-2
[9]
M. Riedel, B. Schuller, M. Rambadt, M. Memon, A. Memon, A. Streit, T. Lippert, S. Zasada, S. Manos, P. Coveney, F. Wolf, and D. Kranzlmüller, "Exploring the potential of using multiple e-science infrastructures with emerging open standards-based e-health research tools," in Cluster, Cloud and Grid Computing (CCGrid), 2010 10th IEEE/ACM International Conference on, May 2010, pp. 341--348.
[10]
M. S. Memon, M. Riedel, A. S. Memon, F. Wolf, A. Streit, T. Lippert, M. Plociennik, M. Owsiak, D. Tskhakaya, and C. Konz, "Lessons learned from jointly using htc- and hpc-driven e-science infrastructures in fusion science," in Proceedings of the International Conference on Information and Emerging Technologies (ICIET 2010), June 14-16, 2010, Karachi, Pakistan. IEEE, 2010.
[11]
P. Hallam-Baker, "Security assertions markup language," 2001.
[12]
T. Moses et al., "Extensible access control markup language (xacml) version 2.0," Oasis Standard, vol. 200502, 2005.
[13]
C. Sosa and A. S. Grimshaw, "Bringing the Grid home," in Proceedings of the 2008 9th IEEE/ACM International Conference on Grid Computing. IEEE Computer Society, 2008, pp. 152--159.
[14]
J. Basney, M. Humphrey, and V. Welch, "The MyProxy online credential repository," Software: Practice and Experience, vol. 35, no. 9, pp. 801--816, 2005.
[15]
M. Morgan and A. Grimshaw, "Genesis ii - standards based grid computing," in Seventh IEEE International Symposium on Cluster Computing and the Grid, 2007., 2007, pp. 611--618.
[16]
P. Benedyczak, K. and Bala, S. van den Berghe, R. Menday, and B. Schuller, "Key aspects of the {UNICORE} 6 security model," Future Generation Computer Systems, vol. 27, no. 2, pp. 195--201, 2011.
[17]
Juelich Supercomputing Centre. {Online}. Available: http://www.fz-juelich.de
[18]
Kraken - NICS. {Online}. Available: http://www.nics.tennessee.edu/computing-resources/kraken
[19]
National Institute for Computational Sciences. {Online}. Available: http://www.nics.tennessee.edu
[20]
Pittsburgh Supercomputing Center. {Online}. Available: https://www.psc.edu
[21]
San Diego Supercomputer Center. {Online}. Available: https://www.sdsc.edu
[22]
B. Schuller and T. Pohlmann, "Uftp: High-performance data transfer for unicore," in UNICORE Summit 2011, Proceedings, 7-8 July 2011, Torun, Poland, ed.:/ M. Romberg, P. Bala, R. M§ller-Pfefferkorn, D.Mallmann, Forschungszentrum J§lich, 2011, IAS Series Vol. 9. - 978-3-89336-750-4. - S. 135--142, 2011, record converted from VDB: 12.11.2012. {Online}. Available: http://juser.fz-juelich.de/record/17790
[23]
W. Allcock, J. Bresnahan, R. Kettimuthu, M. Link, C. Dumitrescu, I. Raicu, and I. Foster, "The globus striped gridftp framework and server," in Proceedings of the 2005 ACM/IEEE conference on Supercomputing. IEEE Computer Society, 2005, p. 54.
[24]
XSEDE Certificates Repository. {Online}. Available: https://software.xsede.org/security/
[25]
S. Marru and et al., "Apache airavata: a framework for distributed applications and computational workflows," in Proceedings of the 2011 ACM workshop on Gateway computing environments, ser. GCE '11. New York, NY, USA: ACM, 2011, pp. 21--28. {Online}. Available: http://doi.acm.org/10.1145/2110486.2110490
[26]
S. Memon, N. Attig, G. Gorbet, L. Gunathilake, M. Riedel, T. Lippert, S. Marru, A. Grimshaw, F. Janetzko, B. Demeler, R. Singh, and M. Riedel, "Improvements of the ultrascan scientific gateway to enable computational jobs on large-scale and open-standards based cyberinfrastructures," in Proceedings of the Conference on Extreme Science and Engineering Discovery Environment: Gateway to Discovery, ser. XSEDE '13. New York, NY, USA: ACM, 2013, pp. 39:1--39:7. {Online}. Available: http://doi.acm.org/10.1145/2484762.2484800
[27]
"UltraScan-III version 2.0: A comprehensive data analysis software package for analytical ultracentrifugation experiments," http://www.ultrascan3.uthscsa.edu/, The University of Texas Health Science Center at San Antonio, Department of Biochemistry, {Online; accessed 19-March-2014}.
[28]
S. Gesing, R. Grunzke, J. Kr§ger, G. Birkenheuer, M. Wewior, P. SchŁSfer, B. Schuller, J. Schuster, S. Herres-Pawlis, S. Breuers, ç. BalaskŮ, M. Kozlovszky, A. Fabri, L. Packschies, P. Kacsuk, D. Blunk, T. Steinke, A. Brinkmann, G. Fels, R. M§ller-Pfefferkorn, R. JŁkel, and O. Kohlbacher, "A single sign-on infrastructure for science gateways on a use case for structural bioinformatics," Journal of Grid Computing, vol. 10, no. 4, pp. 769--790, 2012. {Online}. Available: http://dx.doi.org/10.1007/s10723-012-9247-y
[29]
T. Fieseler and W. G§rich, "Core d-grid infrastructure," in Grid Computing, S. Lin and E. Yen, Eds. Springer US, 2009, pp. 153--162.
[30]
I. Foster, "Globus Online: Accelerating and Democratizing Science through Cloud-Based Services," IEEE Internet Computing, vol. 15, no. 3, pp. 70--73, 2011.
[31]
I. Foster, C. Kesselman, C. Lee, B. Lindell, K. Nahrstedt, and A. Roy, "A distributed resource management architecture that supports advance reservations and co-allocation," in Quality of Service, 1999. IWQoS'99. 1999 Seventh International Workshop on. IEEE, 1999, pp. 27--36.
[32]
M. J. Litzkow, M. Livny, and M. W. Mutka, "Condor-a hunter of idle workstations," in Distributed Computing Systems, 1988., 8th International Conference on. IEEE, 1988, pp. 104--111.
[33]
J. Frey, "Condor dagman: Handling inter-job dependencies," 2002.
Index Terms
- UNICORE in XSEDE: Through Development, Integration, Deployment and beyond
Recommendations
Improvements of the UltraScan scientific gateway to enable computational jobs on large-scale and open-standards based cyberinfrastructures
XSEDE '13: Proceedings of the Conference on Extreme Science and Engineering Discovery Environment: Gateway to DiscoveryThe UltraScan data analysis application is a software package that is able to take advantage of computational resources in order to support the interpretation of analytical ultracentrifugation (AUC) experiments. Since 2006, the UltraScan scientific ...
Homogenizing OSG and XSEDE: Providing Access to XSEDE Allocations through OSG Infrastructure
PEARC '18: Proceedings of the Practice and Experience on Advanced Research Computing: Seamless CreativityWe present a system that allows individual researchers and virtual organizations (VOs) to access allocations on Stampede2 and Bridges through the Open Science Grid (OSG), a national grid infrastructure for running high throughput computing (HTC) tasks. ...
Benchmarking of Integrated OGSA-BES with the Grid Middleware
Euro-Par 2008 Workshops - Parallel ProcessingThis paper evaluates the performance of the emerging OGF standard OGSA - Basic Execution Service (BES) on three fundamentally different Grid middleware platforms: UNICORE 5/6, Globus Toolkit 4 and gLite. The particular focus within this paper is on the ...
Comments
Information & Contributors
Information
Published In
July 2014
445 pages
Copyright © 2014 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
In-Cooperation
- NSF: National Science Foundation
- Drexel University
- Indiana University: Indiana University
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 13 July 2014
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
XSEDE '14
XSEDE '14: Annual Conference of the Extreme Science and Engineering Discovery Environment
July 13 - 18, 2014
GA, Atlanta, USA
Acceptance Rates
XSEDE '14 Paper Acceptance Rate 80 of 120 submissions, 67%;
Overall Acceptance Rate 129 of 190 submissions, 68%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 51Total Downloads
- Downloads (Last 12 months)1
- Downloads (Last 6 weeks)0
Reflects downloads up to 28 Feb 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in