Abstract
The world’s largest machine, the Large Hadron Collider, will have four detectors whose output is expected to answer fundamental questions about the universe. The ATLAS detector is expected to produce 3.2 PB of data per year which will be distributed to storage elements all over the world. In 2008 the resource need is estimated to be 16.9 PB of tape, 25.4 PB of disk, and 50 MSI2k of CPU. Grids are used to simulate, access, and process the data. Sites in several European and non-European countries are connected with the Advanced Resource Connector (ARC) middleware of NorduGrid. In the first half of 2006 about 105 simulation jobs with 27 TB of distributed output organized in some 105 files and 740 datasets were performed on this grid. ARC’s data management capabilities, the Globus Replica Location Service, and ATLAS software were combined to achieve a comprehensive distributed data management system.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
The LHC Study Group: The Large Hadron Collider, Conceptual Design, CERN-AC-95-05 LHC (1995)
ATLAS Collaboration: Detector and Physics Performance Technical Design Report, CERN-LHCC-99-14 (1999)
ATLAS Collaboration: ATLAS Computing Technical Design Report, CERN-LHCC-2005-022 (2005)
Knobloch, J. (ed.): LHC Computing Grid - Technical Design Report, CERN-LHCC-2005-024 (2005)
Open Science Grid Homepage: http://www.opensciencegrid.org
NorduGrid Homepage: http://www.nordugrid.org
Goosesens, L., et al.: ATLAS Production System in ATLAS Data Challenge 2, CHEP 2004, Interlaken, contribution, no. 501
ATLAS Collaboration: ATLAS Computing Technical Design Report, CERN-LHCC-2005 -022, p. 115 (2005)
Nielsen, J., et al.: Experiences with Data Indexing Services supported by the NorduGrid Middleware. In: CHEP 2004, Interlaken, contribution, no. 253
Konstantinov, A., et al.: Data management services of NorduGrid, CERN-2005-002, vol. 2, p. 765 (2005)
Branco, M.: Don Quijote - Data Management for the ATLAS Automatic Production System, CERN-2005 -002, p. 661 (2005)
NorduGrid Collaboration: Performance of the NorduGrid ARC and the Dulcinea Executor in ATLAS Data Challenge 2, CERN-2005-002, vol. 2, p. 1095 (2005)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Haug, S., Ould-Saada, F., Pajchel, K., Read, A.L. (2007). Data Management for the World’s Largest Machine. In: Kågström, B., Elmroth, E., Dongarra, J., Waśniewski, J. (eds) Applied Parallel Computing. State of the Art in Scientific Computing. PARA 2006. Lecture Notes in Computer Science, vol 4699. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-75755-9_58
Download citation
DOI: https://doi.org/10.1007/978-3-540-75755-9_58
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-75754-2
Online ISBN: 978-3-540-75755-9
eBook Packages: Computer ScienceComputer Science (R0)