skip to main content
10.1145/1188455.1188708acmconferencesArticle/Chapter ViewAbstractPublication PagesscConference Proceedingsconference-collections
Article

High speed data gathering, distribution and analysis for physics discoveries at the large Hadron collider

Published:11 November 2006Publication History

ABSTRACT

The latest WAN infrastructure and Grid-based Web Services will be used to demonstrate movement and analysis of TeraByte-scale event datasets for particle physics. Optimized transfers of data over 10Gbit/sec networks linking servers and disk systems will be shown using the latest processors, PCI-Express NICs, RAID arrays and firmware. All available lambdas arriving at the SC06 show floor will be saturated, in full duplex mode. The WAN performance will be monitored using the MonALISA distributed agent-based system. A suite of Grid-enabled Analysis tools developed at Caltech, University of Florida and Michigan will be used, as will. EGEE, OSG, ATLAS and CMS data management software such as SRM, dCache, FTS, and PhEdEx. Prototypes of the latest version of parallel NFS will demonstrate excellent utilization of 10Gbit/sec connections during execution of the analysis tasks.We intend to exceed the aggregate rate of 150Gbits/sec we achieved in our SC2005 Bandwidth Challenge winning entry.

Index Terms

  1. High speed data gathering, distribution and analysis for physics discoveries at the large Hadron collider

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in
          • Published in

            cover image ACM Conferences
            SC '06: Proceedings of the 2006 ACM/IEEE conference on Supercomputing
            November 2006
            746 pages
            ISBN:0769527000
            DOI:10.1145/1188455

            Copyright © 2006 ACM

            Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            • Published: 11 November 2006

            Permissions

            Request permissions about this article.

            Request Permissions

            Check for updates

            Qualifiers

            • Article

            Acceptance Rates

            SC '06 Paper Acceptance Rate54of239submissions,23%Overall Acceptance Rate1,516of6,373submissions,24%

          HTML Format

          View this article in HTML Format .

          View HTML Format