short-paper

File Spooler and Copy System for Fast Data Transfer

Authors:

Alice Florența Șuiu,

Mihai Carabaș,

Costin Grigoraș,

Nicolae ȚăpușAuthors Info & Claims

ECBS 2021: 7th Conference on the Engineering of Computer Based Systems

Article No.: 18, Pages 1 - 5

https://doi.org/10.1145/3459960.3461559

Published: 27 May 2021 Publication History

Abstract

CERN (derived from Conseil européen pour la recherche nucléaire) is a European research organization in nuclear physics, which has particle accelerators and other infrastructures necessary for high-energy physics research.

ALICE (A Large Ion Collider Experiment) is a heavy-ion detector on the Large Hadron Collider ring.

The paper consists of a design solution for a File Spooler and Copy System for the data stored in volatile storage (like local SSDs). The system will manage the data on the local SSDs, and copy them asynchronously to persistent storage, check consistency and remove the copied files from the volatile storage. Also, the paper highlights the tasks that the File Spooler and Copy System must perform to provide a scalable and reliable file transfer.

References

[1]

ANDREW W. APPEL. [n.d.]. Verification of a Cryptographic Primitive: SHA-256. https://www.cs.princeton.edu/~appel/papers/verif-sha.pdf. Last accessed: 12 February 2021.

Digital Library

[2]

Google Cloud. [n.d.]. Implementing exponential backoff. https://cloud.google.com/iot/docs/how-tos/exponential-backoff. Last accessed: 12 February 2021.

[3]

Alvise Dorigo Peter Elmer Fabrizio Furano, Andrew Hanushevsky. [n.d.]. Xrootd - a highly scalable architecture for data access. https://www.quickhash-gui.org/what-is-the-newly-added-xxhash-algorithm/. Last accessed: 12 February 2021.

[4]

QuickHash GUI. [n.d.]. What is the newly added xxHash algorithm?https://www.quickhash-gui.org/what-is-the-newly-added-xxhash-algorithm/. Last accessed: 12 February 2021.

[5]

Mihai Carabas Maria-Elena Mihailescu Sergiu Weisz Nicolae Tapus Ionuţ Mihalache, Costin Grigoras. [n.d.]. File Spooler and Copy System for Fast Data Transfer. https://dl.acm.org/doi/10.1145/3423390.3423403. Last accessed: 12 February 2021.

[6]

M.Litmaath L. Betev. [n.d.]. ALICE Upgrade report. https://indico.cern.ch/event/778465/contributions/3245315/attachments/1844447/3025854/ALICE_upgrde.pdf. Last accessed: 12 February 2021.

[7]

P. Hristov-T. Kollegger C.Kouzinopoulos A. Lebedev V. Lindenstruth A. Manafov M.Richter A. Rybalchenko P. Vande Vyvre N. Winckler M. Al-Turany, P. Buncic. [n.d.]. ALFA: The new ALICE-FAIR software framework. https://iopscience.iop.org/article/10.1088/1742-6596/664/7/072001/pdf. Last accessed: 20 March 2021.

[8]

Mihai Darius Margineanu Cristian, Mihai Carabas. [n.d.]. Client request analysis tool for CERN ALICE Grid Services. . Last accessed: 12 February 2021.

[9]

Theresa Maxino. [n.d.]. Revisiting Fletcher and Adler Checksums. https://kilthub.cmu.edu/articles/journal_contribution/Revisiting_Fletcher_and_Adler_Checksums/6625619. Last accessed: 12 February 2021.

[10]

University of Southern California Information Sciences Institute. [n.d.]. Transmission control protocol. https://tools.ietf.org/html/rfc793. Last accessed: 12 February 2021.

[11]

JAVA ORACLE. [n.d.]. Class socket. https://cds.cern.ch/record/2747109. Last accessed: 12 February 2021.

[12]

CERN Organization. [n.d.]. The ALICE detector’s First Level Processor (FLP) system. https://cds.cern.ch/record/2747109. Last accessed: 20 March 2021.

[13]

CERN Organization. [n.d.]. ALICE detects quark-gluon plasma, a state of matter thought to have formed just after the big bang. https://home.cern/science/experiments/alice. Last accessed: 12 February 2021.

[14]

CERN Organization. [n.d.]. CERN Accelerating science. https://home.cern/about. Last accessed: 12 February 2021.

[15]

CERN Organization. [n.d.]. EOS - Open Storage Documentation. https://eos-docs.web.cern.ch/intro.html. Last accessed: 12 February 2021.

[16]

CERN Organization. [n.d.]. Fast Data Transfer - FDT. http://monalisa.cern.ch/FDT/. Last accessed: 12 February 2021.

[17]

Andreas-Joachim Peters. [n.d.]. Checksum Support. https://indico.cern.ch/event/862873/contributions/3724456/attachments/1981284/3299538/EOS_2020_WS_Checksum_Support.pdf. Last accessed: 12 February 2021.

[18]

Barthélémyvon Haller PiotrKonopka. [n.d.]. The ALICE O2data quality control system. https://inspirehep.net/files/a52ba6ddbbe69358031723a736f8df93. Last accessed: 12 February 2021.

[19]

Matthias Richter. [n.d.]. Data handling in the ALICE O2 event processing. . Last accessed: 20 March 2021.

[20]

Matthias Richter. [n.d.]. A design study for the upgraded ALICE O2 computing facility. https://iopscience.iop.org/article/10.1088/1742-6596/664/8/082046/pdf. Last accessed: 20 March 2021.

[21]

Alexey Rybalchenko. [n.d.]. FairMQ Data Transport for Online & Offline Processing. . Last accessed: 20 March 2021.

[22]

Farhad Ahmed Sagar. [n.d.]. Cryptographic Hashing Functions - MD5. http://cs.indstate.edu/~fsagar/doc/paper.pdf. Last accessed: 12 February 2021.

Cited By

Şuiu AGrigoraş CŢapuş NBetev L(2023)Automatic Data Workflow and Disk Management Tool for the ALICE Experiment2023 IEEE 19th International Conference on Intelligent Computer Communication and Processing (ICCP)10.1109/ICCP60212.2023.10398714(137-143)Online publication date: 26-Oct-2023
https://doi.org/10.1109/ICCP60212.2023.10398714
Vardalachakis MKondylakis HTampouratzis MPapadakis NMastorakis N(2023)Anonymization, Hashing and Data Encryption Techniques: A Comparative Case Study2023 International Conference on Applied Mathematics & Computer Science (ICAMCS)10.1109/ICAMCS59110.2023.00028(129-135)Online publication date: 8-Aug-2023
https://doi.org/10.1109/ICAMCS59110.2023.00028

Recommendations

File Spooler and Copy System for Fast Data Transfer
ICACS '20: Proceedings of the 4th International Conference on Algorithms, Computing and Systems

The ALICE (A Large Ion Collider Experiment) experiment at the CERN (European Organization for Nuclear Research) LHC (Large Hadron Collider) is preparing for the LHC Run3, beginning in 2021, with a detector and computing upgrade. On the computing side, a ...
A multiple-file write scheme for improving write performance of small files in Fast File System

Fast File System (FFS) stores files to disk in separate disk writes, each of which incurs a disk positioning (seek + rotation) limiting the write performance for small files. We propose a new scheme called co-writing to accelerate small file writes in ...
The zebra striped network file system

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

ECBS 2021: 7th Conference on the Engineering of Computer Based Systems

May 2021

168 pages

ISBN:9781450390576

DOI:10.1145/3459960

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 May 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper
Research
Refereed limited

Conference

ECBS 2021

ECBS 2021: 7th Conference on the Engineering of Computer Based Systems

May 26 - 27, 2021

Novi Sad, Serbia

Acceptance Rates

Overall Acceptance Rate 25 of 49 submissions, 51%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
38
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Şuiu AGrigoraş CŢapuş NBetev L(2023)Automatic Data Workflow and Disk Management Tool for the ALICE Experiment2023 IEEE 19th International Conference on Intelligent Computer Communication and Processing (ICCP)10.1109/ICCP60212.2023.10398714(137-143)Online publication date: 26-Oct-2023
https://doi.org/10.1109/ICCP60212.2023.10398714
Vardalachakis MKondylakis HTampouratzis MPapadakis NMastorakis N(2023)Anonymization, Hashing and Data Encryption Techniques: A Comparative Case Study2023 International Conference on Applied Mathematics & Computer Science (ICAMCS)10.1109/ICAMCS59110.2023.00028(129-135)Online publication date: 8-Aug-2023
https://doi.org/10.1109/ICAMCS59110.2023.00028

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten