skip to main content
10.1145/2534695.2534705acmconferencesArticle/Chapter ViewAbstractPublication PagesscConference Proceedingsconference-collections
research-article

End-to-end data movement using MPI-IO over routed terabits infrastructures

Published: 17 November 2013 Publication History

Abstract

Scientific discovery is nowadays driven by large-scale simulations running on massively parallel high-performance computing (HPC) systems. These applications each generate a large amount of data, which then needs to be post-processed for example for data mining or visualization. Unfortunately, the computing platform used for post processing might be different from the one on which the data is initially generated, introducing the challenge of moving large amount of data between computing platforms. This is especially challenging when these two platforms are geographically separated since the data needs to be moved between computing facilities. This is even more critical when scientists tightly couple their domain specific applications with a post processing application.
The paper presents a solution for the data transfer between MPI applications using a dedicated wide area network (WAN) terabit infrastructure. The proposed solution is based on parallel access to data files and the Message Passing Interface (MPI) over the Common Communication Infrastructure (CCI) for the data transfer over a routed infrastructure. In the context of this research, the Energy Sciences Network (ESnet) of the U.S. Department of Energy (DOE) is targeted for the transfer of data between DOE national laboratories.

References

[1]
W. Allcock, J. Bresnahan, R. Kettimuthu, M. Link, C. Dumitrescu, I. Raicu, and I. Foster. The Globus Striped GridFTP Framework and Server. In Proceedings of the 2005 ACM/IEEE conference on Supercomputing, SC '05, pages 54--, Washington, DC, USA, 2005. IEEE Computer Society.
[2]
S. Atchley, D. Dillow, G. M. Shipman, P. Geoffray, J. M. Squyres, G. Bosilca, and R. Minnich. The Common Communication Interface (CCI). In Hot Interconnects, pages 51--60. IEEE, 2011.
[3]
T. M. Forum. MPI: A Message Passing Interface, 1993.
[4]
I. Foster and C. Kesselman. Globus: A Metacomputing Infrastructure Toolkit. International Journal of Supercomputer Applications, 11: 115--128, 1996.
[5]
A. Hanushevsky, A. Trunov, and L. Cottrell. Peer-to-Peer Computing for Secure High Performance Data Copying. In In Proc. of the 2001 Int. Conf. on Computing in High Energy and Nuclear Physics (CHEP 2001), Beijng, 2001.
[6]
Y. Kim, S. Atchley, G. R. Vallée, and G. M. Shipman. Layout-Aware I/O Scheduling for Terabits Data Movement. In To Appear in Proceedings of ithe Workshop on Distributed Storage Systems and Coding for BigData (DSSCB 2013), Oct. 6--9, 2013. Held in conjunction with the 2013 IEEE International Conference on Big Data (IEEE BigData 2013).
[7]
C. Pérez, T. Priol, and A. Ribes. A Parallel CORBA Component Model for Numerical Code Coupling. In M. Parashar, editor, GRID, volume 2536 of Lecture Notes in Computer Science, pages 88--99. Springer, 2002.
[8]
Y. Ren, T. Li, D. Yu, S. Jin, and T. Robertazzi. Middleware Support for RDMA-based Data Transfer in Cloud Computing. In Proceedings of the 2012 IEEE 26th International Parallel and Distributed Processing Symposium Workshops & PhD Forum, IPDPSW '12, pages 1095--1103, Washington, DC, USA, 2012. IEEE Computer Society.

Cited By

View all
  • (2019)FTLADS: Object-Logging based Fault-Tolerant Big Data Transfer System using Layout Aware Data SchedulingIEEE Access10.1109/ACCESS.2019.2905158(1-1)Online publication date: 2019
  • (2017)Optimizing End-to-End Big Data Transfers over Terabits Network InfrastructureIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2016.255043928:1(188-201)Online publication date: 1-Jan-2017
  • (2015)LADSProceedings of the 13th USENIX Conference on File and Storage Technologies10.5555/2750482.2750488(67-80)Online publication date: 16-Feb-2015

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
NDM '13: Proceedings of the Third International Workshop on Network-Aware Data Management
November 2013
84 pages
ISBN:9781450325226
DOI:10.1145/2534695
  • General Chairs:
  • Mehmet Balman,
  • Surendra Byna,
  • Brian L. Tierney
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 November 2013

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. networking
  2. performance measurement

Qualifiers

  • Research-article

Funding Sources

Conference

SC13

Acceptance Rates

NDM '13 Paper Acceptance Rate 9 of 14 submissions, 64%;
Overall Acceptance Rate 14 of 23 submissions, 61%

Upcoming Conference

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)2
  • Downloads (Last 6 weeks)0
Reflects downloads up to 17 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2019)FTLADS: Object-Logging based Fault-Tolerant Big Data Transfer System using Layout Aware Data SchedulingIEEE Access10.1109/ACCESS.2019.2905158(1-1)Online publication date: 2019
  • (2017)Optimizing End-to-End Big Data Transfers over Terabits Network InfrastructureIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2016.255043928:1(188-201)Online publication date: 1-Jan-2017
  • (2015)LADSProceedings of the 13th USENIX Conference on File and Storage Technologies10.5555/2750482.2750488(67-80)Online publication date: 16-Feb-2015

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media