skip to main content
10.1145/2503210.2503245acmconferencesArticle/Chapter ViewAbstractPublication PagesscConference Proceedingsconference-collections
research-article

The Science DMZ: a network design pattern for data-intensive science

Published: 17 November 2013 Publication History

Abstract

The ever-increasing scale of scientific data has become a significant challenge for researchers that rely on networks to interact with remote computing systems and transfer results to collaborators worldwide. Despite the availability of high-capacity connections, scientists struggle with inadequate cyberinfrastructure that cripples data transfer performance, and impedes scientific progress. The Science DMZ paradigm comprises a proven set of network design patterns that collectively address these problems for scientists. We explain the Science DMZ model, including network architecture, system configuration, cybersecurity, and performance tools, that creates an optimized network environment for science. We describe use cases from universities, supercomputing centers and research laboratories, highlighting the effectiveness of the Science DMZ model in diverse operational settings. In all, the Science DMZ model is a solid platform that supports any science workflow, and flexibly accommodates emerging network technologies. As a result, the Science DMZ vastly improves collaboration, accelerating scientific discovery.

References

[1]
C. Alexander. The Timeless Way of Building. Oxford University Press, New York, 1979.
[2]
C. Alexander, S. Ishikawa, and M. Silverstein. A Pattern Language: Towns, Buildings, Construction. Oxford University Press, New York, August 1977.
[3]
W. Allcock, J. Bresnahan, R. Kettimuthu, M. Link, C. Dumitrescu, I. Raicu, and I. Foster. The Globus Striped GridFTP Framework and Server. In Proceedings of the 2005 ACM/IEEE Conference on Supercomputing, SC '05, page 54, Washington, DC, USA, 2005. IEEE Computer Society.
[4]
B. Allen, J. Bresnahan, L. Childers, I. Foster, G. Kandaswamy, R. Kettimuthu, J. Kordas, M. Link, S. Martin, K. Pickett, et al. Software as a service for data scientists. Communications of the ACM, 55(2):81--88, 2012.
[5]
I. T. Association. InfiniBand. Architecture Specification Release 1.2.1 Annex A16: RoCE, 2010.
[6]
E. Gamma, R. Helm, R. Johnson, and J. Vlissides. Design patterns: elements of reusable object-oriented software. Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA, 1995.
[7]
C. Guok, D. Robertson, M. Thompson, J. Lee, B. Tierney, and W. Johnston. Intra and Interdomain Circuit Provisioning Using the OSCARS Reservation System. In Third International Conference on Broadband Communications Networks and Systems, IEEE/ICST, October 2006.
[8]
V. Jacobson, R. Braden, and D. Borman. TCP Extensions for High Performance. RFC 1323 (Proposed Standard), May 1992.
[9]
W. E. Johnston, E. Dart, M. Ernst, and B. Tierney. Enabling high throughput in widely distributed data management and analysis systems: Lessons from the LHC. In TERENA Networking Conference (TNC) 2013, June 2013.
[10]
E. Kissel, G. Fernandes, M. Jaffee, M. Swany, and M. Zhang. Driving software defined networks with xsp. In Workshop on Software Defined Networks (SDN'12), International Conference on Communications (ICC). IEEE, June 2012.
[11]
E. Kissel, B. Tierney, M. Swany, and E. Pouyoul. Efficient Data Transfer Protocols for Big Data. In Proceedings of the 8th International Conference on eScience. IEEE, July 2012.
[12]
M. Mathis, J. Semke, J. Mahdavi, and T. Ott. The macroscopic behavior of the tcp congestion avoidance algorithm. SIGCOMM Comput. Commun. Rev., 27(3):67--82, July 1997.
[13]
N. McKeown, T. Anderson, H. Balakrishnan, G. Parulkar, L. Peterson, J. Rexford, S. Shenker, and J. Turner. Openflow: enabling innovation in campus networks. SIGCOMM Comput. Commun. Rev., 38(2):69--74, Mar. 2008.
[14]
I. Monga, C. Guok, W. E. Johnston, and B. Tierney. Hybrid Networks: Lessons Learned and Future Challenges Based on ESnet4 Experience. In IEEE Communications Magazine, May 2011.
[15]
J. Postel. Transmission Control Protocol. Request for Comments (Standard) 793, Internet Engineering Task Force, September 1981.
[16]
B. Tierney, J. Boote, E. Boyd, A. Brown, M. Grigoriev, J. Metzger, M. Swany, M. Zekauskas, and J. Zurawski. perfSONAR: Instantiating a Global Network Measurement Framework. In SOSP Workshop on Real Overlays and Distributed Systems (ROADS '09), Big Sky, Montana, USA, Oct. 2009. ACM.
[17]
J. Zurawski, R. Ball, A. Barczyk, M. Binkley, J. Boote, E. Boyd, A. Brown, R. Brown, T. Lehman, S. McKee, B. Meekhof, A. Mughal, H. Newman, S. Rozsa, P. Sheldon, A. Tackett, R. Voicu, S. Wolff, and X. Yang. The dynes instrument: A description and overview. Journal of Physics: Conference Series, 396(4):042065, 2012.

Cited By

View all
  • (2024)Globus service enhancements for exascale applications and facilitiesThe International Journal of High Performance Computing Applications10.1177/1094342024128174438:6(658-670)Online publication date: 9-Sep-2024
  • (2024)Shape-shifting Elephants: Multi-modal Transport for Integrated Research InfrastructureProceedings of the 23rd ACM Workshop on Hot Topics in Networks10.1145/3696348.3696855(308-317)Online publication date: 18-Nov-2024
  • (2024)Recent Linux Improvements that Impact TCP Throughput: Insights from R&E NetworksProceedings of the SC '24 Workshops of the International Conference on High Performance Computing, Network, Storage, and Analysis10.1109/SCW63240.2024.00111(775-784)Online publication date: 17-Nov-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SC '13: Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis
November 2013
1123 pages
ISBN:9781450323789
DOI:10.1145/2503210
  • General Chair:
  • William Gropp,
  • Program Chair:
  • Satoshi Matsuoka
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 November 2013

Permissions

Request permissions for this article.

Check for updates

Qualifiers

  • Research-article

Conference

SC13
Sponsor:

Acceptance Rates

SC '13 Paper Acceptance Rate 91 of 449 submissions, 20%;
Overall Acceptance Rate 1,516 of 6,373 submissions, 24%

Upcoming Conference

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)67
  • Downloads (Last 6 weeks)12
Reflects downloads up to 18 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Globus service enhancements for exascale applications and facilitiesThe International Journal of High Performance Computing Applications10.1177/1094342024128174438:6(658-670)Online publication date: 9-Sep-2024
  • (2024)Shape-shifting Elephants: Multi-modal Transport for Integrated Research InfrastructureProceedings of the 23rd ACM Workshop on Hot Topics in Networks10.1145/3696348.3696855(308-317)Online publication date: 18-Nov-2024
  • (2024)Recent Linux Improvements that Impact TCP Throughput: Insights from R&E NetworksProceedings of the SC '24 Workshops of the International Conference on High Performance Computing, Network, Storage, and Analysis10.1109/SCW63240.2024.00111(775-784)Online publication date: 17-Nov-2024
  • (2024)SANReN's 100 Gbps Data Transfer Service: Transferring data fast!Proceedings of the SC '24 Workshops of the International Conference on High Performance Computing, Network, Storage, and Analysis10.1109/SCW63240.2024.00109(765-769)Online publication date: 17-Nov-2024
  • (2024)Understanding Data Movement Patterns in HPC: A NERSC Case StudySC24: International Conference for High Performance Computing, Networking, Storage and Analysis10.1109/SC41406.2024.00077(1-17)Online publication date: 17-Nov-2024
  • (2024)Unveiling SDN Controller Identity through Timing Side Channel2024 15th International Conference on Network of the Future (NoF)10.1109/NoF62948.2024.10741434(169-177)Online publication date: 2-Oct-2024
  • (2024)Science DMZ Networks: How Different Are They Really?2024 IEEE 49th Conference on Local Computer Networks (LCN)10.1109/LCN60385.2024.10639626(1-9)Online publication date: 8-Oct-2024
  • (2024)Strengthening Information Relay by Using a Robust IEP Between Cloud Service Suppliers2024 4th International Conference on Technological Advancements in Computational Sciences (ICTACS)10.1109/ICTACS62700.2024.10841195(1882-1887)Online publication date: 13-Nov-2024
  • (2024)Machine learning controller for data rate management in science DMZ networksComputer Networks10.1016/j.comnet.2024.110237242(110237)Online publication date: Apr-2024
  • (2024)Evaluating TCP BBRv3 performance in wired broadband networksComputer Communications10.1016/j.comcom.2024.04.037222(198-208)Online publication date: Jun-2024
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media