Abstract
The growth of high-speed wide area networks (WANs) has enabled the emergence of new classes of data intensive, wide area computing applications, such as the remote analysis and exploration of data and distributed data mining. The de facto standard for reliable data transfers is the Transmission Control Protocol (TCP). Despite improvements in TCP over the years (to reduce overhead and achieve higher throughput), it is still a common experience for the end-to-end data rates of wide area data mining and data analysis applications to be inefficient. This paper introduces a library called SABUL (Simple Available Bandwidth Utilization Library) which merges features of UDP and TCP to produce a light-weight protocol with flow control, rate control and reliable transmission mechanisms that is designed for data intensive applications over wide area high performance networks. In this paper, we describe the library and give experimental evidence of its effectiveness.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
A.Chien, T.Faber, A. Falk, J. Bannister, R. Grossman, and J. Leigh. Transport protocols for high performance: Whither tcp? Communications of the ACM, to appear.
S.Floyd. Connections with multiple congested gateways in packet-switched networks part1: One-way traffic. Computer Cummunications Review, 21(5):30–47, 1991.
I.Foster and C.Kesselman. The Grid: Blueprint for a New Computing Infrastructure. Morgan Kaufmann, San Francisco, 1998.
Globus data grid. Retrieved from http://www.globus.org//datagrid, September 2, 2002.
Robert Grossman and Marco Mazzucco. Dataspace—a web infrastructure for the exploratory analysis and mining of data. IEEE Computing in Science and Engineering, pp. 44–51, July/August, 2002.
2R. L. Grossman, H.Sivakumar, and S. Bailey. Psockets: The case for application-level network striping for data intensive applications using high speed wide area networks. In Proceedings of Supercomputing 2000, November, 2000.
H. Kargupta and P. Chan (ed.). Advances in Distributed and Parallel Knowledge Discovery. AAAI Press/The MIT Press, Menlo Park, California, 2000.
M. Mathis T. Ott, and J. Kemperman. Window size behavior in tcp/ip with constant loss probability. In DIMACS Workshop on Performance of Realtime Applications on the Internet, November 6, 1996.
R. W. Watson and R. A. Coyne. The parallel i/0 architecture of the high performance storage system (hpss). In Proceedings of of the 14th IEEE Symp. Mass Storage Systems, 1995.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Grossman, R.L., Mazzucco, M., Sivakumar, H. et al. Simple Available Bandwidth Utilization Library for High-Speed Wide Area Networks. J Supercomput 34, 231–242 (2005). https://doi.org/10.1007/s11227-005-1167-1
Issue Date:
DOI: https://doi.org/10.1007/s11227-005-1167-1