Abstract
Communication optimization plays an important role in building networked distributed applications. In this paper, we systematically evaluate four bandwidth reduction algorithms, namely direct sending, delta-encoding, fix-sized blocking, and vary-sized blocking, using five types of documents including source code, images, Web contents, Microsoft Word documents, and Latex files. The experiments were performed under four representative network connection technologies. Performance evaluation results show that different approaches have different performance in terms of different metrics. Completely different results can be achieved by the same algorithm with respect to different types of documents. Network condition can affect some algorithms substantially. Furthermore, the effect of block size to the system performance (for block-based algorithms) was also studied.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Mogul, J.C., Douglis, F., Feldmann, A., Krishnamurthy, B.: Potential Benefits of Delta- Encoding and Data Compression for HTTP. In: Proc. of the 13th ACM SIGCOMM 1997, pp. 181–194 (1997)
Tridgell, P., Mackerras, P.: The rsync algorithm. Technical Report TR-CS-96-05, Department of Computer Science, Australian National University (1996)
Muthitacharoen, A., Chen, B., Mazières, D.: A low-bandwidth network file system. In: Proc. of the 18th ACM Symp. on Operating Systems Principles, SOSP-18 (2001)
Korn, D.G., Vo, K.P.: Engineering a differencing and compression data format. In: Proceedings of the 2002 USENIX Annual Technical Conference (2002)
Rabin, M.O.: Fingerprinting by random polynomials. Technical Report TR-15-81, Harvard Aiken Computation laboratory (1981)
Gzip tool, http://www.gzip.org
Shi, W., Wright, R., Collins, E., Karamcheti, V.: Workload characterization of a personalized web site—and it’s implication on dynamic content caching. In: Proc. of the 7th International Workshop on Web Caching and Content Distribution (WCW 2002), pp. 1–16 (2002)
Shi, W., Collins, E., Karamcheti, V.: Modeling object characteristics of dynamic web content. Journal of Parallel and Distributed Computing 63, 963–980 (2003)
Wills, C.E., Mikhailov, M.: Studying the impact of more complete server information on web caching. In: Proc. of the 5th International Workshop on Web Caching and Content Distribution, WCW 2000 (2000)
Shi, W., Lufei, H., Santhosh, S.: Cegor: An adaptive, distributed file system for heterogeneous network environments. In: Proceedings of the tenth International Conferences on Parallel and Distributed Systems (2004)
Lufei, H., Shi, W.: On the effects of bandwidth reduction techniques. Technical Report MIST-TR-2003-006, Department of Computer Science, Wayne State University (2003)
Lufei, H., Shi, W., Zamorano, L.: A comparison of different data compression approaches in computer-assisted surgery. Technical Report MIST-TR-2004-007, Department of Computer Science, Wayne State University (2004)
Tolia, N., Kozuch, M., Satyanarayanan, M., Karp, B., Bressoud, T., Perrig, A.: Opportunistic use of content addressable storage for distributed file systems. In: Proc. of the USENIX 2003 Annual Technical Conf. (2003)
Rhea, S., Eaton, P., Geels, D., Weatherspoon, H., Zhao, B., Kubiatowicz, J.: Pond: The oceanstore prototype. In: Proc. of the 2nd USENIX Conf. On File and Storage Technologies, pp. 1–14 (2003)
Cox, L.P., Murray, C.D., Noble, B.D.: Pastiche: Making backup cheap and easy. In: Proc. of the Fifth USENIX Symposium on Operating Systems Design and Implementation (2002)
Spring, N.T., Wetherall, D.: A protocol independent technique for eliminating redundant network traffic. In: Proc. of ACM SIGCOMM 2000, pp. 87–95 (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lufei, H., Shi, W., Zamorano, L. (2004). On the Effects of Bandwidth Reduction Techniques in Distributed Applications. In: Yang, L.T., Guo, M., Gao, G.R., Jha, N.K. (eds) Embedded and Ubiquitous Computing. EUC 2004. Lecture Notes in Computer Science, vol 3207. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30121-9_76
Download citation
DOI: https://doi.org/10.1007/978-3-540-30121-9_76
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-22906-3
Online ISBN: 978-3-540-30121-9
eBook Packages: Springer Book Archive