Abstract
This paper proposes the idea of emulating fat-trees in overlays for multi-source multicast applications. Fat-trees are like real trees in that their branches become thicker the closer one gets to the root, thus overcoming the “root bottleneck” of regular trees. We introduce FatNemo, a novel overlay multi-source multicast protocol based on this idea. FatNemo organizes its members into a tree of clusters with cluster sizes increasing closer to the root. It uses bandwidth capacity to decide the highest layer in which a peer can participate, and relies on co-leaders to share the forwarding responsibility and to increase the tree’s resilience to path and node failures.
We present the design of FatNemo and show simulation-based experimental results comparing its performance with that of three alternative protocols (Narada, Nice and Nice-PRM). These initial results show that FatNemo not only minimizes the average and standard deviation of response time, but also handles end host failures gracefully with minimum performance penalty.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Banerjee, S., Bhattacharjee, B.: A comparative study of application layer multicast protocols (2002) (submitted for review)
Banerjee, S., Bhattacharjee, B., Kommareddy, C.: Scalable application layer multicast. In: Proc. of ACM SIGCOMM (August 2002)
Banerjee, S., Lee, S., Bhattacharjee, B., Srinivasan, A.: Resilient multicast using overlays. In: Proc. of ACM SIGMETRICS (June 2003)
Bawa, M., Deshpande, H., Garcia-Molina, H.: Transience of peers & streaming media. In: Proc. of HotNets-I (October 2002)
Birrer, S., Bustamante, F.E.: Nemo - resilient peer-to-peer multicast without the cost. Tech. Report NWU-CS-04-36, Northwestern U. (April 2004)
Blahut, R.E.: Theory and Practice of Error Control Codes. Addison Wesley, Reading (1994)
Bustamante, F.E., Qiao, Y.: Friendships that last: Peer lifespan and its role in P2P protocols. In: Proc. of IWCW (October 2003)
Calvert, K.L., Doar, M.B., Zegura, E.W.: Modeling internet topology. IEEE Communications Magazine 35(6), 160–163 (1997)
Castro, M., Druschel, P., Kermarrec, A.-M., Nandi, A., Rowstron, A., Singh, A.: Splitstream: High-bandwidth multicast in cooperative environments. In: Proc. of the 19th ACM SOSP (October 2003)
Castro, M., Rowstron, A., Kermarrec, A.-M., Druschel, P.: SCRIBE: A large-scale and decentralised application-level multicast infrastructure. IEEE Journal on Selected Areas in Communication 20(8) (2002)
Chawathe, Y.: Scattercast: an architecture for Internet broadcast distribution as an infrastructure service. Ph.D. Thesis, U. of California, Berkeley, CA, Fall (2000)
Chu, Y.-H., Ganjam, A., Ng, T.S.E., Rao, S.G., Sripanidkulchai, K., Zhan, J., Zhang, H.: Early experience with an Internet broadcast system based on overlay multicast. In: Proc. of USENIX ATC (June 2004)
Chu, Y.-H., Rao, S.G., Seshan, S., Zhang, H.: A case for end system multicast. IEEE Journal on Selected Areas in Communication 20(8) (October 2002)
Chu, Y.-H., Rao, S.G., Zhang, H.: A case for end system multicast. In: Proc. of ACM SIGMETRICS (June 2000)
Cohen, B.: BitTorrent File distribution (2001), bitconjurer.org/BitTorrent/
Deering, S.E.: Multicast routing in internetworks and extended LANs. In: Proc. of ACM SIGCOMM (August 1988)
Diot, C., Levine, B.N., Lyles, B., Kassem, H., Balensiefen, D.: Deployment issues for the IP multicast service and architecture. IEEE Network 14(1) (January/February 2000)
Doar, M.B.: A better model for generating test networks. In: Proc. of Globecom (November 1996)
Francis, P.: Yoid: Extending the Internet multicast architecture (April 2000), http://www.aciri.org/yoid
Gummadi, K.P., Dunn, R.J., Saroiu, S., Gribble, S.D., Levy, H.M., Zahorjan, J.: Measurement, modeling and analysis of a peer-to-peer file-sharing workload. In: Proc. of ACM SOSP (December 2003)
Hinrichs, S., Kosak, C., O’Hallaron, D., Stricker, T., Take, R.: An architecture for optimimal all-to-all personalized communication. In: Proceedings of the 6th ACM Symposium on Parallel Algorithms and Architectures (SPAA), pp. 310–319 (1994)
Homewood, M., McLaren, M.: Meiko CS-2 interconnect elan – elite design. In: IEEE Hot Interconnects Symposium (August 1993)
InfiniBand Trade Association. Infiniband architecture specification (1.0.a) (June 2001), www.infinibandta.com
Jannotti, J., Gifford, D.K., Johnson, K.L., Kaashoek, M.F., O’Toole Jr., J.W.: Overcast: Reliable multicasting with and overlay network. In: Proc. of the 4th USENIX OSDI (October 2000)
Kostić, D., Adn Jeannie Albrecht, A.R., Vahdat, A.: Bullet: High bandwidth data dissemination using an overlay mesh. In: Proc. of the 19th ACM SOSP (October 2003)
Leighton, T.: Introduction to Parallel Algorithms and Architectures: Arrays, Trees, Hypercubes. Morgan Kaufmann, San Francisco (1992)
Leiserson, C.E.: Fat-trees: Universal networks for hardware-efficient supercomputing. IEEE Transactions on Computers 34(10), 892–901 (1985)
Leiserson, C.E., Abuhamdeh, Z.S., Douglas, D.C., Feynman, C.R., Ganmukhi, M.N., Hill, J.V., Hillis, W.D., Kuszmaul, B.C., Pierre, M.A.S., Wells, D.S., Wong-Chan, M.C., Yang, S.-W., Zak, R.: The network architecture of the Connection Machine CM-5. Journal of Parallel and Distributed Computing 33(2), 145–158 (1996)
Lu, D., Dinda, P.A.: GridG: Generating realistic computational grids. ACM Sigmetrics Performance Evaluation Review 30(4), 33–41 (2003)
Lu, D., Dinda, P.A.: Synthesizing realistic computational grids. In: Lim, J.-I., Lee, D.-H. (eds.) ICISC 2003. LNCS, vol. 2971, Springer, Heidelberg (2004)
Padmanabhan, V.N., Wang, H.J., Chou, P.A.: Resilient peer-to-peer streaming. In: Proc. of IEEE ICNP (2003)
Pendarakis, D., Shi, S., Verma, D., Waldvogel, M.: ALMI: An application level multicast infrastructure. In: Proc. of USENIX USITS (March 2001)
Ratnasamy, S., Handley, M., Karp, R., Shenker, S.: Application-level multicast using contentaddressable networks. In: Proc. of NGC (November 2001)
Rhea, S., Geels, D., Roscoe, T., Kubiatowicz, J.: Handling churn in a DHT. In: Proc. of USENIX ATC (December 2004)
Tran, D.A., Hua, K.A., Do., T.: ZIGZAG: An efficient peer-to-peer scheme for media streaming. In: Proc. of IEEE INFOCOM (April 2003)
Wang, Z., Crowcroft, J.: Bandwidth-delay based routing algorithms. In: Proc. of IEEE GlobeCom (November 1995)
Xu, J., Kalbarczyk, Z., Iyer, R.K.: Networked Windows NT system field failure data analysis. In: Proc. of PRDC (December 1999)
Yang, M., Fei, Z.: A proactive approach to reconstructing overlay multicast trees. In: Proc. of IEEE INFOCOM (March 2004)
Zhuang, S.Q., Zhao, B.Y., Joseph, A.D., Katz, R.H., Kubiatowicz, J.D.: Bayeux:An architecture for scalable and fault-tolerant wide-area data dissemination. In: Proc. of NOSSDAV (June 2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Birrer, S., Lu, D., Bustamante, F.E., Qiao, Y., Dinda, P. (2004). FatNemo: Building a Resilient Multi-source Multicast Fat-Tree. In: Chi, CH., van Steen, M., Wills, C. (eds) Web Content Caching and Distribution. WCW 2004. Lecture Notes in Computer Science, vol 3293. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30471-5_14
Download citation
DOI: https://doi.org/10.1007/978-3-540-30471-5_14
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-23516-3
Online ISBN: 978-3-540-30471-5
eBook Packages: Springer Book Archive