skip to main content
10.1145/1592568.1592592acmconferencesArticle/Chapter ViewAbstractPublication PagescommConference Proceedingsconference-collections
research-article
Free access

LIPSIN: line speed publish/subscribe inter-networking

Published: 16 August 2009 Publication History

Abstract

A large fraction of today's Internet applications are internally publish/subscribe in nature; the current architecture makes it cumbersome and inept to support them. In essence, supporting efficient publish/subscribe requires data-oriented naming, efficient multicast, and in-network caching. Deployment of native IP-based multicast has failed, and overlay-based multicast systems are inherently inefficient. We surmise that scalable and efficient publish/subscribe will require substantial architectural changes, such as moving from endpoint-oriented systems to information-centric architectures.
In this paper, we propose a novel multicast forwarding fabric, suitable for large-scale topic-based publish/subscribe. Due to very simple forwarding decisions and small forwarding tables, the fabric may be more energy efficient than the currently used ones. To understand the limitations and potential, we provide efficiency and scalability analysis via simulations and early measurements from our two implementations. We show that the system scales up to metropolitan WAN sizes, and we discuss how to interconnect separate networks.

References

[1]
Rocketfuel ISP topology data. http://www.cs.washington.edu/research/networking/rocketfuel/maps/weights-dist.tar.gz.
[2]
B. Ahlgren, L. Eggert, A. Feldmann, A. Gurtov, and T. R. Henderson. Naming and addressing for next-generation internetworks. Technical report, Dagstuhl, 2007.
[3]
M. Balakrishnan, K. Birman, A. Phanishayee, and S. Pleisch. Ricochet: Lateral Error Correction for Time-Critical Multicast. In NSDI' 07, 2007.
[4]
B. Bhargava, E. Mafla, and J. Riedl. Communication in the Raid distributed database system. Comput. Netw. ISDN Syst., 1991.
[5]
K. Birman, M. Balakrishnan, D. Dolev, T. Marian, K. Ostrowski, and A. Phanishayee. Scalable Multicast Platforms for a New Generation of Robust Distributed Applications. In COMSWARE' 07, 2007.
[6]
B. H. Bloom. Space/time trade-offs in hash coding with allowable errors. Commun. ACM, 1970.
[7]
R. Boivie, N. Feldman, Y. Imai, W. Livens, and D. Ooms. Explicit multicast (Xcast) concepts and options. IETF RFC 5058, 2007.
[8]
R. Briscoe. The implications of pervasive computing on network design. BT Technology Journal, 22(3):170--190, 2004.
[9]
A. Z. Broder and M. Mitzenmacher. Survey: Network applications of Bloom filters: A survey. Internet Mathematics, 2004.
[10]
K. L. Calvert, J. Griffioen, and L. Poutievski. Separating Routing and Forwarding: A Clean--Slate Network Layer Design. In In proc. of the Broadnets Conf., 2007.
[11]
M. Cha, P. Rodriguez, S. Moon, and J. Crowcroft. On next-generation telco-managed P2P TV architectures. In IPTPS '08, 2008.
[12]
J. Day. Patterns in Network Architecture: A Return to Fundamentals. Prentice Hall, 2008.
[13]
S. E. Deering and D. Cheriton. Multicast routing in datagram internetworks and extended LANs. ACM Trans. on Comp. Syst., 1990.
[14]
F. Dogar, A. Phanishayee, H. Pucha, O. Ruwase, and D. Andersen. Ditto -- A System for Opportunistic Caching in Multi-hop Wireless Mesh Networks. In ACM Mobicom, 2008.
[15]
P. T. Eugster, P. A. Felber, R. Guerraoui, and A.-M. Kermarrec. The many faces of publish/subscribe. ACM Comput. Surv., 2003.
[16]
P. Faratin, D. Clark, P. Gilmore, S. Bauer, A. Berger, and W. Lehr. Complexity of Internet interconnections: Technology, incentives and implications for policy. In TPRC' 07, 2007.
[17]
P. Gill, M. Arlitt, Z. Li, and A. Mahanti. YouTube Traffic Characterization: A View From the Edge. In ACM SIGCOMM IMC'07., 2007.
[18]
A. Gulli and A. Signorini. The indexable web is more than 11.5 billion pages. In WWW '05, 2005.
[19]
H. Holbrook and B. Cain. Source-specific multicast for IP. RFC 4607. 2006.
[20]
J.D.Touch and V.K.Pingali. The RNA metaprotocol. In ICCCN '08, 2008.
[21]
Z. Jerzak and C. Fetzer. Bloom filter based routing for content-based publish/subscribe. In DEBS '08, 2008.
[22]
H. T. Kaur, S. Kalyanaraman, A. Weiss, S. Kanwar, and A. Gandhi. Bananas: an evolutionary framework for explicit and multipath routing in the internet. SIGCOMM Comput. Commun. Rev., 2003.
[23]
T. Koponen, M. Chawla, B.-G. Chun, A. Ermolinskiy, K. H. Kim, S. Shenker, and I. Stoica. A data-oriented (and beyond) network architecture. In SIGCOMM '07, 2007.
[24]
H. Liu, V. Ramasubramanian, and E. G. Sirer. Client behavior and feed characteristics of RSS, a publish--subscribe system for web micronews. In IMC'05, 2005.
[25]
J. W. Lockwood, N. McKeown, G. Watson, G. Gibb, P. Hartke, J. Naous, R. Raghuraman, and J. Luo. NetFPGA-an open platform for gigabit-rate network switching and routing. In MSE '07, 2007.
[26]
E. Mannie. Generalized Multi-Protocol Label Switching (GMPLS) Architecture. RFC 3945, 2004.
[27]
A. Markopoulou, G. Iannaccone, S. Bhattacharyya, C. Chuah, and C. Diot. Characterization of failures in an IP backbone. In INFOCOM 2004, 2004.
[28]
S. Orlowski, M. Pióro, A. Tomaszewski, and R. Wessäly. SNDlib 1.0-Survivable Network Design Library. In INOC' 07, 2007.
[29]
L. B. Poutievski, K. L. Calvert, and J. N. Griffioen. Routing and forwarding with flexible addressing. Journal Of Communication and Networks, 2007.
[30]
J. Rajahalme, M. Särelä, P. Nikander, and S. Tarkoma. Incentive-compatible caching and peering in data-oriented networks. In ReArch'08, 2008.
[31]
S. Ratnasamy, A. Ermolinskiy, and S. Shenker. Revisiting IP multicast. In SIGCOMM'06, 2006.
[32]
M. Särelä, T. Rintaho, and S. Tarkoma. RTFM: Publish/subscribe internetworking architecture. ICT Mobile Summit, 2008.
[33]
J. Scott, J. Crowcroft, P. Hui, and C. Diot. Haggle: a networking architecture designed around mobile users. In Annual IFIP Conference on Wireless On-demand Network Systems and Services, 2006.
[34]
A. Sharma, A. Bestavros, and I. Matta. dPAM: a distributed prefetching protocol for scalable asynchronous multicast in P2P systems. In INFOCOM' 05, 2005.
[35]
R. Sherwood, A. Bender, and N. Spring. Discarte: a disjunctive Internet cartographer. SIGCOMM Comput. Commun. Rev., 2008.
[36]
I. Stoica, D. Adkins, S. Zhuang, S. Shenker, and S. Surana. Internet indirection infrastructure. In SIGCOMM'02, 2002.
[37]
C. A. Sunshine. Source routing in computer networks. SIGCOMM Comput. Commun. Rev., 1977.
[38]
M. Szeredi. Filesystem in Userspace. Located at http://fuse. sourceforge. net.
[39]
S. Tarkoma, D. Trossen, and M. Särelä. Black boxed rendezvous based networking. In MobiArch '08, 2008.
[40]
N. Tolia, M. Kozuch, M. Satyanarayanan, B. Karp, and T. Bressoud. Opportunistic use of content addressable storage for distributed file systems. In USENIX' 03, 2003.
[41]
D. Trossen (edit.). Architecture definition, component descriptions, and requirements. Deliverable D2.3, PSIRP project, 2009.
[42]
Y. Vigfusson, H. Abu-Libdeh, M. Balakrishnan, K. Birman, and Y. Tock. Dr. multicast: Rx for datacenter communication scalability. In HotNets-VII, 2008.
[43]
A. Whitaker and D. Wetherall. Forwarding without loops in Icarus. In Proc. of OPENARCH, 2002.
[44]
T. Wolf. A credential-based data path architecture for assurable global networking. In IEEE MILCOM, 2007.
[45]
A. Zahemszky, A. Csaszar, P. Nikander, and C. Esteve. Exploring the pubsub routing/forwarding space. In International Workshop on the Network of the Future, 2009.

Cited By

View all
  • (2024)Achieving High Efficiency for Datacenter Multicast using Skewed Bloom FilterProceedings of the 53rd International Conference on Parallel Processing10.1145/3673038.3673126(1227-1236)Online publication date: 12-Aug-2024
  • (2024)Assessment of a Semi-supervised Machine Learning Method for Thwarting Network DDoS AssaultsEvolution in Signal Processing and Telecommunication Networks10.1007/978-981-97-0644-0_28(307-318)Online publication date: 23-Apr-2024
  • (2023)Security and Privacy of IP-ICN Coexistence: A Comprehensive SurveyIEEE Communications Surveys & Tutorials10.1109/COMST.2023.329518225:4(2427-2455)Online publication date: Dec-2024
  • Show More Cited By

Index Terms

  1. LIPSIN: line speed publish/subscribe inter-networking

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image ACM Conferences
        SIGCOMM '09: Proceedings of the ACM SIGCOMM 2009 conference on Data communication
        August 2009
        340 pages
        ISBN:9781605585949
        DOI:10.1145/1592568
        • cover image ACM SIGCOMM Computer Communication Review
          ACM SIGCOMM Computer Communication Review  Volume 39, Issue 4
          SIGCOMM '09
          October 2009
          325 pages
          ISSN:0146-4833
          DOI:10.1145/1594977
          Issue’s Table of Contents
        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Sponsors

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 16 August 2009

        Permissions

        Request permissions for this article.

        Check for updates

        Author Tags

        1. bloom filters
        2. forwarding
        3. multicast
        4. publish/subscribe

        Qualifiers

        • Research-article

        Conference

        SIGCOMM '09
        Sponsor:
        SIGCOMM '09: ACM SIGCOMM 2009 Conference
        August 16 - 21, 2009
        Barcelona, Spain

        Acceptance Rates

        Overall Acceptance Rate 462 of 3,389 submissions, 14%

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)117
        • Downloads (Last 6 weeks)13
        Reflects downloads up to 10 Feb 2025

        Other Metrics

        Citations

        Cited By

        View all
        • (2024)Achieving High Efficiency for Datacenter Multicast using Skewed Bloom FilterProceedings of the 53rd International Conference on Parallel Processing10.1145/3673038.3673126(1227-1236)Online publication date: 12-Aug-2024
        • (2024)Assessment of a Semi-supervised Machine Learning Method for Thwarting Network DDoS AssaultsEvolution in Signal Processing and Telecommunication Networks10.1007/978-981-97-0644-0_28(307-318)Online publication date: 23-Apr-2024
        • (2023)Security and Privacy of IP-ICN Coexistence: A Comprehensive SurveyIEEE Communications Surveys & Tutorials10.1109/COMST.2023.329518225:4(2427-2455)Online publication date: Dec-2024
        • (2022)Preventing DDoS Flooding Attacks With Cryptographic Path Identifiers in Future InternetIEEE Transactions on Network and Service Management10.1109/TNSM.2022.314751119:2(1690-1704)Online publication date: Jun-2022
        • (2022)Forwarding and Routing With Packet SubscriptionsIEEE/ACM Transactions on Networking10.1109/TNET.2022.317206630:6(2464-2479)Online publication date: Dec-2022
        • (2020)A REVIEW ON ADAPTIVE FORWARDING IN NAMED DATA NETWORKINGInternational Journal of Engineering Technologies and Management Research10.29121/ijetmr.v5.i2.2018.6455:2(201-207)Online publication date: 2-May-2020
        • (2020)Forwarding and routing with packet subscriptionsProceedings of the 16th International Conference on emerging Networking EXperiments and Technologies10.1145/3386367.3431315(282-294)Online publication date: 23-Nov-2020
        • (2020)Achieving High Throughput for Heterogeneous Networks With Consecutive Caching and Adaptive RetrievalIEEE Transactions on Network Science and Engineering10.1109/TNSE.2020.30109397:4(2443-2455)Online publication date: 1-Oct-2020
        • (2020)DCAuth: Data-Centric Authentication for Secure In-Network Big-Data RetrievalIEEE Transactions on Network Science and Engineering10.1109/TNSE.2018.28720497:1(15-27)Online publication date: 1-Jan-2020
        • (2020)Elmo: Source Routed Multicast for Public CloudsIEEE/ACM Transactions on Networking10.1109/TNET.2020.302086928:6(2587-2600)Online publication date: Dec-2020
        • Show More Cited By

        View Options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        Login options

        Figures

        Tables

        Media

        Share

        Share

        Share this Publication link

        Share on social media