Skip to main content

Scribe: The Design of a Large-Scale Event Notification Infrastructure

  • Conference paper
  • First Online:
Book cover Networked Group Communication (NGC 2001)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2233))

Included in the following conference series:

Abstract

This paper presents Scribe, a large-scale event notification infrastructure for topic-based publish-subscribe applications. Scribe supports large numbers of topics, with a potentiallylarge number of subscribers per topic. Scribe is built on top of Pastry, a generic peer-topeer object location and routing substrate overlayed on the Internet, and leverages Pastry’s reliability, self-organization and locality properties. Pastryi s used to create a topic (group) and to build an efficient multicast tree for the dissemination of events to the topic’s subscribers (members). Scribe provides weak reliabilitygu arantees, but we outline how an application can extend Scribe to provide stronger ones.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Talarian Corporation. Everything You need to know about Middleware: Mission-Critical Interprocess Communication (White Paper). http://www.talarian.com/, 1999.

  2. TIBCO. TIB/Rendezvous White Paper. http://www.rv.tibco.com/whitepaper.html, 1999.

  3. P.T. Eugster, P. Felber, R. Guerraoui, and A.-M. Kermarrec. The manyfaces of publish/subscribe. Technical Report DSC ID:2000104, EPFL, January 2001.

    Google Scholar 

  4. S. Floyd, V. Jacobson, C.G. liu, S. McCanne, and L. Zhang. A reliable multicast framework for light-weight sessions and application level framing. IEEE/ACM Transaction on networking, pages 784–803, December 1997.

    Google Scholar 

  5. J.C. Lin and S. Paul. A reliable multicast transport protocol. In Proc. of IEEE INFOCOM’96, pages 1414–1424, 1996.

    Google Scholar 

  6. S. Deering and D. Cheriton. Multicast Routing in Datagram Internetworks and Extended LANs. ACM Transactions on Computer Systems, 8(2), May 1990.

    Google Scholar 

  7. S. Deering, D. Estrin, D. Farinacci, V. Jacobson, C. Liu, and L. Wei. The PIM Architecture for Wide-Area Multicast Routing. IEEE/ACM Transactions on Networking, 4(2), April 1996.

    Google Scholar 

  8. K.P. Birman, M. Hayden, O. Ozkasap, Z. Xiao, M. Budiu, and Y. Minsky. Bimodal multicast. ACM Transactions on Computer Systems, 17(2):41–88, May 1999.

    Article  Google Scholar 

  9. Patrick Eugster, Sidath Handurukande, Rachid Guerraoui, Anne-Marie Kermarrec, and Petr Kouznetsov. Lightweight probabilistic broadcast. In Proceedings of The International Conference on Dependable Systems and Networks (DSN 2001), July 2001.

    Google Scholar 

  10. Luis F. Cabrera, Michael B. Jones, and Marvin Theimer. Herald: Achieving a global event notification service. In HotOS VIII, May 2001.

    Google Scholar 

  11. Shelly Q. Zhuang, Ben Y. Zhao, Anthony D. Joseph, Randy H. Katz, and John Kubiatowicz. Bayeux: An Architecture for Scalable and Fault-tolerant Wide-Area Data Dissemination. In Proc. of the Eleventh International Workshop on Network and Operating System Support for Digital Audio and Video (NOSSDAV 2001), June 2001.

    Google Scholar 

  12. Antony Rowstron and Peter Druschel. Pastry: Scalable, distributed object location and routing for large-scale peer-to-peer systems. In Proc. IFIP/ACM Middleware 2001, Heidelberg, Germany, November 2001.

    Google Scholar 

  13. Ben Y. Zhao, John D. Kubiatowicz, and Anthony D. Joseph. Tapestry: An infrastructure for fault-resilient wide-area location and routing. Technical Report UCB//CSD-01-1141, U. C. Berkeley, April 2001.

    Google Scholar 

  14. I. Stoica, R. Morris, D. Karger, M. F. Kaashoek, and H. Balakrishnan. Chord: A scalable peer-to-peer lookup service for Internet applications. In Proc. ACM SIGCOMM 2001, San Diego, CA, August 2001.

    Google Scholar 

  15. S. Ratnasamy, P. Francis, M. Handley, R. Karp, and S. Shenker. A Scalable Content-Addressable Network. In Proc. of ACM SIGCOMM, August 2001.

    Google Scholar 

  16. E. Zegura, K. Calvert, and S. Bhattacharjee. How to model an internetwork. In INFOCOM96, 1996.

    Google Scholar 

  17. Peter Druschel and Antony Rowstron. PAST: A persistent and anonymous store. In HotOS VIII, May 2001.

    Google Scholar 

  18. Antony Rowstron and Peter Druschel. Storage management and caching in PAST, a large-scale, persistent peer-to-peer storage utility. In Proc. ACM SOSP 2001, Ban., Canada, October 2001.

    Google Scholar 

  19. FIPS 180-1. Secure hash standard. Technical Report Publication 180-1, Federal Information Processing Standard (FIPS), National Institute of Standards and Technology, US Department of Commerce, Washington D.C., April 1995.

    Google Scholar 

  20. Yogen K. Dalal and Robert Metcalfe. Reverse path forwarding of broadcast packets. Communications of the ACM, 21(12):1040–1048, 1978.

    Article  MATH  Google Scholar 

  21. L. Lamport. The Part-Time Parliament. Report Research Report 49, Digital Equipment Corporation Systems Research Center, Palo Alto, CA, September 1989.

    Google Scholar 

  22. John Jannotti, David K. Gifford, Kirk L. Johnson, M. Frans Kaashoek, and James W. O’Toole. Overcast: Reliable Multicasting with an Overlay Network. In Proc. of the Fourth Symposium on Operating System Design and Implementation (OSDI), pages 197–212, October 2000.

    Google Scholar 

  23. Yang hua Chu, Sanjay G. Rao, and Hui Zhang. A case for end system multicast. In Proc. of ACM Sigmetrics, pages 1–12, June 2000.

    Google Scholar 

  24. Miguel Castro, Peter Druschel, Anne-Marie Kermarrec, and Antony Rowstron. Scribe: A large-scale and decentralized publish-subscribe infrastructure, September 2001. Submitted for publication. http://www.research.microsoft.com/~antr/scribe.

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2001 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Rowstron, A., Kermarrec, AM., Castro, M., Druschel, P. (2001). Scribe: The Design of a Large-Scale Event Notification Infrastructure. In: Crowcroft, J., Hofmann, M. (eds) Networked Group Communication. NGC 2001. Lecture Notes in Computer Science, vol 2233. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45546-9_3

Download citation

  • DOI: https://doi.org/10.1007/3-540-45546-9_3

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-42824-4

  • Online ISBN: 978-3-540-45546-2

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics