Abstract
We propose a new Publish/Subscribe system, called Fleet, that seamlessly combines a novel subscription mapping scheme and a structured overlay network address space partitioning technique to build an effective content-based publish/subscribe (pub/sub) system over a distributed hash table (DHT) overlay. Fleet employs an explicit mechanism to deal with skewed popularity distributions in subscriptions and events, which spreads the load generated by hot attributes across a multitude of peers. The address space partitioning event delivery mechanism expedites event delivery. Fleet strikes an ideal balance between subscription storage cost and event delivery cost, and is more scalable in the number of events, subscriptions, schema attributes, and number of system nodes.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Aguilera, M.K., Strom, R.E., Sturman, D.C., Astley, M., Chandra, T.D.: Matching events in a content-based subscription system. In: Proceedings of the eighteenth annual ACM symposium on Principles of distributed computing (1999)
Baldoni, R., Marchetti, C., Virgillito, A., Vitenberg, R.: Content-Based Publish-Subscribe over Structured Overlay Networks. In: ICDCS (2005)
Castelli, S., Costa, P., Picco, G.P.: Large-Scale Content-Based Routing in a Multidimensional Space. In: INFOCOM 2008 (2008)
Cai, M., Frank, M., Chen, J., Szekely, P.: MAAN: A Mulit-Attribute Addressable Network for Grid Information Services. Journal of Grid Computing 2(1), 3–14 (2004)
Li, D., Cao, J., Lu, X., Chen, K.: Efficient Range Query Processing in Peer-to-Peer Systems. IEEE Transactions on Knowledge and Data Engineering (accpted, 2009)
Carzaniga, A., Rosenblum, D.S., Wolf, A.L.: Design and Evaluation of a Wide-Area Event Notification Service. ACM Trans. on Computer Systems 19(3), 332–383 (2001)
Carzaniga, A., Rutherford, M.J., Wolf, A.L.: A Routing Scheme for Content-Based Networking. In: Proceedings of IEEE INFOCOM 2004, Hong Kong, China (March 2004)
Carzaniga, A., Wolf, A.L.: Forwarding in a Content-Based Network. In: Proceedings of ACM SIGCOMM, Karlsruhe, Germany, pp. 163–174 (August 2003)
Carzaniga, M.J.R., Wolf, A.L.: A Benchmark Suite for Distributed Publish/Subscribe Systems. Technical Report CU-CS-927-02, Department of Computer Science, University of Colorado (April 2002)
Chockler, G., Melamed, R., Tock, Y., Vitenberg, R.: Constructing scalable overlays for pub-sub with many topics. In: Proceedings of the twenty-sixth annual ACM symposium on Principles of distributed computing (2007)
Fabret, F., Jacobsen, A., Llirbat, F., Pereira, J., Ross, K., Shasha, D.: Filtering algorithms and implementation for very fast publish/subscribe systems. ACM SIGMOD Record 30(2) (June 2001)
Gao, J., Steenkiste, P.: An Adaptive Protocol for Efficient Support of Range Queries in DHT-based Systems. In: Proceedings of the 12th IEEE International Conference on Network Protocols (2004)
Gupta, A., Sahin, O.D., Agrawal, D., El Abbadi, A.: Meghdoot: Content-based publish/Subscribe over P2P networks. In: Jacobsen, H.-A. (ed.) Middleware 2004. LNCS, vol. 3231, pp. 254–273. Springer, Heidelberg (2004)
Li, D.S., Lu, X.C., Wu, J.: FissionE: A Scalable Constant Degree and Low Congestion DHT Scheme Based on Kautz Graphs. In: Proc. IEEE INFOCOM, pp. 1677–1688 (2005)
Lo, S.C., Chiu, Y.T.: Design of Content-Based Publish/Subscribe Systems over Structured Overlay Networks. IEICE Trans. on Information and Systems E91-D(5), 1504–1511 (2008)
Ramasubramanian, V., Sirer, E.G.: Beehive: O(1) Lookup Performance for Power-Law Query Distributions in Peer-to-Peer Overlays. In: Proceedings of Networked System Design and Implementation (NSDI), San Francisco, California (March 2004)
Wu, K.-L., Yu, P.S.: Efficient query monitoring using adaptive multiple key hashing. In: Proceedings of the eleventh international conference on Information and knowledge management, McLean, Virginia, USA, November 04-09 (2002)
Yang, X., Hu, Y.: A DHT-based Infrastructure for Content-based Publish/Subscribe Services. In: Seventh IEEE International Conference on Peer-to-Peer Computing (2007)
Zhu, Y., Hu, Y.: Ferry A P2P-Based Architecture for Content-Based Publish/Subscribe Services. IEEE Transactions on Parallel and Distributed System 18(5) (2007)
Sayood, K.: Introduction to Data Compression, 3/e. Academic Press, London (2005)
Rao, W., Chen, L., Fu, A.W.-C., Bu, Y.: Optimal proactive caching in peer-to-peer network: analysis and application. In: Proceedings of the sixteenth ACM conference on Conference on information and knowledge management, November 06-10 (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Chen, C., Tsai, CL., Tsai, KC. (2009). Fleet: An Effective System for Publish/Subscribe Service over P2P Networks. In: Hua, A., Chang, SL. (eds) Algorithms and Architectures for Parallel Processing. ICA3PP 2009. Lecture Notes in Computer Science, vol 5574. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-03095-6_4
Download citation
DOI: https://doi.org/10.1007/978-3-642-03095-6_4
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-03094-9
Online ISBN: 978-3-642-03095-6
eBook Packages: Computer ScienceComputer Science (R0)