skip to main content
10.1145/3423211.3426400acmconferencesArticle/Chapter ViewAbstractPublication PagesmiddlewareConference Proceedingsconference-collections
research-article

On Delivery Guarantees in Distributed Content-Based Publish/Subscribe Systems

Published: 11 December 2020 Publication History

Abstract

Distributed overlay-based publish/subscribe systems provide a selective and scalable communication paradigm for connecting components of a distributed application. Existing overlay-based systems only guarantee delivery of notifications to clients that are already known by all brokers in the overlay. Nonetheless, due to the propagation delay, it takes time for a client's interests to be received by all brokers comprising the overlay. The message propagation delay and unclear delivery guarantees during this time increase the complexity of developing distributed applications based on the pub/sub paradigm. In this paper, we propose a collection of message processing and delivery guarantees that allows clients to clearly define the set of publications they receive. Based on our evaluation, these delivery guarantees can reduce buffering requirements on clients by up to 10 times, prevent missing notifications due to the propagation delay, and provide clients with primitive building blocks that simplify application development. We evaluate our proposed routing algorithms and show that a pub/sub system can provide the proposed delivery guarantees without increasing its resource requirements or hindering its throughput.

References

[1]
R. Baldoni, M. Contenti, S. T. Piergiovanni, and A. Virgillito. 2003. Modeling publish/subscribe communication systems: towards a formal approach. In WORDS'03.
[2]
Mike Burrows. 2006. The Chubby Lock Service for Loosely-coupled Distributed Systems. In OSDI '06.
[3]
Antonio Carzaniga, David S. Rosenblum, and others. 2001. Design and Evaluation of a Wide-area Event Notification Service. ACM Trans. Comput. Syst. (2001).
[4]
Jacques Chester. 2020. Introducing Knative Serving. https://freecontent.manning.com/introducing-knative-serving/. (2020). Accessed: 2020-09-11.
[5]
Gregory V. Chockler, Idit Keidar, and Roman Vitenberg. 2001. Group Communication Specifications: A Comprehensive Study. ACM Comput. Surv. (2001).
[6]
Gianpaolo Cugola, Matteo Migliavacca, and Alessandro Monguzzi. 2007. On Adding Replies to Publish-subscribe. In DEBS '07.
[7]
Knative Documentation. 2020. Knative Serving. https://knative.dev/docs/serving/. (2020). Accessed: 2020-09-11.
[8]
Eli Fidler, Hans-Arno Jacobsen, Guoli Li, and Serge Mankovskii. 2005. The PADRES Distributed Publish/Subscribe System. International Conference on Feature Interactions in Telecommunications and Software Systems (ICFI'05) (July 2005), 12-30.
[9]
Apache Software Foundation. 2018. Apache Pulsar pub/sub messaging platform. https://pulsar.incubator.apache.org/. (2018). Accessed: 2018-04-01.
[10]
Sebastian Frischbier, Alessandro Margara, Tobias Freudenreich, and others. 2013. Aggregation for Implicit Invocations. In AOSD '13.
[11]
Google. 2018. Cloud Pub/Sub: A Google-Scale Messaging Service. https://cloud.google.com/pubsub/architecture. (2018). Accessed: 2018-05-01.
[12]
Google. 2018. Google Public NTP. https://developers.google.com/time/. (2018). Accessed: 2018-03-05.
[13]
Jonathan C. Hill, John C. Knight, Aaron M. Crickenberger, and Richard Honhard. 2002. Publish and Subscribe with Reply. Technical Report. University of Virginia.
[14]
Songlin Hu, Vinod Muthusamy, Guoli Li, and Hans-Arno Jacobsen. 2009. Transactional Mobility in Distributed Content-based Publish/Subscribe Systems. In 29th IEEE International Conference on Distributed Computing Systems (ICDCS). 101--110.
[15]
Patrick Hunt, Mahadev Konar, Flavio P. Junqueira, and others. 2010. ZooKeeper: Wait-free Coordination for Internet-scale Systems. In USENIXATC'10.
[16]
Randall Hunt. 2017. Keeping Time With Amazon Time Sync Service. https://aws.amazon.com/blogs/aws/keeping-time-with-amazon-time-sync-service. (2017). Accessed: 2018-03-05.
[17]
Hans-Arno Jacobsen, Alex Cheung, Guoli Li, Balasubramaneyam Maniymaran, Vinod Muthusamy, and Reza Sherafat Kazemzadeh. 2010. The PADRES Publish/Subscribe System. In Principles and Applications of Distributed Event-Based Systems. IGI Global, 164--205.
[18]
Martin Jergler, Kaiwen Zhang, and Hans-Arno Jacobsen. 2018. Multi-client Transactions in Distributed Publish/Subscribe Systems. In ICDCS.
[19]
Reza Sherafat Kazemzadeh. 2012. Overlay neighborhoods for distributed publish/subscribe systems. Ph.D. Dissertation. University of Toronto.
[20]
Reza Sherafat Kazemzadeh and Hans-Arno Jacobsen. 2009. Reliable and Highly Available Distributed Publish/Subscribe Service. In SRDS '09.
[21]
M. Kim, A. Mohindra, V. Muthusamy, R. Ranchal, V. Salapura, A. Slominski, and R. Khalaf. 2016. Building scalable, secure, multi-tenant cloud services on IBM Bluemix. IBM Journal of Research and Development 60 (2016).
[22]
Jay Kreps, Neha Narkhede, Jun Rao, and others. 2011. Kafka: A distributed messaging system for log processing. In Proceedings of the NetDB. 1--7.
[23]
Kfir Lev-Ari, Edward Bortnikov, Idit Keidar, and Alexander Shraer. 2016. Modular Composition of Coordination Services. In USENIX ATC '16.
[24]
Guoli Li, Shuang Hou, and H. Jacobsen. 2005. A Unified Approach to Routing, Covering and Merging in Publish/Subscribe Systems Based on Modified Binary Decision Diagrams. In ICDCS '05.
[25]
Guoli Li, Vinod Muthusamy, and Hans-Arno Jacobsen. 2008. Adaptive Content-based Routing in General Overlay Topologies. In Middleware '08.
[26]
M. Li, F. Ye, M. Kim, H. Chen, and H. Lei. 2011. A Scalable and Elastic Publish/Subscribe Service. In IPDPS '11.
[27]
Microsoft. 2018. Azure regions. https://azure.microsoft.com/en-us/regions/. (2018). Accessed: 2018-01-15.
[28]
Neha Narkhede, Gwen Shapira, and Todd Palino. 2016. Kafka: The Definitive Guide. O'Reilly Media, Inc.
[29]
Navneet Kumar Pandey, Kaiwen Zhang, Stephane Weiss, Hans-Arno Jacobsen, and Roman Vitenberg. 2015. Minimizing the Communication Cost of Aggregation in Publish/Subscribe Systems. In 35th IEEE International Conference on Distributed Computing Systems (ICDCS).
[30]
G. Pardo-Castellote. 2003. OMG Data-Distribution Service: architectural overview. In ICDCS Workshops '03.
[31]
Pooya Salehi, Christoph Doblander, and Hans-Arno Jacobsen. 2016. Highly-available Content-based Publish/Subscribe via Gossiping. In DEBS '16.
[32]
Yogeshwer Sharma, Philippe Ajoux, Petchean Ang, David Callies, Abhishek Choudhary, Laurent Demailly, Thomas Fersch, Liat Atsmon Guz, Andrzej Kotulski, Sachin Kulkarni, Sanjeev Kumar, Harry Li, Jun Li, Evgeniy Makeev, Kowshik Prakasam, Robbert Van Renesse, Sabyasachi Roy, Pratyush Seth, Yee Jiun Song, Benjamin Wester, Kaushik Veeraraghavan, and Peter Xie. 2015. Wormhole: Reliable Pub-Sub to Support Geo-replicated Internet Services. In 12th USENIX Symposium on Networked Systems Design and Implementation (NSDI 15). USENIX Association, Oakland, CA, 351--366. https://www.usenix.org/conference/nsdi15/technical-sessions/presentation/sharma
[33]
Colby Tresness. 2018. Understanding serverless cold start. https://azure.microsoft.com/en-us/blog/understanding-serverless-cold-start/. (2018). Accessed: 2020-09-11.
[34]
L. Vargas, L. I. W. Pesonen, E. Gudes, and J. Bacon. 2007. Transactions in Content-Based Publish/Subscribe Middleware. In ICDCS Workshops '07.
[35]
WonderNetwork. 2018. Global ping statistics. https://wondernetwork.com/pings. (2018). Accessed: 2018-01-15.

Cited By

View all
  • (2023)ComDeX: A Context-aware Federated Platform for IoT-enhanced CommunitiesProceedings of the 17th ACM International Conference on Distributed and Event-based Systems10.1145/3583678.3596890(37-48)Online publication date: 27-Jun-2023
  • (2022)SmartPubSub: Content-based Pub-Sub on IPFS2022 IEEE 47th Conference on Local Computer Networks (LCN)10.1109/LCN53696.2022.9843795(327-330)Online publication date: 26-Sep-2022
  • (2021)Towards Energy Efficiency in Data Centers: An Industrial Experience Based on Reuse and Layout ChangesApplied Sciences10.3390/app1111471911:11(4719)Online publication date: 21-May-2021
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
Middleware '20: Proceedings of the 21st International Middleware Conference
December 2020
455 pages
ISBN:9781450381536
DOI:10.1145/3423211
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 December 2020

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Content-based routing
  2. Publish/Subscribe

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

  • Alexander von Humboldt-Stiftung

Conference

Middleware '20
Sponsor:
Middleware '20: 21st International Middleware Conference
December 7 - 11, 2020
Delft, Netherlands

Acceptance Rates

Overall Acceptance Rate 203 of 948 submissions, 21%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)11
  • Downloads (Last 6 weeks)0
Reflects downloads up to 23 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2023)ComDeX: A Context-aware Federated Platform for IoT-enhanced CommunitiesProceedings of the 17th ACM International Conference on Distributed and Event-based Systems10.1145/3583678.3596890(37-48)Online publication date: 27-Jun-2023
  • (2022)SmartPubSub: Content-based Pub-Sub on IPFS2022 IEEE 47th Conference on Local Computer Networks (LCN)10.1109/LCN53696.2022.9843795(327-330)Online publication date: 26-Sep-2022
  • (2021)Towards Energy Efficiency in Data Centers: An Industrial Experience Based on Reuse and Layout ChangesApplied Sciences10.3390/app1111471911:11(4719)Online publication date: 21-May-2021
  • (2021)Lap: A latency‐aware parallelism framework for content‐based publish/subscribe systemsConcurrency and Computation: Practice and Experience10.1002/cpe.664035:17Online publication date: 21-Sep-2021

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media