skip to main content
10.1145/2405688.2405689acmotherconferencesArticle/Chapter ViewAbstractPublication PagesmiddlewareConference Proceedingsconference-collections
research-article

Language expressiveness and quality of service for publish/subscribe systems

Published: 03 December 2012 Publication History

Abstract

The publish/subscribe paradigm is known for its loosely coupled interactions and event filtering capabilities. Traditional applications using pub/sub systems require large-scale deployment and high event throughput. Thus, pub/sub has always put the emphasis on scalability and performance, to the detriment of filtering expressiveness and quality of service. The matching language is usually limited to topic-based or content-based event filtering and does not allow complex stream-based subscriptions to be expressed. Messages are delivered on a best-effort basis without any ordering or reliability guarantees. Installing additional services and event processing systems at the endpoints can overcome the limitations of pub/sub systems. However, we argue that such solutions are inefficient and put a lot of strain on the pub/sub layer itself. Therefore, the focus of this thesis is to develop integrated solutions to extend pub/sub language expression and quality of service, and demonstrate that our approach results in better performance from a holistic perspective. We first describe multiple case studies for pub/sub and identify major features which need to be supported. We then extract those requirements from our use cases and develop general solutions within the pub/sub layer. Features we have supported so far includes total order and ranked data dissemination. Finally, we conduct experiments to compare the performance of our approach to baselines which rely on end-to-end services and perform holistic evaluations to assess the impact of our work.

References

[1]
A. Arasu, S. Babu, and J. Widom. Cql: A language for continuous queries over streams and relations. In G. Lausen and D. Suciu, editors, Database Programming Languages, volume 2921 of Lecture Notes in Computer Science, pages 123--124. Springer Berlin/Heidelberg, 2004.
[2]
A. Benzing, B. Koldehofe, M. Volz, and K. Rothermel. Multilevel predictions for the aggregation of data in global sensor networks. In Proceedings of the 2010 IEEE/ACM 14th International Symposium on Distributed Simulation and Real Time Applications, DS-RT '10, pages 169--178, 2010.
[3]
J.-S. Boulanger, J. Kienzle, and C. Verbrugge. Comparing interest management algorithms for massively multiplayer games. In ACM SIGCOMM NetGames Workshop, 2006.
[4]
A. Carzaniga, D. S. Rosenblum, and A. L. Wolf. Design and evaluation of a wide-area event notification service. ACM Transactions on Computer Systems, 19(3):332--383, Aug. 2001.
[5]
J. Chen, B. Wu, M. Delap, B. Knutsson, H. Lu, and C. Amza. Locality aware dynamic load management for massively multiplayer games. In Proceedings of the tenth ACM SIGPLAN symposium on Principles and practice of parallel programming, PPoPP '05, pages 289--300, New York, NY, USA, 2005. ACM.
[6]
G. Cugola et al. The JEDI event-based infrastructure and its application to the development of the OPSS WFMS. IEEE TSE, 2001.
[7]
X. Défago, A. Schiper, and P. Urbán. Total order broadcast and multicast algorithms: Taxonomy and survey. ACM Comput. Surv., 36:372--421, December 2004.
[8]
A. Denault and J. Kienzle. Journey: A massively multiplayer online game middleware. IEEE Software, 28(5):38--44, 2011.
[9]
M. Drosou, K. Stefanidis, and E. Pitoura. Preference-aware publish/subscribe delivery with diversity. In Proceedings of the Third ACM International Conference on Distributed Event-Based Systems, DEBS '09, pages 6:1--6:12, 2009.
[10]
P. T. Eugster et al. The many faces of publish/subscribe. ACM CSUR, 2003.
[11]
T. Fawcett and F. Provost. Activity monitoring: Noticing interesting changes in behavior. In SIGKDD, 1999.
[12]
K. R. Jayaram, C. Jayalath, and P. Eugster. Parametric subscriptions for content-based publish/subscribe networks. In Middleware, pages 128--147, 2010.
[13]
P. Jesus, C. Baquero, and P. S. Almeida. A survey of distributed data aggregation algorithms. CoRR, abs/1110.0725, 2011.
[14]
R. S. Kazemzadeh and H.-A. Jacobsen. Partition-tolerant distributed publish/subscribe systems. In Proceedings of the 2011 IEEE 30th International Symposium on Reliable Distributed Systems, SRDS '11, pages 101--110, 2011.
[15]
J. Kienzle, C. Verbrugge, B. Kemme, A. Denault, and M. Hawker. Mammoth: a massively multiplayer game research framework. In Int. Conf. on Foundations of Digital Games (FDG), pages 308--315, 2009.
[16]
I. Koenig. Event processing as a core capability of your content distribution fabric. In Gartner Event Processing Summit, 2007.
[17]
G. Li, S. Hou, and H.-A. Jacobsen. A unified approach to routing, covering and merging in publish/subscribe systems based on modified binary decision diagrams. In Distributed Computing Systems, 2005. ICDCS 2005. Proceedings. 25th IEEE International Conference on, pages 447--457, june 2005.
[18]
D. C. Luckham. The Power of Events: An Introduction to Complex Event Processing in Distributed Enterprise Systems. Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA, 2001.
[19]
C. Lumezanu, N. Spring, and B. Bhattacharjee. Decentralized message ordering for publish/subscribe systems. In Proceedings of the ACM/IFIP/USENIX 2006 International Conference on Middleware, Middleware '06, pages 162--179, New York, NY, USA, 2006. Springer-Verlag New York, Inc.
[20]
T. Nadeem, S. Dashtinezhad, C. Liao, and L. Iftode. TrafficView: A Scalable Traffic Monitoring System. In Proceedings of the 2004 IEEE International Conference on Mobile Data Management (MDM 2004).
[21]
A. Noureddine, A. Bourdon, R. Rouvoy, and L. Seinturier. e-Surgeon: Diagnosing Energy Leaks of Application Servers. Technical report, Jan. 2012.
[22]
G. P. Picco, G. Cugola, and A. L. Murphy. Efficient content-based event dispatching in the presence of topological reconfiguration. In Proceedings of the 23rd International Conference on Distributed Computing Systems, ICDCS '03, pages 234--, 2003.
[23]
K. Pripužić, I. P. Žarko, and K. Aberer. Top-k/w publish/subscribe: finding k most relevant publications in sliding time window w. In Proceedings of the second international conference on Distributed event-based systems, DEBS '08, pages 127--138, 2008.
[24]
I. Rose, R. Murty, P. Pietzuch, J. Ledlie, M. Roussopoulos, and M. Welsh. COBRA: Content-based filtering and aggregation of blogs and RSS feeds. In NSDI, 2007.
[25]
C. Schuler, H. Schuldt, and H.-J. Schek. Supporting reliable transactional business processes by publish/subscribe techniques. In TES, 2001.
[26]
Y. Tock, N. Naaman, A. Harpaz, and G. Gershinsky. Hierarchical clustering of message flows in a multicast data dissemination system. In IASTED PDCS, 2005.
[27]
G. A. Wilkin, K. R. Jayaram, P. Eugster, and A. Khetrapal. Faidecs: fair decentralized event correlation. In Proceedings of the 12th ACM/IFIP/USENIX international conference on Middleware, Middleware'11, pages 228--248, 2011.
[28]
K. Zhang and B. Kemme. Transaction models for massively multiplayer online games. In SRDS, pages 31--40, 2011.
[29]
K. Zhang, B. Kemme, and A. Denault. Persistence in massively multiplayer online games. In ACM SIGCOMM NetGames Workshop, pages 53--58, 2008.
[30]
K. Zhang, V. Muthusamy, and H.-A. Jacobsen. Total order in content-based publish/subscribe systems. In ICDCS, pages 335--344, 2012.
[31]
K. Zhang, M. Sadoghi, V. Muthusamy, and H.-A. Jacobsen. Distributed ranked data dissemination in social networks. Technical report, University of Toronto, 2012.
[32]
Y. Zhao and R. Strom. Exploiting event stream interpretation in publish-subscribe systems. In PODC, pages 219--228. ACM Press, 2001.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
MIDDLEWARE '12: Proceedings of the 9th Middleware Doctoral Symposium of the 13th ACM/IFIP/USENIX International Middleware Conference
December 2012
52 pages
ISBN:9781450316118
DOI:10.1145/2405688
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

  • Professional
  • USENIX Assoc: USENIX Assoc
  • IFIP

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 December 2012

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. aggregation
  2. complex event processing
  3. data streams
  4. online games
  5. publish/subscribe
  6. total ordering

Qualifiers

  • Research-article

Conference

Middleware '12
Sponsor:
  • USENIX Assoc
Middleware '12: 13th International Middleware Conference
December 3, 2012
Quebec, Montreal, Canada

Acceptance Rates

Overall Acceptance Rate 203 of 948 submissions, 21%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 119
    Total Downloads
  • Downloads (Last 12 months)1
  • Downloads (Last 6 weeks)0
Reflects downloads up to 23 Feb 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media