research-article

Parallel event processing for content-based publish/subscribe systems

Authors:

Amer Farroukh,

Elias Ferzli,

Naweed Tajuddin,

Hans-Arno JacobsenAuthors Info & Claims

DEBS '09: Proceedings of the Third ACM International Conference on Distributed Event-Based Systems

Article No.: 8, Pages 1 - 4

https://doi.org/10.1145/1619258.1619269

Published: 06 July 2009 Publication History

Get Access

Abstract

Event processing systems are a promising technology for enterprise-scale applications. However, achieving scalability yet maintaining high performance is a challenging problem. This work introduces a parallel matching engine which leverages current chip multi-processors to increase throughput and to reduce the matching time. We present three parallelization techniques, as well as lock-based and software transactional memory-based implementations of each technique, and discuss their impact. The results show a 74% reduction of the average matching time and an improved throughput of over 1600 events/second when using eight processors.

References

[1]

M. K. Aguilera, R. E. Strom, D. C. Sturman, M. Astley, and T. D. Chandra. Matching events in a content-based subscription system. In PODC, 1999.

Digital Library

Google Scholar

[2]

C. Cranor, T. Johnson, and O. Spataschek. Gigascope: a stream database for network applications. In SIGMOD, 2003.

Digital Library

Google Scholar

[3]

P. Damron, A. Fedorova, Y. Lev, V. Luchangco, M. Moir, and D. Nussbaum. Hybrid transactional memory. In SIGOPS, 2006.

Digital Library

Google Scholar

[4]

H. Dreger, A. Feldmann, M. Mai, V. Paxson, and R. Sommer. Dynamic application-layer protocol analysis for network intrusion detection. In USENIX Security Symposium, 2006.

Digital Library

Google Scholar

[5]

F. Fabret, H.-A. Jacobsen, F. Llirbat, J. Pereira, K. A. Ross, and D. Shasha. Filtering algorithms and implementation for very fast publish/subscribe systems. In SIGMOD, 2001.

Digital Library

Google Scholar

[6]

G. Li, S. Hou, and H.-A. Jacobsen. A unified approach to routing, covering and merging in publish/subscribe systems based on modified binary decision diagrams. In ICDCS, 2005.

Digital Library

Google Scholar

[7]

D. Lupei, A. Czajkowski, C. Segulja, M. Stumm, and C. Amza. Automatic adaptation of transactional memory state management to application conflict patterns. In Interact, 2009.

Google Scholar

[8]

V. J. Marathe, W. S. Iii, and M. L. Scott. Adaptive software transactional memory. In DISC, 2005.

Digital Library

Google Scholar

[9]

M. Olszewski, J. Cutler, and J. G. Steffan. Judostm: A dynamic binary-rewriting approach to software transactional memory. In PACT, 2007.

Digital Library

Google Scholar

[10]

Oracle. Complex event processing in the real world. White Paper, 2007.

Google Scholar

[11]

T. W. Yan and H. Garcia-Molina. The SIFT information dissemination system. In TODS, 1999.

Digital Library

Google Scholar

Cited By

View all

Zhu WQian SXu JXue GCao JZhu YLi W(2021)Lap: A latency‐aware parallelism framework for content‐based publish/subscribe systemsConcurrency and Computation: Practice and Experience10.1002/cpe.664035:17Online publication date: 21-Sep-2021
https://doi.org/10.1002/cpe.6640
Liao ZQian SCao JCao YXue GYu JZhu YLi M(2019)PhSIHProceedings of the 48th International Conference on Parallel Processing10.1145/3337821.3337859(1-10)Online publication date: 5-Aug-2019
https://dl.acm.org/doi/10.1145/3337821.3337859
Shah MKulkarni D(2018)Multi-GPU Approach for Development of Parallel and Scalable Pub-Sub SystemComputing, Communication and Signal Processing10.1007/978-981-13-1513-8_49(471-478)Online publication date: 13-Sep-2018
https://doi.org/10.1007/978-981-13-1513-8_49
Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

DEBS '09: Proceedings of the Third ACM International Conference on Distributed Event-Based Systems

July 2009

292 pages

ISBN:9781605586656

DOI:10.1145/1619258

Conference Chairs:
Aniruddha Gokhale
Vanderbilt University
,
Douglas C. Schmidt
Vanderbilt University

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 July 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Conference

DEBS '09

Sponsor:

DEBS '09: The 3rd ACM International Conference on Distributed Event-based Systems

July 6 - 9, 2009

Tennessee, Nashville

Acceptance Rates

Overall Acceptance Rate 145 of 583 submissions, 25%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

18
Total Citations
View Citations
302
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Zhu WQian SXu JXue GCao JZhu YLi W(2021)Lap: A latency‐aware parallelism framework for content‐based publish/subscribe systemsConcurrency and Computation: Practice and Experience10.1002/cpe.664035:17Online publication date: 21-Sep-2021
https://doi.org/10.1002/cpe.6640
Liao ZQian SCao JCao YXue GYu JZhu YLi M(2019)PhSIHProceedings of the 48th International Conference on Parallel Processing10.1145/3337821.3337859(1-10)Online publication date: 5-Aug-2019
https://dl.acm.org/doi/10.1145/3337821.3337859
Shah MKulkarni D(2018)Multi-GPU Approach for Development of Parallel and Scalable Pub-Sub SystemComputing, Communication and Signal Processing10.1007/978-981-13-1513-8_49(471-478)Online publication date: 13-Sep-2018
https://doi.org/10.1007/978-981-13-1513-8_49
Rogora DPapalini MKhazaei KMargara ACarzaniga ACugola G(2017)High-Throughput Subset Matching on Commodity GPU-Based SystemsProceedings of the Twelfth European Conference on Computer Systems10.1145/3064176.3064190(513-526)Online publication date: 23-Apr-2017
https://dl.acm.org/doi/10.1145/3064176.3064190
Kannan KBaskaran RAkila VSivakumar NSaruladha KZayaraz GIlavarasan E(2016)Fault Tolerant Event Subscription Model for Smart CommunitiesProceedings of the International Conference on Informatics and Analytics10.1145/2980258.2980417(1-6)Online publication date: 25-Aug-2016
https://dl.acm.org/doi/10.1145/2980258.2980417
Shah MKulkarni DGal AWeidlich MKalogeraki VVenkasubramanian N(2016)Design and development of high performance, scalable content based publish subscribe systemProceedings of the 10th ACM International Conference on Distributed and Event-based Systems10.1145/2933267.2933428(406-409)Online publication date: 13-Jun-2016
https://dl.acm.org/doi/10.1145/2933267.2933428
Margara ACugola G(2014)High-Performance Publish-Subscribe Matching Using Parallel HardwareIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2013.3925:1(126-135)Online publication date: 1-Jan-2014
https://dl.acm.org/doi/10.1109/TPDS.2013.39
Bellavista PCorradi AReale A(2014)Quality of Service in Wide Scale Publish—Subscribe SystemsIEEE Communications Surveys & Tutorials10.1109/SURV.2014.031914.0019216:3(1591-1616)Online publication date: Nov-2015
https://doi.org/10.1109/SURV.2014.031914.00192
Sadoghi MJacobsen H(2014)Adaptive parallel compressed event matching2014 IEEE 30th International Conference on Data Engineering10.1109/ICDE.2014.6816665(364-375)Online publication date: Mar-2014
https://doi.org/10.1109/ICDE.2014.6816665
Shah MKulkarni D(2014)Enabling QoS support for multi-core message broker in Publish/Subscribe system2014 IEEE International Advance Computing Conference (IACC)10.1109/IAdCC.2014.6779421(774-778)Online publication date: Feb-2014
https://doi.org/10.1109/IAdCC.2014.6779421
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Recommendations

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Qualifiers

Conference

Acceptance Rates

Upcoming Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations