tutorial

Processing flows of information: from data stream to complex event processing

Authors:

Alessandro Margara,

Gianpaolo CugolaAuthors Info & Claims

DEBS '11: Proceedings of the 5th ACM international conference on Distributed event-based system

Pages 359 - 360

https://doi.org/10.1145/2002259.2002307

Published: 11 July 2011 Publication History

Get Access

Abstract

An increasing number of distributed applications requires processing continuously flowing data from geographically distributed sources at unpredictable rate to obtain timely responses to complex queries. Examples of such applications come from the most disparate fields: from wireless sensor networks to financial tickers, from traffic management to click stream inspection.

These requirements led to the development of a number of systems specifically designed to process information as a flow according to a set of pre-deployed processing rules. We collectively call them Information Flow Processing (IFP) Systems. Despite having a common goal, IFP systems differ in a wide range of aspects, including architectures, data models, rule languages, and processing mechanisms.

In this tutorial we draw a general framework to analyze and compare the results achieved so far in the area of IFP systems. This allows us to offer a systematic overview of the topic, favoring the communication between different communities, and highlighting a number of open issue that still need to be addressed in research.

References

[1]

B. Babcock, S. Babu, M. Datar, R. Motwani, and J. Widom. Models and issues in data stream systems. In PODS '02: Proceedings of the twenty-first ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems, pages 1--16, New York, NY, USA, 2002. ACM.

Digital Library

Google Scholar

[2]

G. Cugola and A. Margara. Processing flows of information: From data stream to complex event processing. ACM Computing Surveys, to appear.

Digital Library

Google Scholar

[3]

D. C. Luckham. The Power of Events: An Introduction to Complex Event Processing in Distributed Enterprise Systems. Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA, 2001.

Digital Library

Google Scholar

Cited By

View all

Ntoulias EAlevizos EArtikis AAkasiadis CKoumparos A(2022)Online fleet monitoring with scalable event recognition and forecastingGeoInformatica10.1007/s10707-022-00465-226:4(613-644)Online publication date: 11-May-2022
https://doi.org/10.1007/s10707-022-00465-2
Bugert NSchöpfel M(2021)Design of a Framework Model for the Implementation and Application of a Supply Chain Event Management SystemLogistik in Wissenschaft und Praxis10.1007/978-3-658-33480-2_3(45-65)Online publication date: 14-Aug-2021
https://doi.org/10.1007/978-3-658-33480-2_3
Berezovskyi AInam REl-khoury JTorngren MFersman E(2019)Efficient State Update Exchange in a CPS Environment for Linked Data-based Digital Twins2019 IEEE 17th International Conference on Industrial Informatics (INDIN)10.1109/INDIN41052.2019.8972284(983-989)Online publication date: Jul-2019
https://doi.org/10.1109/INDIN41052.2019.8972284
Show More Cited By

Index Terms

Processing flows of information: from data stream to complex event processing

Recommendations

Processing flows of information: From data stream to complex event processing

A large number of distributed applications requires continuous and timely processing of information as it flows from the periphery to the center of the system. Examples include intrusion detection systems which analyze network traffic in real-time to ...
Taming velocity and variety simultaneously in big data with stream reasoning: tutorial
DEBS '16: Proceedings of the 10th ACM International Conference on Distributed and Event-based Systems

Many "big data" applications must tame velocity (processing data in-motion) and variety (processing many different types of data) simultaneously.

The research on knowledge representation and reasoning has focused on the variety of data, devising data ...
A stream processing architecture for heterogeneous data sources in the Internet of Things
Highlights
- An architecture for processing heterogeneous data sources in IoT is proposed.
- ...
Abstract
The number of Internet of Things (IoT) and smart devices capable of producing, consuming and exchanging information is constantly increasing. It is estimated there will be around 30 billion of them in 2020. In most cases, the ...

Comments

Information & Contributors

Information

Published In

DEBS '11: Proceedings of the 5th ACM international conference on Distributed event-based system

July 2011

418 pages

ISBN:9781450304238

DOI:10.1145/2002259

Conference Chair:
David Eyers
University of Otago, NZ
,
General Chair:
Opher Etzion
IBM Research, Israel
,
Program Chairs:
Avigdor Gal
Technion -- Israel Institute of Technology, Israel
,
Stan Zdonik
Brown University, USA
,
Paul Vincent
TIBCO Software LTD, UK

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 July 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Tutorial

Conference

DEBS '11

Sponsor:

DEBS '11: The 5th ACM International Conference on Distributed Event-based system

July 11 - 15, 2011

New York, New York, USA

Acceptance Rates

DEBS '11 Paper Acceptance Rate 23 of 95 submissions, 24%;

Overall Acceptance Rate 145 of 583 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

27
Total Citations
View Citations
792
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)1

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Ntoulias EAlevizos EArtikis AAkasiadis CKoumparos A(2022)Online fleet monitoring with scalable event recognition and forecastingGeoInformatica10.1007/s10707-022-00465-226:4(613-644)Online publication date: 11-May-2022
https://doi.org/10.1007/s10707-022-00465-2
Bugert NSchöpfel M(2021)Design of a Framework Model for the Implementation and Application of a Supply Chain Event Management SystemLogistik in Wissenschaft und Praxis10.1007/978-3-658-33480-2_3(45-65)Online publication date: 14-Aug-2021
https://doi.org/10.1007/978-3-658-33480-2_3
Berezovskyi AInam REl-khoury JTorngren MFersman E(2019)Efficient State Update Exchange in a CPS Environment for Linked Data-based Digital Twins2019 IEEE 17th International Conference on Industrial Informatics (INDIN)10.1109/INDIN41052.2019.8972284(983-989)Online publication date: Jul-2019
https://doi.org/10.1109/INDIN41052.2019.8972284
Li YZhang TSong C(2019)Research on Generation Algorithm of Complex Event Processing Rules Based on Time Series2019 Eleventh International Conference on Advanced Computational Intelligence (ICACI)10.1109/ICACI.2019.8778586(124-128)Online publication date: Jun-2019
https://doi.org/10.1109/ICACI.2019.8778586
Cugola GMargara A(2019)Low latency complex event processing on parallel hardwareJournal of Parallel and Distributed Computing10.1016/j.jpdc.2011.11.00272:2(205-218)Online publication date: 4-Jan-2019
https://dl.acm.org/doi/10.1016/j.jpdc.2011.11.002
Sánchez CSchneider GAhrendt WBartocci EBianculli DColombo CFalcone YFrancalanza AKrstić SLourenço JNickovic DPace GRufino JSignoles JTraytel DWeiss A(2019)A survey of challenges for runtime verification from advanced application domains (beyond software)Formal Methods in System Design10.1007/s10703-019-00337-wOnline publication date: 9-Aug-2019
https://doi.org/10.1007/s10703-019-00337-w
Elyusufi ZElyusufi YAitkbir M(2019)Combining CRM Strength and Big Data Tools for Customers Profile AnalysisInnovations in Smart Cities Applications Edition 210.1007/978-3-030-11196-0_20(226-237)Online publication date: 7-Feb-2019
https://doi.org/10.1007/978-3-030-11196-0_20
Blomqvist E(2018)The use of Semantic Web technologies for decision support --a surveySemantic Web10.5555/2786122.27861245:3(177-201)Online publication date: 13-Dec-2018
https://dl.acm.org/doi/10.5555/2786122.2786124
Karampiperis PMouchakis GPaliouras GKarkaletsis V(2018)ER designer toolkitUniversal Access in the Information Society10.1007/s10209-013-0300-913:1(115-123)Online publication date: 21-Dec-2018
https://dl.acm.org/doi/10.1007/s10209-013-0300-9
Rao GZhao BZhang XFeng ZXiao G(2018)PRSPR: An Adaptive Framework for Massive RDF Stream ReasoningWeb and Big Data10.1007/978-3-319-96890-2_36(440-448)Online publication date: 19-Jul-2018
https://doi.org/10.1007/978-3-319-96890-2_36
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Cited By

Index Terms

Recommendations

Processing flows of information: From data stream to complex event processing

Taming velocity and variety simultaneously in big data with stream reasoning: tutorial

A stream processing architecture for heterogeneous data sources in the Internet of Things