skip to main content
research-article

Processing flows of information: From data stream to complex event processing

Published: 14 June 2012 Publication History

Abstract

A large number of distributed applications requires continuous and timely processing of information as it flows from the periphery to the center of the system. Examples include intrusion detection systems which analyze network traffic in real-time to identify possible attacks; environmental monitoring applications which process raw data coming from sensor networks to identify critical situations; or applications performing online analysis of stock prices to identify trends and forecast future values.
Traditional DBMSs, which need to store and index data before processing it, can hardly fulfill the requirements of timeliness coming from such domains. Accordingly, during the last decade, different research communities developed a number of tools, which we collectively call Information flow processing (IFP) systems, to support these scenarios. They differ in their system architecture, data model, rule model, and rule language. In this article, we survey these systems to help researchers, who often come from different backgrounds, in understanding how the various approaches they adopt may complement each other.
In particular, we propose a general, unifying model to capture the different aspects of an IFP system and use it to provide a complete and precise classification of the systems and mechanisms proposed so far.

References

[1]
Abadi, D., Carney, D., Çetintemel, U., Cherniack, M., Convey, C., Erwin, C., Galvez, E., Hatoun, M., Maskey, A., Rasin, A., Singer, A., Stonebraker, M., Tatbul, N., Xing, Y., Yan, R., and Zdonik, S. 2003. Aurora: A data stream management system. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD'03). ACM, New York, NY, 666.
[2]
Abadi, D., Carney, D., Cetintemel, U., Cherniack, M., Convey, C., Lee, S., Stonebraker, M., Tatbul, N., and S., Z. 2003. Aurora: A new model and architecture for data stream management. VLDB J. 12, 2.
[3]
Abadi, D. J., Ahmad, Y., Balazinska, M., Cetintemel, U., Cherniack, M., Hwang, J.-H., Lindner, W., Maskey, A. S., Rasin, A., Ryvkina, E., Tatbul, N., Xing, Y., and Zdonik, S. B. 2005. The design of the Borealis stream processing engine. In Proceedings of the 2nd Biennial Conference on Innovative Data Systems Research (CIDR2005). ACM.
[4]
Adaikkalavan, R. and Chakravarthy, S. 2006. Snoopib: Interval-based event specification and detection for active databases. Data Knowl. Eng. 59, 1, 139--165.
[5]
Adi, A. and Etzion, O. 2004. Amit—The situation manager. VLDB J. 13, 2, 177--203.
[6]
Agrawal, J., Diao, Y., Gyllstrom, D., and Immerman, N. 2008. Efficient pattern matching over event streams. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD'08). ACM, New York, NY, 147--160.
[7]
Aguilera, M. K., Strom, R. E., Sturman, D. C., Astley, M., and Chandra, T. D. 1999. Matching events in a content-based subscription system. In Proceedings of the 18th Annual ACM Symposium on Principles of Distributed Computing (PODC'99). ACM, New York, NY, 53--61.
[8]
Ahmad, Y., Berg, B., Cetintemel, U., Humphrey, M., Hwang, J.-H., Jhingran, A., Maskey, A., Papaemmanouil, O., Rasin, A., Tatbul, N., Xing, W., Xing, Y., and Zdonik, S. 2005. Distributed operation in the Borealis stream processing engine. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD'05). ACM, New York, NY, 882--884.
[9]
Ahmad, Y. and Çetintemel, U. 2004. Network-aware query processing for stream-based applications. In Proceedings of the 13th International Conference on Very Large Databases (VLDB'04). 456--467.
[10]
Akdere, M., Çetintemel, U., and Tatbul, N. 2008. Plan-based complex event detection across distributed sources. Proc. VLDB. 1, 1, 66--77.
[11]
Aleri. 2010. http://www.aleri.com/. Last accessed 11/2010.
[12]
Altinel, M. and Franklin, M. J. 2000. Efficient filtering of xml documents for selective dissemination of information. In Proceedings of the International Conference on Very Large Databases (VLDB'00). Morgan Kaufmann Publishers Inc., San Francisco, CA, 53--64.
[13]
Amini, L., Andrade, H., Bhagwan, R., Eskesen, F., King, R., Selo, P., Park, Y., and Venkatramani, C. 2006. Spc: A distributed, scalable platform for data mining. In Proceedings of the 4th International Workshop on Data Mining Standards, Services and Platforms (DMSSP'06). ACM, New York, NY, 27--37.
[14]
Amini, L., Jain, N., Sehgal, A., Silber, J., and Verscheure, O. 2006. Adaptive control of extreme-scale stream processing systems. In Proceedings of the 26th IEEE International Conference on Distributed Computing Systems (ICDCS'06). IEEE Computer Society, Los Alamitos, CA, 71.
[15]
Arasu, A., Babcock, B., Babu, S., Datar, M., Ito, K., Nishizawa, I., Rosenstein, J., and Widom, J. 2003. Stream: The stanford stream data manager. IEEE Data Eng. Bull. 26.
[16]
Arasu, A., Babu, S., and Widom, J. 2002. An abstract semantics and concrete language for continuous queries over streams and relations. Tech. rep. 2002-57, Stanford InfoLab, Stanford, CA.
[17]
Arasu, A., Babu, S., and Widom, J. 2006. The CQL continuous query language: Semantic foundations and query execution. VLDB J. 15, 2, 121--142.
[18]
Ashayer, G., Leung, H. K. Y., and Jacobsen, H.-A. 2002. Predicate matching and subscription matching in publish/subscribe systems. In Proceedings of the Workshop on Distributed Event-based Systems, co-located with the 22nd International Conference on Distributed Computing Systems. IEEE Computer Society Press, Los Alamitos, CA.
[19]
Avnur, R. and Hellerstein, J. M. 2000. Eddies: Continuously adaptive query processing. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD'00). ACM, New York, NY, 261--272.
[20]
Babcock, B., Babu, S., Datar, M., Motwani, R., and Widom, J. 2002. Models and issues in data stream systems. In Proceedings of the 21st ACM SIGMOD/PODS Symposium on Principles of Database Systems (PODS'02). ACM, New York, NY, 1--16.
[21]
Babcock, B., Datar, M., and Motwani, R. 2004. Load shedding for aggregation queries over data streams. In Proceedings of the 20th International Conference on Data Engineering (ICDE'04). IEEE Computer Society, Los Alamitos, CA, 350.
[22]
Babu, S. and Widom, J. 2001. Continuous queries over data streams. SIGMOD Rec. 30, 3, 109--120.
[23]
Bagchi, A., Chaudhary, A., Goodrich, M., Li, C., and Shmueli-Scheuer, M. 2006. Achieving communication efficiency through push-pull partitioning of semantic spaces to disseminate dynamic information. IEEE Trans. Knowl. Data Eng. 18, 10, 1352--1367.
[24]
Bai, Y., Thakkar, H., Wang, H., Luo, C., and Zaniolo, C. 2006. A data stream language and system designed for power and extensibility. In Proceedings of the 15th ACM International Conference on Information and Knowledge Management (CIKM'06). ACM, New York, NY, 337--346.
[25]
Balazinska, M., Balakrishnan, H., Madden, S. R., and Stonebraker, M. 2008. Fault-tolerance in the Borealis distributed stream processing system. ACM Trans. Database Syst. 33, 1, 1--44.
[26]
Balazinska, M., Balakrishnan, H., and Stonebraker, M. 2004. Contract-based load management in federated distributed systems. In Proceedings of the 1st Symposium on Networked Systems Design and Implementation (NSDI'04). USENIX Association, 15.
[27]
Balter, R. 2004. JORAM: The open source enterprise service bus. Tech. rep., ScalAgent Distributed Technologies SA, Echirolles Cedex, France.
[28]
Barbon, F., Traverso, P., Pistore, M., and Trainotti, M. 2006a. Run-time monitoring of instances and classes of Web service compositions. In Proceedings of the IEEE International Conference on Web Services (ICWS'06). IEEE Computer Society, Los Alamitos, CA, 63--71.
[29]
Barbon, F., Traverso, P., Pistore, M., and Trainotti, M. 2006b. Run-time monitoring of the execution of plans for Web service composition. In Proceedings of the 16th International Conference on Automated Planning and Scheduling (ICAPS'06). 346--349.
[30]
Baresi, L., Bianculli, D., Ghezzi, C., Guinea, S., and Spoletini, P. 2007. Validation of Web service compositions. IET Softw. 1, 6, 219--232.
[31]
Baresi, L. and Guinea, S. 2005a. Dynamo: Dynamic monitoring of ws-bpel processes. In Proceedings of the 3rd International Conference on Service-Oriented Computing (ICSOC'05). 478--483.
[32]
Baresi, L. and Guinea, S. 2005b. Towards dynamic monitoring of ws-bpel processes. In Proceedings of the 3rd International Conference on Service-Oriented Computing (ICSOC'05). 269--282.
[33]
Baresi, L., Guinea, S., Kazhamiakin, R., and Pistore, M. 2008. An integrated approach for the runtime monitoring of bpel orchestrations. In Proceedings of the 1st European Conference on Towards a Service-Based Internet. Lecture Notes in Computer Science vol. 5377, Springer-Verlag, Berlin, 1--12.
[34]
Barga, R. S., Goldstein, J., Ali, M. H., and Hong, M. 2007. Consistent streaming through time: A vision for event stream processing. In Proceedings of the 3rd Biennial Conference on Innovative Data Systems Research (CIDR'07). 363--374.
[35]
Barringer, H., Goldberg, A., Havelund, K., and Sen, K. 2004. Rule-based runtime verification. In Proceedings of the 5th International Conference on Verification, Model Checking, and Abstract Interpretation (VMCAI'04). 44--57.
[36]
Bass, T. 2007. Mythbusters: Event stream processing v. complex event processing. Keynote speech at the 1st International Confrence on Distributed Event-Based Systems (DEBS'07).
[37]
Bauer, A., Leucker, M., and Schallhart, C. 2006a. Model-based runtime analysis of distributed reactive systems. In Proceedings of the 17th Australian Software Engineering Conference (ASWEC'06). 243--252.
[38]
Bauer, A., Leucker, M., and Schallhart, C. 2006b. Monitoring of real-time properties. In Proceedings of the 26th Conference on Foundations of Software Technology and Theoretical Computer Science (FSTTCS), S. Arun-Kumar and N. Garg, Eds. Lecture Notes in Computer Science, vol. 4337. Springer-Verlag, Berlin.
[39]
Bauer, A., Leucker, M., and Schallhart, C. 2007. The good, the bad, and the ugly, but how ugly is ugly? In Runtime Verification, 7th International Workshop (RV 2007). Lecture Notes in Computer Science, vol. 5289, 126--138.
[40]
Bauer, A., Leucker, M., and Schallhart, C. 2010. Runtime verification for LTL and TLTL. ACM Trans. Softw. Eng. Methodol. Forthcoming.
[41]
Beeri, C., Eyal, A., Milo, T., and Pilberg, A. 2007. Monitoring business processes with queries. In Proceedings of the 33rd International Conference on Very Large Databases (VLDB'07). 603--614.
[42]
Bertino, E., Ferrari, E., and Guerrini, G. 1998. An approach to model and query event-based temporal data. In Proceedings of the International Symposium on Temporal Representation and Reasoning, 122.
[43]
Bozdag, E., Mesbah, A., and van Deursen, A. 2007. A comparison of push and pull techniques for AJAX. Tech. rep. Tud-SERG-2007-016a, Delft University of Technology, Delft, The Netherlands.
[44]
Brenna, L., Demers, A., Gehrke, J., Hong, M., Ossher, J., Panda, B., Riedewald, M., Thatte, M., and White, W. 2007. Cayuga: A high-performance event processing engine. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD'07). ACM, New York, NY, 1100--1102.
[45]
Broda, K., Clark, K., Miller, R., and Russo, A. 2009. Sage: A logical agent-based environment monitoring and control system. In Proceedings of the European Conference on Ambient Intelligence (AmI'09). 112--117.
[46]
Buchmann, A. P., Deutsch, A., Zimmermann, J., and Higa, M. 1995. The reach active oodbms. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD'95). ACM, New York, NY, 476.
[47]
Campailla, A., Chaki, S., Clarke, E., Jha, S., and Veith, H. 2001. Efficient filtering in publish-subscribe systems using binary decision diagrams. In Proceedings of the 23rd International Conference on Software Engineering (ICSE'01). IEEE Computer Society, Los Alamitos, CA, 443--452.
[48]
Carney, D., Çetintemel, U., Cherniack, M., Convey, C., Lee, S., Seidman, G., Stonebraker, M., Tatbul, N., and Zdonik, S. 2002. Monitoring streams: A new class of data management applications. In Proceedings of the 28th International Conference on Very Large Databases (VLDB'02). 215--226.
[49]
Carzaniga, A., Rosenblum, D., and Wolf, A. 2001. Design and evaluation of a wide-area event notification service. ACM Trans. Comp. Syst. 19, 3, 332--383.
[50]
Carzaniga, A., Rosenblum, D. S., and Wolf, A. L. 2000. Achieving scalability and expressiveness in an internet-scale event notification service. In Proceedings of the 19th Annual ACM Symposium on Principles of Distributed Computing. 219--227.
[51]
Carzaniga, A. and Wolf, A. L. 2002. Content-based networking: A new communication infrastructure. In Proceedings of the Revised Papers from the NSF Workshop on Developing an Infrastructure for Mobile and Wireless Systems (IMWS'01). Springer-Verlag, London, UK, 59--68.
[52]
Carzaniga, A. and Wolf, A. L. 2003. Forwarding in a content-based network. In Proceedings of the Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications (SIGCOMM'03). ACM, New York, NY, 163--174.
[53]
Chakravarthy, S. and Adaikkalavan, R. 2008. Events and streams: Harnessing and unleashing their synergy! In Proceedings of the 2nd International Conference on Distributed Event-Based Systems (DEBS'08). ACM, New York, NY, 1--12.
[54]
Chakravarthy, S., Anwar, E., Maugis, L., and Mishra, D. 1994. Design of sentinel: An object-oriented dmbs with event-based rules. Inform. Softw. Technol. 36, 9, 555--568.
[55]
Chakravarthy, S. and Mishra, D. 1994. Snoop: An expressive event specification language for active databases. Data Knowl. Eng. 14, 1, 1--26.
[56]
Chand, R. and Felber, P. 2004. Xnet: a Reliable content-based publish/subscribe system. In Proceedings of the 23rd IEEE International Symposium on Reliable Distributed Systems. 264--273.
[57]
Chandrasekaran, S., Cooper, O., Deshpande, A., Franklin, M. J., Hellerstein, J. M., Hong, W., Krishnamurthy, S., Madden, S. R., Reiss, F., and Shah, M. A. 2003. Telegraphcq: Continuous dataflow processing. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD'03). ACM, New York, NY, 668--668.
[58]
Chandrasekaran, S. and Franklin, M. 2004. Remembrance of streams past: Overload-sensitive management of archived streams. In Proceedings of the 13th International Conference on Very Large Databases (VLDB'04). 348--359.
[59]
Chandrasekaran, S. and Franklin, M. J. 2002. Streaming queries over streaming data. In Proceedings of the 28th International Conference on Very Large Databases (VLDB'02). 203--214.
[60]
Chaudhuri, S. 1998. An overview of query optimization in relational systems. In Proceedings of the 17th ACM SIGACT Symposium on Principles of Database Systems (PODS'98). ACM, New York, NY, 34--43.
[61]
Chaudhuri, S. and Dayal, U. 1997. An overview of data warehousing and olap technology. SIGMOD Rec. 26, 1, 65--74.
[62]
Chen, J., DeWitt, D. J., Tian, F., and Wang, Y. 2000. Niagaracq: A scalable continuous query system for Internet databases. SIGMOD Rec. 29, 2, 379--390.
[63]
Cherniack, M., Balakrishnan, H., Balazinska, M., Carney, D., Cetintemel, U., Xing, Y., and Zdonik, S. 2003. Scalable distributed stream processing. In Proceedings of the 1st Biennial Conference on Innovative Data Systems Research (CIDR'03). ACM. CA.
[64]
Chi, Y., Wang, H., and Yu, P. S. 2005. Loadstar: Load shedding in data stream mining. In Proceedings of the 31st International Conference on Very Large Databases (VLDB'05), 1302--1305.
[65]
Clarke, E. M. and Schlingloff, B.-H. 2001. Model checking. In Handbook of Automated Reasoning, J. A. Robinson and A. Voronkov, Eds. The MIT Press, Cambridge, MA. 1635--1790.
[66]
Coral8. 2010a. http://www.coral8.com/. Last accessed 11/2010.
[67]
Coral8. 2010b. http://www.aleri.com/WebHelp/coral8_documentation.htm. Last assessed 11/2010.
[68]
Cranor, C., Gao, Y., Johnson, T., Shkapenyuk, V., and Spatscheck, O. 2002. Gigascope: High performance network monitoring with an sql interface. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD'02). ACM, New York, NY, 623--623.
[69]
Cranor, C., Johnson, T., Spataschek, O., and Shkapenyuk, V. 2003. Gigascope: A stream database for network applications. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD'03). ACM, New York, NY, 647--651.
[70]
Cugola, G., Di Nitto, E., and Fuggetta, A. 2001. The Jedi event-based infrastructure and its application to the development of the opss wfms. IEEE Trans. Softw. Eng. 27, 9, 827--850.
[71]
Cugola, G. and Margara, A. 2009. Raced: An adaptive middleware for complex event detection. In Proceedings of the 8th International Workshop on Adaptive and Reflective Middleware (ARM'09). ACM, New York, NY, 1--6.
[72]
Cugola, G. and Margara, A. 2010a. Complex event processing with t-rex. Tech. rep., Politecnico di Milano, Milano, Italy.
[73]
Cugola, G. and Margara, A. 2010b. Tesla: A formally defined event specification language. In Proceedings of the 4th ACM International Conference on Distributed Event-Based Systems (DEBS'10). ACM, New York, NY, 50--61.
[74]
Dayal, U., Blaustein, B., Buchmann, A., Chakravarthy, U., Hsu, M., Ledin, R., McCarthy, D., Rosenthal, A., Sarin, S., Carey, M. J., Livny, M., and Jauhari, R. 1988. The hipac project: Combining active databases and timing constraints. SIGMOD Rec. 17, 1, 51--70.
[75]
Debar, H. and Wespi, A. 2001. Aggregation and correlation of intrusion-detection alerts. In Proceedings of the International Symposium on Recent Advances in Intrusion Detection. 85--103.
[76]
Demers, A., Gehrke, J., Hong, M., Riedewald, M., and White, W. 2006. Towards expressive publish/subscribe systems. In Proceedings of the International Conference on Extending Database Technology (EDBT). 627--644.
[77]
Deutsch, A., Fernandez, M., Florescu, D., Levy, A., and Suciu, D. 1999. A query language for xml. Comput. Netw. 31, 11-16, 1155--1169.
[78]
Drusinsky, D. 2000. The temporal rover and the atg rover. In Proceedings of the 7th International SPIN Workshop on SPIN Model Checking and Software Verification. Springer-Verlag, London, UK, 323--330.
[79]
Eisenberg, A. and Melton, J. 1999. Sql: 1999, formerly known as sql3. SIGMOD Rec. 28, 1, 131--138.
[80]
Engstrm, H., Engstrm, H., Berndtsson, M., Berndtsson, M., Lings, B., and Lings, B. 1997. ACOOD essentials. Tech. rep. Hs-IDA-TR-97-010, University of Skörde, Sweden.
[81]
EPTS. 2010. http://www.ep-ts.com/. Last accessed 11/2010.
[82]
Esper. 2010. http://www.espertech.com/. Last accessed 11/2010.
[83]
Etzion, O. 2007. Event processing and the babylon tower. Event Processing Thinking Blog: http://epthinking.blogspot.com/2007/09/event-processing-and-babylon-tower.html.
[84]
Etzion, O. 2010. Event processing thinking. http://epthinking.blogspot.com/. Last accessed 11/2010.
[85]
Etzion, O. and Niblett, P. 2010. Event Processing in Action. Manning Publications Co., Greenwich, CT.
[86]
Eugster, P., Felber, P., Guerraoui, R., and Kermarrec, A.-M. 2003. The many faces of publish/subscribe. ACM Comput. Surv. 2, 35.
[87]
Event Zero. 2010a. http://www.eventzero.com/solutions/environment.aspx. Last accessed 11/2010.
[88]
EventZero. 2010b. http://www.eventzero.com/. Last accessed 11/2010.
[89]
Fiege, L., Mühl, G., and Gärtner, F. C. 2002. Modular event-based systems. Knowl. Eng. Rev. 17, 4, 359--388.
[90]
Forgy, C. L. 1982. Rete: A fast algorithm for the many pattern/many object pattern match problem. Artificial Intell. 19, 1, 17--37.
[91]
Galton, A. and Augusto, J. C. 2002. Two approaches to event definition. In Proceedings of the 13th International Conference Database and Expert Systems Applications (DEXA'02). 547--556.
[92]
Gatziu, S. and Dittrich, K. 1993. Events in an active object-oriented database system. In Proceedings of the International Workshop on Rules in Database Systems (RIDS), N. Paton and H. Williams, Eds. Workshops in Computing, Springer-Verlag, Edinburgh, U.K.
[93]
Gatziu, S., Geppert, A., and Dittrich, K. R. 1992. Integrating active concepts into an object-oriented database system. In Proceedings of the 3rd International Workshop on Database Programming Languages : Bulk Types & Persistent Data (DBPL3). Morgan Kaufmann Publishers Inc., San Francisco, CA, 399--415.
[94]
Gedik, B., Andrade, H., Wu, K.-L., Yu, P. S., and Doo, M. 2008. Spade: The systems declarative stream processing engine. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD'08). ACM, New York, NY, 1123--1134.
[95]
Gehani, N. H. and Jagadish, H. V. 1991. Ode as an active database: Constraints and triggers. In Proceedings of the 17th International Conference on Very Large Databases (VLDB'91). Morgan Kaufmann Publishers Inc., San Francisco, CA, 327--336.
[96]
Gehani, N. H., Jagadish, H. V., and Shmueli, O. 1992. Composite event specification in active databases: Model & implementation. In Proceedings of the 18th International Conference on Very Large Databases (VLDB'92). Morgan Kaufmann Publishers Inc., San Francisco, CA, 327--338.
[97]
Giannakopoulou, D. and Havelund, K. 2001. Runtime analysis of linear temporal logic specifications. Tech. rep., 01. 21, Research Institute for Advanced Computer Science, Mountain View, CA.
[98]
Golab, L. and Özsu, M. T. 2003. Issues in data stream management. SIGMOD Rec. 32, 2, 5--14.
[99]
Golab, L. and Özsu, M. T. 2005. Update-pattern-aware modeling and processing of continuous queries. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD'05). ACM, New York, NY, 658--669.
[100]
Gualtieri, M. and Rymer, J. 2009. The Forrester Wave#8482;: Complex Event Processing (CEP) Platforms, Q3 2009. White paper.
[101]
Gyllstrom, D., Agrawal, J., Diao, Y., and Immerman, N. 2008. On supporting kleene closure over event streams. In Proceedings of the IEEE 24th International Conference on Data Engineering (ICDE'08). IEEE Computer Society, Los Alamitos, CA, 1391--1393.
[102]
Havelund, K. and Rosu, G. 2002. Synthesizing monitors for safety properties. In Proceedings of the 8th International Conference on Tools and Algorithms for the Construction and Analysis of Systems (TACAS'02). Springer-Verlag, London, UK, 342--356.
[103]
Hwang, J.-H., Balazinska, M., Rasin, A., Cetintemel, U., Stonebraker, M., and Zdonik, S. 2005. High-availability algorithms for distributed stream processing. In Proceedings of the 21st International Conference on Data Engineering (ICDE'05). IEEE Computer Society, Los Alamitos, CA, 779--790.
[104]
IBM. 2008. http://www.ibm.com/software/integration/wbe/. Last accessed 11/2010.
[105]
IBM. 2010. http://www-935.ibm.com/services/us/index.wss. Last accessed 11/2010.
[106]
Ioannidis, Y. E. 1996. Query optimization. ACM Comput. Surv. 28, 1, 121--123.
[107]
Jain, N., Amini, L., Andrade, H., King, R., Park, Y., Selo, P., and Venkatramani, C. 2006. Design, implementation, and evaluation of the linear road bnchmark on the stream processing core. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD'06). ACM, New York, NY, 431--442.
[108]
Jain, N., Mishra, S., Srinivasan, A., Gehrke, J., Widom, J., Balakrishnan, H., Çetintemel, U., Cherniack, M., Tibbetts, R., and Zdonik, S. 2008. Towards a streaming sql standard. Proc. VLDB Endow. 1, 2, 1379--1390.
[109]
Jarke, M. and Koch, J. 1984. Query optimization in database systems. ACM Comput. Surv. 16, 2, 111--152.
[110]
Khandekar, R., Hildrum, K., Parekh, S., Rajan, D., Wolf, J., Wu, K.-L., Andrade, H., and Gedik, B. 2009. Cola: Optimizing stream processing applications via graph partitioning. In Proceedings of the 10th ACM/IFIP/USENIX International Conference on Middleware. Springer-Verlag New York, Inc., New York, NY, 1--20.
[111]
Khoussainova, N., Balazinska, M., and Suciu, D. 2008. Probabilistic event extraction from rfid data. In Proceedings of the IEEE 24th International Conference on Data Engineering (ICDE'08). IEEE Computer Society, Los Alamitos, CA, 1480--1482.
[112]
Konana, P., Liu, G., Lee, C.-G., and Woo, H. 2004. Specifying timing constraints and composite events: An application in the design of electronic brokerages. IEEE Trans. Softw. Eng. 30, 12, 841--858.
[113]
Kumar, V., Cooper, B. F., Cai, Z., Eisenhauer, G., and Schwan, K. 2005. Resource-aware distributed stream management using dynamic overlays. In Proceedings of the 25th IEEE International Conference on Distributed Computing Systems (ICDCS'05). IEEE Computer Society, Los Alamitos, CA, 783--792.
[114]
Lakshmanan, G. T., Li, Y., and Strom, R. 2008. Placement strategies for internet-scale data stream systems. IEEE Internet Comput. 12, 6, 50--60.
[115]
Lamport, L. 1978. Time, clocks, and the ordering of events in a distributed system. Commun. ACM 21, 7, 558--565.
[116]
Law, Y.-N., Wang, H., and Zaniolo, C. 2004. Query languages and data models for database sequences and data streams. In Proceedings of the 13th International Conference on Very Large Databases (VLDB'04). 492--503.
[117]
Leucker, M. and Schallhart, C. 2009. A brief account of runtime verification. In Proceedings of the 1st Workshop on Formal Languages and Analysis of Contract-Oriented Software (FLACOS'07). J. Logic Algebra. Program. 78, 5, 293--303.
[118]
Li, G. and Jacobsen, H.-A. 2005. Composite subscriptions in content-based publish/subscribe systems. In Proceedings of the 6th ACM/IFIP/USENIX International Conference on Middleware. Springer-Verlag New York, Inc., New York, NY, 249--269.
[119]
Lieuwen, D. F., Gehani, N. H., and Arlein, R. M. 1996. The ode active database: Trigger semantics and implementation. In Proceedings of the 12th International Conference on Data Engineering (ICDE'96). IEEE Computer Society, Los Alamitos, CA, 412--420.
[120]
Lin, E. Y.-T. and Zhou, C. 1999. Modeling and analysis of message passing in distributed manufacturing systems. IEEE Trans. Syst. Man, Cybernet. Part C 29, 2, 250--262.
[121]
Liu, H. and Jacobsen, H.-A. 2004. Modeling uncertainties in publish/subscribe systems. In Proceedings of the 20th International Conference on Data Engineering (ICDE'04). IEEE Computer Society, Los Alamitos, CA, 510.
[122]
Liu, L. and Pu, C. 1997. A dynamic query scheduling framework for distributed and evolving information systems. In Proceedings of the 17th International Conference on Distributed Computing Systems (ICDCS '97). IEEE Computer Society, Los Alamitos, CA, 474.
[123]
Liu, L., Pu, C., and Tang, W. 1999. Continual queries for internet scale event-driven information delivery. IEEE Trans. Knowl. Data Eng. 11, 4, 610--628.
[124]
Luckham, D. 1996. Rapide: A language and toolset for simulation of distributed systems by partial orderings of events. Tech. rep. Stanford University, Stanford, CA.
[125]
Luckham, D. 2010. http://complexevents.com/. Last accessed 11/2010.
[126]
Luckham, D. C. 2001. The Power of Events: An Introduction to Complex Event Processing in Distributed Enterprise Systems. Addison-Wesley Longman Publishing Co., Inc., Boston, MA.
[127]
Luckham, D. C. and Vera, J. 1995. An event-based architecture definition language. IEEE Trans. Softw. Eng. 21, 717--734.
[128]
Madden, S., Shah, M., Hellerstein, J. M., and Raman, V. 2002. Continuously adaptive continuous queries over streams. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD'02). ACM, New York, NY, 49--60.
[129]
Magee, J., Dulay, N., and Kramer, J. 1994. Regis: A constructive development environment for distributed programs. Distrib. Syst. Eng. 1, 5, 304--312.
[130]
Maler, O., Nickovic, D., and Pnueli, A. 2006. From mitl to timed automata. In Proceedings of the International Conference on Formal Modeling and Analysis of Timed Systems (FORMATS'06). 274--289.
[131]
Mansouri-Samani, M. and Sloman, M. 1993. Monitoring distributed systems. Netw. IEEE 7, 6, 20--30.
[132]
Mansouri-Samani, M. and Sloman, M. 1996. A configurable event service for distributed systems. In Proceedings of the 3rd International Conference on Configurable Distributed Systems (ICCDS'96). IEEE Computer Society, Washington, DC, USA, 210.
[133]
Mansouri-Samani, M. and Sloman, M. 1997. Gem: A generalized event monitoring language for distributed systems. Distrib. Syst. Eng. 4, 96--108.
[134]
McCarthy, D. and Dayal, U. 1989. The architecture of an active database management system. SIGMOD Rec. 18, 2, 215--224.
[135]
Mühl, G., Fiege, L., and Pietzuch, P. 2006. Distributed Event-Based Systems. Springer.
[136]
O'Keeffe, D. and Bacon, J. 2010. Reliable complex event detection for pervasive computing. In Proceedings of the 4th ACM International Conference on Distributed Event-Based Systems (DEBS'10). ACM, New York, NY, 73--84.
[137]
Oracle. 2010. http://www.oracle.com/technologies/soa/complex-event-processing.html. Last accessed 11/2010.
[138]
Pallickara, S. and Fox, G. 2003. Naradabrokering: A distributed middleware framework and architecture for enabling durable peer-to-peer grids. In Proceedings of the ACM/IFIP/USENIX 2003 International Conference on Middleware. Springer-Verlag New York, Inc., New York, NY, 41--61.
[139]
Pandey, S., Dhamdhere, K., and Olston, C. 2004. Wic: A general-purpose algorithm for monitoring web information sources. In Proceedings of the 13th International Conference on Very Large Databases (VLDB'04). 360--371.
[140]
Park, J., Reveliotis, S. A., Bodner, D. A., and McGinnis, L. F. 2002. A distributed, event-driven control architecture for flexibly automated manufacturing systems. Int. J. Comput. Integ. Manuf. 15, 2, 109--126.
[141]
Paton, N. W. and Díaz, O. 1999. Active database systems. ACM Comput. Surv. 31, 1, 63--103.
[142]
Pietzuch, P., Ledlie, J., Shneidman, J., Roussopoulos, M., Welsh, M., and Seltzer, M. 2006. Network-aware operator placement for stream-processing systems. In Proceedings of the 22nd International Conference on Data Engineering (ICDE'06). IEEE Computer Society, Los Alamitos, CA, 49.
[143]
Pietzuch, P. R. and Bacon, J. 2002. Hermes: A distributed event-based middleware architecture. In Proceedings of the 22nd International Conference on Distributed Computing Systems (ICDCSW'02). IEEE Computer Society, Los Alamitos, CA, 611--618.
[144]
Pietzuch, P. R., Shand, B., and Bacon, J. 2003. A framework for event composition in distributed systems. In Proceedings of the ACM/IFIP/USENIX International Middleware Conference. 62--82.
[145]
Pnueli, A. 1997. The temporal logic of programs. Tech. rep., Weizmann Science Press of Israel, Jerusalem, Israel.
[146]
Progress-Apama. 2010. http://web.progress.com/it-need/complex-event-processing.html. Last accessed 11/2010.
[147]
Raman, V., Raman, B., and Hellerstein, J. M. 1999. Online dynamic reordering for interactive data processing. In Proceedings of the 25th International Conference on Very Large Databases (VLDB'99). Morgan Kaufmann Publishers Inc., San Francisco, CA, 709--720.
[148]
Repantis, T., Gu, X., and Kalogeraki, V. 2006. Synergy: Sharing-aware component composition for distributed stream processing systems. In Proceedings of the ACM/IFIP/USENIX 2006 International Conference on Middleware. Springer-Verlag New York, Inc., New York, NY, 322--341.
[149]
Roitman, H., Gal, A., and Raschid, L. 2008. Satisfying complex data needs using pull-based online monitoring of volatile data sources. In Proceedings of the IEEE 24th International Conference on Data Engineering (ICDE'08). IEEE Computer Society, Los Alamitos, CA, 1465--1467.
[150]
Roitman, H., Gal, A., and Raschid, L. 2010a. A dual framework and algorithms for targeted online data delivery. IEEE Trans. Knowl. Data Eng. 99, Preprints.
[151]
Roitman, H., Gal, A., and Raschid, L. 2010b. On trade-offs in event delivery systems. In Proceedings of the 4th ACM International Conference on Distributed Event-Based Systems (DEBS'10). ACM, New York, NY, 116--127.
[152]
Rosenblum, D. and Wolf, A. L. 1997. A design framework for internet-scale event observation and notification. In Proceedings of the 6th European Software Engineering Conference (ESEC/FSE). Lacture Notes in Computer Science, Springer-Verlag, Berlin, 1301.
[153]
Sadri, R., Zaniolo, C., Zarkesh, A., and Adibi, J. 2004. Expressing and optimizing sequence queries in database systems. ACM Trans. Database Syst. 29, 2, 282--318.
[154]
Schultz-Moeller, N. P., Migliavacca, M., and Pietzuch, P. 2009. Distributed complex event processing with query optimisation. In Proceedings of the International Conference on Distributed Event-Based Systems (DEBS'09).
[155]
Sellis, T. K. 1988. Multiple-query optimization. ACM Trans. Database Syst. 13, 1, 23--52.
[156]
Shah, M. A., Hellerstein, J. M., and Brewer, E. 2004a. Highly available, fault-tolerant, parallel dataflows. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD'04). ACM, New York, NY, 827--838.
[157]
Shah, M. A., Hellerstein, J. M., and Brewer, E. 2004b. Highly available, fault-tolerant, parallel dataflows. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD'04). ACM, New York, NY, 827--838.
[158]
Shah, M. A., Hellerstein, J. M., Chandrasekaran, S., and Franklin, M. J. 2003. Flux: An adaptive partitioning operator for continuous query systems. In Proceedings of the International Conference on Data Engineering. 25.
[159]
Srivastava, U. and Widom, J. 2004. Memory-limited execution of windowed stream joins. In Proceedings of the 13th International Conference on Very Large Databases (VLDB'04). 324--335.
[160]
Stolz, V. 2007. Temporal assertions with parametrized propositions. In Proceedings of the Runtime Verification Workshop (RV'07). 176--187.
[161]
Streambase. 2010a. http://www.streambase.com/. Last accessed 10/2010.
[162]
Streambase. 2010b. http://streambase.com/developers/docs/latest/streamsql/index.html. Last accessed 11/2010.
[163]
Strom, R. E., Banavar, G., Chandra, T. D., Kaplan, M., Miller, K., Mukherjee, B., Sturman, D. C., and Ward, M. 1998. Gryphon: An information flow-based approach to message brokering. In Proceedings of the International Symposium on Software Reliability Engineering.
[164]
Sullivan, M. and Heybey, A. 1998. Tribeca: A system for managing large databases of network traffic. In Proceedings of the Annual Conference on USENIX Annual Technical Conference (ATEC'98). USENIX Association, Berkeley, CA, 2--2.
[165]
Tatbul, N., Çetintemel, U., Zdonik, S., Cherniack, M., and Stonebraker, M. 2003. Load shedding in a data stream manager. In Proceedings of the 29th International Conference on Very Large Databases (VLDB'03). 309--320.
[166]
Tatbul, N. and Zdonik, S. 2006a. Dealing with overload in distributed stream processing systems. In Proceedings of the 22nd International Conference on Data Engineering Workshops (ICDEW'06). IEEE Computer Society, Los Alamitos, CA, 24.
[167]
Tatbul, N. and Zdonik, S. 2006b. Window-aware load shedding for aggregation queries over data streams. In Proceedings of the 32nd International Conference on Very Large Databases (VLDB'06), 799--810.
[168]
Tibco. 2010. http://www.tibco.com/software/complex-event-processing/businessevents/default.jsp. Last accessed 11/2010.
[169]
Van Renesse, R., Birman, K. P., and Vogels, W. 2003. Astrolabe: A robust and scalable technology for distributed system monitoring, management, and data mining. ACM Trans. Comput. Syst. 21, 2, 164--206.
[170]
Wang, F. and Liu, P. 2005. Temporal management of rfid data. In Proceedings of the International Conference on Very Large Database (VLDB'05) 1128--1139.
[171]
Wasserkrug, S., Gal, A., Etzion, O., and Turchin, Y. 2008. Complex event processing over uncertain data. In Proceedings of the 2nd International Conference on Distributed Event-Based Systems (DEBS'08). ACM, New York, NY, 253--264.
[172]
White, W., Riedewald, M., Gehrke, J., and Demers, A. 2007. What is “next” in event processing? In Proceedings of the 26th ACM SIGMOD-PODS Symposium on Principles of Database Systems (PODS'07). ACM, New York, NY, 263--272.
[173]
Widom, J. and Ceri, S. 1996. Introduction to active database systems. In Active Database Systems: Triggers and Rules For Advanced Database Processing. Morgan Kaufmann, 1--41.
[174]
Wolf, J., Bansal, N., Hildrum, K., Parekh, S., Rajan, D., Wagle, R., Wu, K.-L., and Fleischer, L. 2008. Soda: An optimizing scheduler for large-scale stream-based distributed computer systems. In Proceedings of the 9th ACM/IFIP/USENIX International Conference on Middleware. Springer-Verlag New York, Inc., New York, NY, 306--325.
[175]
Wright, M., Chodzko, J., and Luk, D. 2010. Principles and Applications of Distributed Event-Based Systems. IGI Global, 1--18.
[176]
Wu, E., Diao, Y., and Rizvi, S. 2006. High-performance complex event processing over streams. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD'06). ACM, New York, NY, 407--418.
[177]
Wu, K.-L., Hildrum, K. W., Fan, W., Yu, P. S., Aggarwal, C. C., George, D. A., Gedik, B., Bouillet, E., Gu, X., Luo, G., and Wang, H. 2007. Challenges and experience in prototyping a multimodal stream analytic and monitoring application on system s. In Proceedings of the 33rd International Conference on Very Large Databases (VLDB'07). 1185--1196.
[178]
Xu, J., Tang, X., and Lee, W.-C. 2006. Time-critical on-demand data broadcast: Algorithms, analysis, and performance evaluation. IEEE Trans. Parallel Distrib. Syst. 17, 3--14.
[179]
Yalagandula, P. and Dahlin, M. 2004. A scalable distributed information management system. In Proceedings of the Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications (SIGCOMM'04). ACM, New York, NY, 379--390.
[180]
Zhou, Y., Ooi, B. C., Tan, K.-L., and Wu, J. 2006. Efficient dynamic operator placement in a locally distributed continuous query system. In Proceedings of the OTM Conferences. 54--71.
[181]
Zimmer, D. 1999. On the semantics of complex events in active database management systems. In Proceedings of the 15th International Conference on Data Engineering (ICDE'99). IEEE Computer Society, Los Alamitos, CA, 392.

Cited By

View all
  • (2025)DISCES: Systematic Discovery of Event Stream QueriesProceedings of the ACM on Management of Data10.1145/37096823:1(1-26)Online publication date: 11-Feb-2025
  • (2025)Vamos: Middleware for best-effort third-party monitoringScience of Computer Programming10.1016/j.scico.2024.103212240(103212)Online publication date: Feb-2025
  • (2025)Programming IoT systems: A focused conceptual framework and survey of approachesInternet of Things10.1016/j.iot.2025.101548(101548)Online publication date: Feb-2025
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Computing Surveys
ACM Computing Surveys  Volume 44, Issue 3
June 2012
344 pages
ISSN:0360-0300
EISSN:1557-7341
DOI:10.1145/2187671
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 June 2012
Accepted: 01 October 2010
Revised: 01 March 2010
Received: 01 November 2009
Published in CSUR Volume 44, Issue 3

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Complex event processing
  2. publish-subscribe
  3. stream processing

Qualifiers

  • Research-article
  • Research
  • Refereed

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)312
  • Downloads (Last 6 weeks)26
Reflects downloads up to 25 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2025)DISCES: Systematic Discovery of Event Stream QueriesProceedings of the ACM on Management of Data10.1145/37096823:1(1-26)Online publication date: 11-Feb-2025
  • (2025)Vamos: Middleware for best-effort third-party monitoringScience of Computer Programming10.1016/j.scico.2024.103212240(103212)Online publication date: Feb-2025
  • (2025)Programming IoT systems: A focused conceptual framework and survey of approachesInternet of Things10.1016/j.iot.2025.101548(101548)Online publication date: Feb-2025
  • (2025)Operational process monitoring: An object-centric approachComputers in Industry10.1016/j.compind.2024.104170164(104170)Online publication date: Jan-2025
  • (2025)Budget-Constrained Runtime Allocation of Linked Data Services in Stream ProcessingData Science and Engineering10.1007/s41019-024-00277-4Online publication date: 10-Feb-2025
  • (2025)RL4CEP: reinforcement learning for updating CEP rulesComplex & Intelligent Systems10.1007/s40747-024-01742-311:2Online publication date: 9-Jan-2025
  • (2025)Can’t you answer while you wait?Annals of Mathematics and Artificial Intelligence10.1007/s10472-025-09968-8Online publication date: 17-Jan-2025
  • (2024)A Framework for IoT Data Collection and Fusion in Infectious Diseases SurveillanceDesigning Sustainable Internet of Things Solutions for Smart Industries10.4018/979-8-3693-5498-8.ch009(229-278)Online publication date: 22-Nov-2024
  • (2024)A Systematic Review of Event-Matching Methods for Complex Event Detection in Video StreamsSensors10.3390/s2422723824:22(7238)Online publication date: 13-Nov-2024
  • (2024)Modeling and Performance Analysis of a Notification-Based Method for Processing Video Queries on the FlyApplied Sciences10.3390/app1409356614:9(3566)Online publication date: 24-Apr-2024
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media