Gianpaolo Cugola
Alessandro Margara
Skip Abstract Section
Abstract
A large number of distributed applications requires continuous and timely processing of information as it flows from the periphery to the center of the system. Examples include intrusion detection systems which analyze network traffic in real-time to identify possible attacks; environmental monitoring applications which process raw data coming from sensor networks to identify critical situations; or applications performing online analysis of stock prices to identify trends and forecast future values.
Traditional DBMSs, which need to store and index data before processing it, can hardly fulfill the requirements of timeliness coming from such domains. Accordingly, during the last decade, different research communities developed a number of tools, which we collectively call Information flow processing (IFP) systems, to support these scenarios. They differ in their system architecture, data model, rule model, and rule language. In this article, we survey these systems to help researchers, who often come from different backgrounds, in understanding how the various approaches they adopt may complement each other.
In particular, we propose a general, unifying model to capture the different aspects of an IFP system and use it to provide a complete and precise classification of the systems and mechanisms proposed so far.
- Abadi, D., Carney, D., Çetintemel, U., Cherniack, M., Convey, C., Erwin, C., Galvez, E., Hatoun, M., Maskey, A., Rasin, A., Singer, A., Stonebraker, M., Tatbul, N., Xing, Y., Yan, R., and Zdonik, S. 2003. Aurora: A data stream management system. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD'03). ACM, New York, NY, 666. Google Scholar
Digital Library
- Abadi, D., Carney, D., Cetintemel, U., Cherniack, M., Convey, C., Lee, S., Stonebraker, M., Tatbul, N., and S., Z. 2003. Aurora: A new model and architecture for data stream management. VLDB J. 12, 2. Google ScholarDigital Library
- Abadi, D. J., Ahmad, Y., Balazinska, M., Cetintemel, U., Cherniack, M., Hwang, J.-H., Lindner, W., Maskey, A. S., Rasin, A., Ryvkina, E., Tatbul, N., Xing, Y., and Zdonik, S. B. 2005. The design of the Borealis stream processing engine. In Proceedings of the 2nd Biennial Conference on Innovative Data Systems Research (CIDR2005). ACM.Google Scholar
- Adaikkalavan, R. and Chakravarthy, S. 2006. Snoopib: Interval-based event specification and detection for active databases. Data Knowl. Eng. 59, 1, 139--165. Google ScholarDigital Library
- Adi, A. and Etzion, O. 2004. Amit—The situation manager. VLDB J. 13, 2, 177--203. Google ScholarDigital Library
- Agrawal, J., Diao, Y., Gyllstrom, D., and Immerman, N. 2008. Efficient pattern matching over event streams. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD'08). ACM, New York, NY, 147--160. Google ScholarDigital Library
- Aguilera, M. K., Strom, R. E., Sturman, D. C., Astley, M., and Chandra, T. D. 1999. Matching events in a content-based subscription system. In Proceedings of the 18th Annual ACM Symposium on Principles of Distributed Computing (PODC'99). ACM, New York, NY, 53--61. Google ScholarDigital Library
- Ahmad, Y., Berg, B., Cetintemel, U., Humphrey, M., Hwang, J.-H., Jhingran, A., Maskey, A., Papaemmanouil, O., Rasin, A., Tatbul, N., Xing, W., Xing, Y., and Zdonik, S. 2005. Distributed operation in the Borealis stream processing engine. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD'05). ACM, New York, NY, 882--884. Google ScholarDigital Library
- Ahmad, Y. and Çetintemel, U. 2004. Network-aware query processing for stream-based applications. In Proceedings of the 13th International Conference on Very Large Databases (VLDB'04). 456--467. Google ScholarDigital Library
- Akdere, M., Çetintemel, U., and Tatbul, N. 2008. Plan-based complex event detection across distributed sources. Proc. VLDB. 1, 1, 66--77. Google ScholarDigital Library
- Aleri. 2010. http://www.aleri.com/. Last accessed 11/2010.Google Scholar
- Altinel, M. and Franklin, M. J. 2000. Efficient filtering of xml documents for selective dissemination of information. In Proceedings of the International Conference on Very Large Databases (VLDB'00). Morgan Kaufmann Publishers Inc., San Francisco, CA, 53--64. Google ScholarDigital Library
- Amini, L., Andrade, H., Bhagwan, R., Eskesen, F., King, R., Selo, P., Park, Y., and Venkatramani, C. 2006. Spc: A distributed, scalable platform for data mining. In Proceedings of the 4th International Workshop on Data Mining Standards, Services and Platforms (DMSSP'06). ACM, New York, NY, 27--37. Google ScholarDigital Library
- Amini, L., Jain, N., Sehgal, A., Silber, J., and Verscheure, O. 2006. Adaptive control of extreme-scale stream processing systems. In Proceedings of the 26th IEEE International Conference on Distributed Computing Systems (ICDCS'06). IEEE Computer Society, Los Alamitos, CA, 71. Google ScholarDigital Library
- Arasu, A., Babcock, B., Babu, S., Datar, M., Ito, K., Nishizawa, I., Rosenstein, J., and Widom, J. 2003. Stream: The stanford stream data manager. IEEE Data Eng. Bull. 26.Google Scholar
- Arasu, A., Babu, S., and Widom, J. 2002. An abstract semantics and concrete language for continuous queries over streams and relations. Tech. rep. 2002-57, Stanford InfoLab, Stanford, CA.Google Scholar
- Arasu, A., Babu, S., and Widom, J. 2006. The CQL continuous query language: Semantic foundations and query execution. VLDB J. 15, 2, 121--142. Google ScholarDigital Library
- Ashayer, G., Leung, H. K. Y., and Jacobsen, H.-A. 2002. Predicate matching and subscription matching in publish/subscribe systems. In Proceedings of the Workshop on Distributed Event-based Systems, co-located with the 22nd International Conference on Distributed Computing Systems. IEEE Computer Society Press, Los Alamitos, CA. Google ScholarDigital Library
- Avnur, R. and Hellerstein, J. M. 2000. Eddies: Continuously adaptive query processing. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD'00). ACM, New York, NY, 261--272. Google ScholarDigital Library
- Babcock, B., Babu, S., Datar, M., Motwani, R., and Widom, J. 2002. Models and issues in data stream systems. In Proceedings of the 21st ACM SIGMOD/PODS Symposium on Principles of Database Systems (PODS'02). ACM, New York, NY, 1--16. Google ScholarDigital Library
- Babcock, B., Datar, M., and Motwani, R. 2004. Load shedding for aggregation queries over data streams. In Proceedings of the 20th International Conference on Data Engineering (ICDE'04). IEEE Computer Society, Los Alamitos, CA, 350. Google ScholarDigital Library
- Babu, S. and Widom, J. 2001. Continuous queries over data streams. SIGMOD Rec. 30, 3, 109--120. Google ScholarDigital Library
- Bagchi, A., Chaudhary, A., Goodrich, M., Li, C., and Shmueli-Scheuer, M. 2006. Achieving communication efficiency through push-pull partitioning of semantic spaces to disseminate dynamic information. IEEE Trans. Knowl. Data Eng. 18, 10, 1352--1367. Google ScholarDigital Library
- Bai, Y., Thakkar, H., Wang, H., Luo, C., and Zaniolo, C. 2006. A data stream language and system designed for power and extensibility. In Proceedings of the 15th ACM International Conference on Information and Knowledge Management (CIKM'06). ACM, New York, NY, 337--346. Google ScholarDigital Library
- Balazinska, M., Balakrishnan, H., Madden, S. R., and Stonebraker, M. 2008. Fault-tolerance in the Borealis distributed stream processing system. ACM Trans. Database Syst. 33, 1, 1--44. Google ScholarDigital Library
- Balazinska, M., Balakrishnan, H., and Stonebraker, M. 2004. Contract-based load management in federated distributed systems. In Proceedings of the 1st Symposium on Networked Systems Design and Implementation (NSDI'04). USENIX Association, 15. Google ScholarDigital Library
- Balter, R. 2004. JORAM: The open source enterprise service bus. Tech. rep., ScalAgent Distributed Technologies SA, Echirolles Cedex, France.Google Scholar
- Barbon, F., Traverso, P., Pistore, M., and Trainotti, M. 2006a. Run-time monitoring of instances and classes of Web service compositions. In Proceedings of the IEEE International Conference on Web Services (ICWS'06). IEEE Computer Society, Los Alamitos, CA, 63--71. Google ScholarDigital Library
- Barbon, F., Traverso, P., Pistore, M., and Trainotti, M. 2006b. Run-time monitoring of the execution of plans for Web service composition. In Proceedings of the 16th International Conference on Automated Planning and Scheduling (ICAPS'06). 346--349.Google Scholar
- Baresi, L., Bianculli, D., Ghezzi, C., Guinea, S., and Spoletini, P. 2007. Validation of Web service compositions. IET Softw. 1, 6, 219--232.Google ScholarCross Ref
- Baresi, L. and Guinea, S. 2005a. Dynamo: Dynamic monitoring of ws-bpel processes. In Proceedings of the 3rd International Conference on Service-Oriented Computing (ICSOC'05). 478--483. Google ScholarDigital Library
- Baresi, L. and Guinea, S. 2005b. Towards dynamic monitoring of ws-bpel processes. In Proceedings of the 3rd International Conference on Service-Oriented Computing (ICSOC'05). 269--282. Google ScholarDigital Library
- Baresi, L., Guinea, S., Kazhamiakin, R., and Pistore, M. 2008. An integrated approach for the runtime monitoring of bpel orchestrations. In Proceedings of the 1st European Conference on Towards a Service-Based Internet. Lecture Notes in Computer Science vol. 5377, Springer-Verlag, Berlin, 1--12. Google ScholarDigital Library
- Barga, R. S., Goldstein, J., Ali, M. H., and Hong, M. 2007. Consistent streaming through time: A vision for event stream processing. In Proceedings of the 3rd Biennial Conference on Innovative Data Systems Research (CIDR'07). 363--374.Google Scholar
- Barringer, H., Goldberg, A., Havelund, K., and Sen, K. 2004. Rule-based runtime verification. In Proceedings of the 5th International Conference on Verification, Model Checking, and Abstract Interpretation (VMCAI'04). 44--57.Google Scholar
- Bass, T. 2007. Mythbusters: Event stream processing v. complex event processing. Keynote speech at the 1st International Confrence on Distributed Event-Based Systems (DEBS'07). Google ScholarDigital Library
- Bauer, A., Leucker, M., and Schallhart, C. 2006a. Model-based runtime analysis of distributed reactive systems. In Proceedings of the 17th Australian Software Engineering Conference (ASWEC'06). 243--252. Google ScholarDigital Library
- Bauer, A., Leucker, M., and Schallhart, C. 2006b. Monitoring of real-time properties. In Proceedings of the 26th Conference on Foundations of Software Technology and Theoretical Computer Science (FSTTCS), S. Arun-Kumar and N. Garg, Eds. Lecture Notes in Computer Science, vol. 4337. Springer-Verlag, Berlin. Google ScholarDigital Library
- Bauer, A., Leucker, M., and Schallhart, C. 2007. The good, the bad, and the ugly, but how ugly is ugly? In Runtime Verification, 7th International Workshop (RV 2007). Lecture Notes in Computer Science, vol. 5289, 126--138. Google ScholarDigital Library
- Bauer, A., Leucker, M., and Schallhart, C. 2010. Runtime verification for LTL and TLTL. ACM Trans. Softw. Eng. Methodol. Forthcoming. Google ScholarDigital Library
- Beeri, C., Eyal, A., Milo, T., and Pilberg, A. 2007. Monitoring business processes with queries. In Proceedings of the 33rd International Conference on Very Large Databases (VLDB'07). 603--614. Google ScholarDigital Library
- Bertino, E., Ferrari, E., and Guerrini, G. 1998. An approach to model and query event-based temporal data. In Proceedings of the International Symposium on Temporal Representation and Reasoning, 122. Google ScholarDigital Library
- Bozdag, E., Mesbah, A., and van Deursen, A. 2007. A comparison of push and pull techniques for AJAX. Tech. rep. Tud-SERG-2007-016a, Delft University of Technology, Delft, The Netherlands.Google Scholar
- Brenna, L., Demers, A., Gehrke, J., Hong, M., Ossher, J., Panda, B., Riedewald, M., Thatte, M., and White, W. 2007. Cayuga: A high-performance event processing engine. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD'07). ACM, New York, NY, 1100--1102. Google ScholarDigital Library
- Broda, K., Clark, K., Miller, R., and Russo, A. 2009. Sage: A logical agent-based environment monitoring and control system. In Proceedings of the European Conference on Ambient Intelligence (AmI'09). 112--117. Google ScholarDigital Library
- Buchmann, A. P., Deutsch, A., Zimmermann, J., and Higa, M. 1995. The reach active oodbms. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD'95). ACM, New York, NY, 476. Google ScholarDigital Library
- Campailla, A., Chaki, S., Clarke, E., Jha, S., and Veith, H. 2001. Efficient filtering in publish-subscribe systems using binary decision diagrams. In Proceedings of the 23rd International Conference on Software Engineering (ICSE'01). IEEE Computer Society, Los Alamitos, CA, 443--452. Google ScholarDigital Library
- Carney, D., Çetintemel, U., Cherniack, M., Convey, C., Lee, S., Seidman, G., Stonebraker, M., Tatbul, N., and Zdonik, S. 2002. Monitoring streams: A new class of data management applications. In Proceedings of the 28th International Conference on Very Large Databases (VLDB'02). 215--226. Google ScholarDigital Library
- Carzaniga, A., Rosenblum, D., and Wolf, A. 2001. Design and evaluation of a wide-area event notification service. ACM Trans. Comp. Syst. 19, 3, 332--383. Google ScholarDigital Library
- Carzaniga, A., Rosenblum, D. S., and Wolf, A. L. 2000. Achieving scalability and expressiveness in an internet-scale event notification service. In Proceedings of the 19th Annual ACM Symposium on Principles of Distributed Computing. 219--227. Google ScholarDigital Library
- Carzaniga, A. and Wolf, A. L. 2002. Content-based networking: A new communication infrastructure. In Proceedings of the Revised Papers from the NSF Workshop on Developing an Infrastructure for Mobile and Wireless Systems (IMWS'01). Springer-Verlag, London, UK, 59--68. Google ScholarDigital Library
- Carzaniga, A. and Wolf, A. L. 2003. Forwarding in a content-based network. In Proceedings of the Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications (SIGCOMM'03). ACM, New York, NY, 163--174. Google ScholarDigital Library
- Chakravarthy, S. and Adaikkalavan, R. 2008. Events and streams: Harnessing and unleashing their synergy! In Proceedings of the 2nd International Conference on Distributed Event-Based Systems (DEBS'08). ACM, New York, NY, 1--12. Google ScholarDigital Library
- Chakravarthy, S., Anwar, E., Maugis, L., and Mishra, D. 1994. Design of sentinel: An object-oriented dmbs with event-based rules. Inform. Softw. Technol. 36, 9, 555--568.Google ScholarCross Ref
- Chakravarthy, S. and Mishra, D. 1994. Snoop: An expressive event specification language for active databases. Data Knowl. Eng. 14, 1, 1--26. Google ScholarDigital Library
- Chand, R. and Felber, P. 2004. Xnet: a Reliable content-based publish/subscribe system. In Proceedings of the 23rd IEEE International Symposium on Reliable Distributed Systems. 264--273. Google ScholarDigital Library
- Chandrasekaran, S., Cooper, O., Deshpande, A., Franklin, M. J., Hellerstein, J. M., Hong, W., Krishnamurthy, S., Madden, S. R., Reiss, F., and Shah, M. A. 2003. Telegraphcq: Continuous dataflow processing. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD'03). ACM, New York, NY, 668--668. Google ScholarDigital Library
- Chandrasekaran, S. and Franklin, M. 2004. Remembrance of streams past: Overload-sensitive management of archived streams. In Proceedings of the 13th International Conference on Very Large Databases (VLDB'04). 348--359. Google ScholarDigital Library
- Chandrasekaran, S. and Franklin, M. J. 2002. Streaming queries over streaming data. In Proceedings of the 28th International Conference on Very Large Databases (VLDB'02). 203--214. Google ScholarDigital Library
- Chaudhuri, S. 1998. An overview of query optimization in relational systems. In Proceedings of the 17th ACM SIGACT Symposium on Principles of Database Systems (PODS'98). ACM, New York, NY, 34--43. Google ScholarDigital Library
- Chaudhuri, S. and Dayal, U. 1997. An overview of data warehousing and olap technology. SIGMOD Rec. 26, 1, 65--74. Google ScholarDigital Library
- Chen, J., DeWitt, D. J., Tian, F., and Wang, Y. 2000. Niagaracq: A scalable continuous query system for Internet databases. SIGMOD Rec. 29, 2, 379--390. Google ScholarDigital Library
- Cherniack, M., Balakrishnan, H., Balazinska, M., Carney, D., Cetintemel, U., Xing, Y., and Zdonik, S. 2003. Scalable distributed stream processing. In Proceedings of the 1st Biennial Conference on Innovative Data Systems Research (CIDR'03). ACM. CA.Google Scholar
- Chi, Y., Wang, H., and Yu, P. S. 2005. Loadstar: Load shedding in data stream mining. In Proceedings of the 31st International Conference on Very Large Databases (VLDB'05), 1302--1305. Google ScholarDigital Library
- Clarke, E. M. and Schlingloff, B.-H. 2001. Model checking. In Handbook of Automated Reasoning, J. A. Robinson and A. Voronkov, Eds. The MIT Press, Cambridge, MA. 1635--1790. Google ScholarDigital Library
- Coral8. 2010a. http://www.coral8.com/. Last accessed 11/2010.Google Scholar
- Coral8. 2010b. http://www.aleri.com/WebHelp/coral8_documentation.htm. Last assessed 11/2010.Google Scholar
- Cranor, C., Gao, Y., Johnson, T., Shkapenyuk, V., and Spatscheck, O. 2002. Gigascope: High performance network monitoring with an sql interface. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD'02). ACM, New York, NY, 623--623. Google ScholarDigital Library
- Cranor, C., Johnson, T., Spataschek, O., and Shkapenyuk, V. 2003. Gigascope: A stream database for network applications. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD'03). ACM, New York, NY, 647--651. Google ScholarDigital Library
- Cugola, G., Di Nitto, E., and Fuggetta, A. 2001. The Jedi event-based infrastructure and its application to the development of the opss wfms. IEEE Trans. Softw. Eng. 27, 9, 827--850. Google ScholarDigital Library
- Cugola, G. and Margara, A. 2009. Raced: An adaptive middleware for complex event detection. In Proceedings of the 8th International Workshop on Adaptive and Reflective Middleware (ARM'09). ACM, New York, NY, 1--6. Google ScholarDigital Library
- Cugola, G. and Margara, A. 2010a. Complex event processing with t-rex. Tech. rep., Politecnico di Milano, Milano, Italy.Google Scholar
- Cugola, G. and Margara, A. 2010b. Tesla: A formally defined event specification language. In Proceedings of the 4th ACM International Conference on Distributed Event-Based Systems (DEBS'10). ACM, New York, NY, 50--61. Google ScholarDigital Library
- Dayal, U., Blaustein, B., Buchmann, A., Chakravarthy, U., Hsu, M., Ledin, R., McCarthy, D., Rosenthal, A., Sarin, S., Carey, M. J., Livny, M., and Jauhari, R. 1988. The hipac project: Combining active databases and timing constraints. SIGMOD Rec. 17, 1, 51--70. Google ScholarDigital Library
- Debar, H. and Wespi, A. 2001. Aggregation and correlation of intrusion-detection alerts. In Proceedings of the International Symposium on Recent Advances in Intrusion Detection. 85--103. Google ScholarDigital Library
- Demers, A., Gehrke, J., Hong, M., Riedewald, M., and White, W. 2006. Towards expressive publish/subscribe systems. In Proceedings of the International Conference on Extending Database Technology (EDBT). 627--644. Google ScholarDigital Library
- Deutsch, A., Fernandez, M., Florescu, D., Levy, A., and Suciu, D. 1999. A query language for xml. Comput. Netw. 31, 11-16, 1155--1169. Google ScholarDigital Library
- Drusinsky, D. 2000. The temporal rover and the atg rover. In Proceedings of the 7th International SPIN Workshop on SPIN Model Checking and Software Verification. Springer-Verlag, London, UK, 323--330. Google ScholarDigital Library
- Eisenberg, A. and Melton, J. 1999. Sql: 1999, formerly known as sql3. SIGMOD Rec. 28, 1, 131--138. Google ScholarDigital Library
- Engstrm, H., Engstrm, H., Berndtsson, M., Berndtsson, M., Lings, B., and Lings, B. 1997. ACOOD essentials. Tech. rep. Hs-IDA-TR-97-010, University of Skörde, Sweden.Google Scholar
- EPTS. 2010. http://www.ep-ts.com/. Last accessed 11/2010.Google Scholar
- Esper. 2010. http://www.espertech.com/. Last accessed 11/2010.Google Scholar
- Etzion, O. 2007. Event processing and the babylon tower. Event Processing Thinking Blog: http://epthinking.blogspot.com/2007/09/event-processing-and-babylon-tower.html.Google Scholar
- Etzion, O. 2010. Event processing thinking. http://epthinking.blogspot.com/. Last accessed 11/2010.Google Scholar
- Etzion, O. and Niblett, P. 2010. Event Processing in Action. Manning Publications Co., Greenwich, CT. Google ScholarDigital Library
- Eugster, P., Felber, P., Guerraoui, R., and Kermarrec, A.-M. 2003. The many faces of publish/subscribe. ACM Comput. Surv. 2, 35. Google ScholarDigital Library
- Event Zero. 2010a. http://www.eventzero.com/solutions/environment.aspx. Last accessed 11/2010.Google Scholar
- EventZero. 2010b. http://www.eventzero.com/. Last accessed 11/2010.Google Scholar
- Fiege, L., Mühl, G., and Gärtner, F. C. 2002. Modular event-based systems. Knowl. Eng. Rev. 17, 4, 359--388. Google ScholarDigital Library
- Forgy, C. L. 1982. Rete: A fast algorithm for the many pattern/many object pattern match problem. Artificial Intell. 19, 1, 17--37.Google ScholarDigital Library
- Galton, A. and Augusto, J. C. 2002. Two approaches to event definition. In Proceedings of the 13th International Conference Database and Expert Systems Applications (DEXA'02). 547--556. Google ScholarDigital Library
- Gatziu, S. and Dittrich, K. 1993. Events in an active object-oriented database system. In Proceedings of the International Workshop on Rules in Database Systems (RIDS), N. Paton and H. Williams, Eds. Workshops in Computing, Springer-Verlag, Edinburgh, U.K.Google Scholar
- Gatziu, S., Geppert, A., and Dittrich, K. R. 1992. Integrating active concepts into an object-oriented database system. In Proceedings of the 3rd International Workshop on Database Programming Languages : Bulk Types & Persistent Data (DBPL3). Morgan Kaufmann Publishers Inc., San Francisco, CA, 399--415. Google ScholarDigital Library
- Gedik, B., Andrade, H., Wu, K.-L., Yu, P. S., and Doo, M. 2008. Spade: The systems declarative stream processing engine. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD'08). ACM, New York, NY, 1123--1134. Google ScholarDigital Library
- Gehani, N. H. and Jagadish, H. V. 1991. Ode as an active database: Constraints and triggers. In Proceedings of the 17th International Conference on Very Large Databases (VLDB'91). Morgan Kaufmann Publishers Inc., San Francisco, CA, 327--336. Google ScholarDigital Library
- Gehani, N. H., Jagadish, H. V., and Shmueli, O. 1992. Composite event specification in active databases: Model & implementation. In Proceedings of the 18th International Conference on Very Large Databases (VLDB'92). Morgan Kaufmann Publishers Inc., San Francisco, CA, 327--338. Google ScholarDigital Library
- Giannakopoulou, D. and Havelund, K. 2001. Runtime analysis of linear temporal logic specifications. Tech. rep., 01. 21, Research Institute for Advanced Computer Science, Mountain View, CA. Google ScholarDigital Library
- Golab, L. and Özsu, M. T. 2003. Issues in data stream management. SIGMOD Rec. 32, 2, 5--14. Google ScholarDigital Library
- Golab, L. and Özsu, M. T. 2005. Update-pattern-aware modeling and processing of continuous queries. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD'05). ACM, New York, NY, 658--669. Google ScholarDigital Library
- Gualtieri, M. and Rymer, J. 2009. The Forrester Wave#8482;: Complex Event Processing (CEP) Platforms, Q3 2009. White paper.Google Scholar
- Gyllstrom, D., Agrawal, J., Diao, Y., and Immerman, N. 2008. On supporting kleene closure over event streams. In Proceedings of the IEEE 24th International Conference on Data Engineering (ICDE'08). IEEE Computer Society, Los Alamitos, CA, 1391--1393. Google ScholarDigital Library
- Havelund, K. and Rosu, G. 2002. Synthesizing monitors for safety properties. In Proceedings of the 8th International Conference on Tools and Algorithms for the Construction and Analysis of Systems (TACAS'02). Springer-Verlag, London, UK, 342--356. Google ScholarDigital Library
- Hwang, J.-H., Balazinska, M., Rasin, A., Cetintemel, U., Stonebraker, M., and Zdonik, S. 2005. High-availability algorithms for distributed stream processing. In Proceedings of the 21st International Conference on Data Engineering (ICDE'05). IEEE Computer Society, Los Alamitos, CA, 779--790. Google ScholarDigital Library
- IBM. 2008. http://www.ibm.com/software/integration/wbe/. Last accessed 11/2010.Google Scholar
- IBM. 2010. http://www-935.ibm.com/services/us/index.wss. Last accessed 11/2010.Google Scholar
- Ioannidis, Y. E. 1996. Query optimization. ACM Comput. Surv. 28, 1, 121--123. Google ScholarDigital Library
- Jain, N., Amini, L., Andrade, H., King, R., Park, Y., Selo, P., and Venkatramani, C. 2006. Design, implementation, and evaluation of the linear road bnchmark on the stream processing core. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD'06). ACM, New York, NY, 431--442. Google ScholarDigital Library
- Jain, N., Mishra, S., Srinivasan, A., Gehrke, J., Widom, J., Balakrishnan, H., Çetintemel, U., Cherniack, M., Tibbetts, R., and Zdonik, S. 2008. Towards a streaming sql standard. Proc. VLDB Endow. 1, 2, 1379--1390. Google ScholarDigital Library
- Jarke, M. and Koch, J. 1984. Query optimization in database systems. ACM Comput. Surv. 16, 2, 111--152. Google ScholarDigital Library
- Khandekar, R., Hildrum, K., Parekh, S., Rajan, D., Wolf, J., Wu, K.-L., Andrade, H., and Gedik, B. 2009. Cola: Optimizing stream processing applications via graph partitioning. In Proceedings of the 10th ACM/IFIP/USENIX International Conference on Middleware. Springer-Verlag New York, Inc., New York, NY, 1--20. Google ScholarDigital Library
- Khoussainova, N., Balazinska, M., and Suciu, D. 2008. Probabilistic event extraction from rfid data. In Proceedings of the IEEE 24th International Conference on Data Engineering (ICDE'08). IEEE Computer Society, Los Alamitos, CA, 1480--1482. Google ScholarDigital Library
- Konana, P., Liu, G., Lee, C.-G., and Woo, H. 2004. Specifying timing constraints and composite events: An application in the design of electronic brokerages. IEEE Trans. Softw. Eng. 30, 12, 841--858. Google ScholarDigital Library
- Kumar, V., Cooper, B. F., Cai, Z., Eisenhauer, G., and Schwan, K. 2005. Resource-aware distributed stream management using dynamic overlays. In Proceedings of the 25th IEEE International Conference on Distributed Computing Systems (ICDCS'05). IEEE Computer Society, Los Alamitos, CA, 783--792. Google ScholarDigital Library
- Lakshmanan, G. T., Li, Y., and Strom, R. 2008. Placement strategies for internet-scale data stream systems. IEEE Internet Comput. 12, 6, 50--60. Google ScholarDigital Library
- Lamport, L. 1978. Time, clocks, and the ordering of events in a distributed system. Commun. ACM 21, 7, 558--565. Google ScholarDigital Library
- Law, Y.-N., Wang, H., and Zaniolo, C. 2004. Query languages and data models for database sequences and data streams. In Proceedings of the 13th International Conference on Very Large Databases (VLDB'04). 492--503. Google ScholarDigital Library
- Leucker, M. and Schallhart, C. 2009. A brief account of runtime verification. In Proceedings of the 1st Workshop on Formal Languages and Analysis of Contract-Oriented Software (FLACOS'07). J. Logic Algebra. Program. 78, 5, 293--303.Google ScholarCross Ref
- Li, G. and Jacobsen, H.-A. 2005. Composite subscriptions in content-based publish/subscribe systems. In Proceedings of the 6th ACM/IFIP/USENIX International Conference on Middleware. Springer-Verlag New York, Inc., New York, NY, 249--269. Google ScholarDigital Library
- Lieuwen, D. F., Gehani, N. H., and Arlein, R. M. 1996. The ode active database: Trigger semantics and implementation. In Proceedings of the 12th International Conference on Data Engineering (ICDE'96). IEEE Computer Society, Los Alamitos, CA, 412--420. Google ScholarDigital Library
- Lin, E. Y.-T. and Zhou, C. 1999. Modeling and analysis of message passing in distributed manufacturing systems. IEEE Trans. Syst. Man, Cybernet. Part C 29, 2, 250--262. Google ScholarDigital Library
- Liu, H. and Jacobsen, H.-A. 2004. Modeling uncertainties in publish/subscribe systems. In Proceedings of the 20th International Conference on Data Engineering (ICDE'04). IEEE Computer Society, Los Alamitos, CA, 510. Google ScholarDigital Library
- Liu, L. and Pu, C. 1997. A dynamic query scheduling framework for distributed and evolving information systems. In Proceedings of the 17th International Conference on Distributed Computing Systems (ICDCS '97). IEEE Computer Society, Los Alamitos, CA, 474. Google ScholarDigital Library
- Liu, L., Pu, C., and Tang, W. 1999. Continual queries for internet scale event-driven information delivery. IEEE Trans. Knowl. Data Eng. 11, 4, 610--628. Google ScholarDigital Library
- Luckham, D. 1996. Rapide: A language and toolset for simulation of distributed systems by partial orderings of events. Tech. rep. Stanford University, Stanford, CA. Google ScholarDigital Library
- Luckham, D. 2010. http://complexevents.com/. Last accessed 11/2010.Google Scholar
- Luckham, D. C. 2001. The Power of Events: An Introduction to Complex Event Processing in Distributed Enterprise Systems. Addison-Wesley Longman Publishing Co., Inc., Boston, MA. Google ScholarDigital Library
- Luckham, D. C. and Vera, J. 1995. An event-based architecture definition language. IEEE Trans. Softw. Eng. 21, 717--734. Google ScholarDigital Library
- Madden, S., Shah, M., Hellerstein, J. M., and Raman, V. 2002. Continuously adaptive continuous queries over streams. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD'02). ACM, New York, NY, 49--60. Google ScholarDigital Library
- Magee, J., Dulay, N., and Kramer, J. 1994. Regis: A constructive development environment for distributed programs. Distrib. Syst. Eng. 1, 5, 304--312.Google ScholarCross Ref
- Maler, O., Nickovic, D., and Pnueli, A. 2006. From mitl to timed automata. In Proceedings of the International Conference on Formal Modeling and Analysis of Timed Systems (FORMATS'06). 274--289. Google ScholarDigital Library
- Mansouri-Samani, M. and Sloman, M. 1993. Monitoring distributed systems. Netw. IEEE 7, 6, 20--30.Google ScholarDigital Library
- Mansouri-Samani, M. and Sloman, M. 1996. A configurable event service for distributed systems. In Proceedings of the 3rd International Conference on Configurable Distributed Systems (ICCDS'96). IEEE Computer Society, Washington, DC, USA, 210. Google ScholarDigital Library
- Mansouri-Samani, M. and Sloman, M. 1997. Gem: A generalized event monitoring language for distributed systems. Distrib. Syst. Eng. 4, 96--108.Google ScholarCross Ref
- McCarthy, D. and Dayal, U. 1989. The architecture of an active database management system. SIGMOD Rec. 18, 2, 215--224. Google ScholarDigital Library
- Mühl, G., Fiege, L., and Pietzuch, P. 2006. Distributed Event-Based Systems. Springer. Google ScholarDigital Library
- O'Keeffe, D. and Bacon, J. 2010. Reliable complex event detection for pervasive computing. In Proceedings of the 4th ACM International Conference on Distributed Event-Based Systems (DEBS'10). ACM, New York, NY, 73--84. Google ScholarDigital Library
- Oracle. 2010. http://www.oracle.com/technologies/soa/complex-event-processing.html. Last accessed 11/2010.Google Scholar
- Pallickara, S. and Fox, G. 2003. Naradabrokering: A distributed middleware framework and architecture for enabling durable peer-to-peer grids. In Proceedings of the ACM/IFIP/USENIX 2003 International Conference on Middleware. Springer-Verlag New York, Inc., New York, NY, 41--61. Google ScholarDigital Library
- Pandey, S., Dhamdhere, K., and Olston, C. 2004. Wic: A general-purpose algorithm for monitoring web information sources. In Proceedings of the 13th International Conference on Very Large Databases (VLDB'04). 360--371. Google ScholarDigital Library
- Park, J., Reveliotis, S. A., Bodner, D. A., and McGinnis, L. F. 2002. A distributed, event-driven control architecture for flexibly automated manufacturing systems. Int. J. Comput. Integ. Manuf. 15, 2, 109--126.Google ScholarCross Ref
- Paton, N. W. and Díaz, O. 1999. Active database systems. ACM Comput. Surv. 31, 1, 63--103. Google ScholarDigital Library
- Pietzuch, P., Ledlie, J., Shneidman, J., Roussopoulos, M., Welsh, M., and Seltzer, M. 2006. Network-aware operator placement for stream-processing systems. In Proceedings of the 22nd International Conference on Data Engineering (ICDE'06). IEEE Computer Society, Los Alamitos, CA, 49. Google ScholarDigital Library
- Pietzuch, P. R. and Bacon, J. 2002. Hermes: A distributed event-based middleware architecture. In Proceedings of the 22nd International Conference on Distributed Computing Systems (ICDCSW'02). IEEE Computer Society, Los Alamitos, CA, 611--618. Google ScholarDigital Library
- Pietzuch, P. R., Shand, B., and Bacon, J. 2003. A framework for event composition in distributed systems. In Proceedings of the ACM/IFIP/USENIX International Middleware Conference. 62--82. Google ScholarDigital Library
- Pnueli, A. 1997. The temporal logic of programs. Tech. rep., Weizmann Science Press of Israel, Jerusalem, Israel. Google ScholarDigital Library
- Progress-Apama. 2010. http://web.progress.com/it-need/complex-event-processing.html. Last accessed 11/2010.Google Scholar
- Raman, V., Raman, B., and Hellerstein, J. M. 1999. Online dynamic reordering for interactive data processing. In Proceedings of the 25th International Conference on Very Large Databases (VLDB'99). Morgan Kaufmann Publishers Inc., San Francisco, CA, 709--720. Google ScholarDigital Library
- Repantis, T., Gu, X., and Kalogeraki, V. 2006. Synergy: Sharing-aware component composition for distributed stream processing systems. In Proceedings of the ACM/IFIP/USENIX 2006 International Conference on Middleware. Springer-Verlag New York, Inc., New York, NY, 322--341. Google ScholarDigital Library
- Roitman, H., Gal, A., and Raschid, L. 2008. Satisfying complex data needs using pull-based online monitoring of volatile data sources. In Proceedings of the IEEE 24th International Conference on Data Engineering (ICDE'08). IEEE Computer Society, Los Alamitos, CA, 1465--1467. Google ScholarDigital Library
- Roitman, H., Gal, A., and Raschid, L. 2010a. A dual framework and algorithms for targeted online data delivery. IEEE Trans. Knowl. Data Eng. 99, Preprints. Google ScholarDigital Library
- Roitman, H., Gal, A., and Raschid, L. 2010b. On trade-offs in event delivery systems. In Proceedings of the 4th ACM International Conference on Distributed Event-Based Systems (DEBS'10). ACM, New York, NY, 116--127. Google ScholarDigital Library
- Rosenblum, D. and Wolf, A. L. 1997. A design framework for internet-scale event observation and notification. In Proceedings of the 6th European Software Engineering Conference (ESEC/FSE). Lacture Notes in Computer Science, Springer-Verlag, Berlin, 1301. Google ScholarDigital Library
- Sadri, R., Zaniolo, C., Zarkesh, A., and Adibi, J. 2004. Expressing and optimizing sequence queries in database systems. ACM Trans. Database Syst. 29, 2, 282--318. Google ScholarDigital Library
- Schultz-Moeller, N. P., Migliavacca, M., and Pietzuch, P. 2009. Distributed complex event processing with query optimisation. In Proceedings of the International Conference on Distributed Event-Based Systems (DEBS'09). Google ScholarDigital Library
- Sellis, T. K. 1988. Multiple-query optimization. ACM Trans. Database Syst. 13, 1, 23--52. Google ScholarDigital Library
- Shah, M. A., Hellerstein, J. M., and Brewer, E. 2004a. Highly available, fault-tolerant, parallel dataflows. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD'04). ACM, New York, NY, 827--838. Google ScholarDigital Library
- Shah, M. A., Hellerstein, J. M., and Brewer, E. 2004b. Highly available, fault-tolerant, parallel dataflows. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD'04). ACM, New York, NY, 827--838. Google ScholarDigital Library
- Shah, M. A., Hellerstein, J. M., Chandrasekaran, S., and Franklin, M. J. 2003. Flux: An adaptive partitioning operator for continuous query systems. In Proceedings of the International Conference on Data Engineering. 25.Google Scholar
- Srivastava, U. and Widom, J. 2004. Memory-limited execution of windowed stream joins. In Proceedings of the 13th International Conference on Very Large Databases (VLDB'04). 324--335. Google ScholarDigital Library
- Stolz, V. 2007. Temporal assertions with parametrized propositions. In Proceedings of the Runtime Verification Workshop (RV'07). 176--187. Google ScholarDigital Library
- Streambase. 2010a. http://www.streambase.com/. Last accessed 10/2010.Google Scholar
- Streambase. 2010b. http://streambase.com/developers/docs/latest/streamsql/index.html. Last accessed 11/2010.Google Scholar
- Strom, R. E., Banavar, G., Chandra, T. D., Kaplan, M., Miller, K., Mukherjee, B., Sturman, D. C., and Ward, M. 1998. Gryphon: An information flow-based approach to message brokering. In Proceedings of the International Symposium on Software Reliability Engineering.Google Scholar
- Sullivan, M. and Heybey, A. 1998. Tribeca: A system for managing large databases of network traffic. In Proceedings of the Annual Conference on USENIX Annual Technical Conference (ATEC'98). USENIX Association, Berkeley, CA, 2--2. Google ScholarDigital Library
- Tatbul, N., Çetintemel, U., Zdonik, S., Cherniack, M., and Stonebraker, M. 2003. Load shedding in a data stream manager. In Proceedings of the 29th International Conference on Very Large Databases (VLDB'03). 309--320. Google ScholarDigital Library
- Tatbul, N. and Zdonik, S. 2006a. Dealing with overload in distributed stream processing systems. In Proceedings of the 22nd International Conference on Data Engineering Workshops (ICDEW'06). IEEE Computer Society, Los Alamitos, CA, 24. Google ScholarDigital Library
- Tatbul, N. and Zdonik, S. 2006b. Window-aware load shedding for aggregation queries over data streams. In Proceedings of the 32nd International Conference on Very Large Databases (VLDB'06), 799--810. Google ScholarDigital Library
- Tibco. 2010. http://www.tibco.com/software/complex-event-processing/businessevents/default.jsp. Last accessed 11/2010.Google Scholar
- Van Renesse, R., Birman, K. P., and Vogels, W. 2003. Astrolabe: A robust and scalable technology for distributed system monitoring, management, and data mining. ACM Trans. Comput. Syst. 21, 2, 164--206. Google ScholarDigital Library
- Wang, F. and Liu, P. 2005. Temporal management of rfid data. In Proceedings of the International Conference on Very Large Database (VLDB'05) 1128--1139. Google ScholarDigital Library
- Wasserkrug, S., Gal, A., Etzion, O., and Turchin, Y. 2008. Complex event processing over uncertain data. In Proceedings of the 2nd International Conference on Distributed Event-Based Systems (DEBS'08). ACM, New York, NY, 253--264. Google ScholarDigital Library
- White, W., Riedewald, M., Gehrke, J., and Demers, A. 2007. What is “next” in event processing? In Proceedings of the 26th ACM SIGMOD-PODS Symposium on Principles of Database Systems (PODS'07). ACM, New York, NY, 263--272. Google ScholarDigital Library
- Widom, J. and Ceri, S. 1996. Introduction to active database systems. In Active Database Systems: Triggers and Rules For Advanced Database Processing. Morgan Kaufmann, 1--41.Google Scholar
- Wolf, J., Bansal, N., Hildrum, K., Parekh, S., Rajan, D., Wagle, R., Wu, K.-L., and Fleischer, L. 2008. Soda: An optimizing scheduler for large-scale stream-based distributed computer systems. In Proceedings of the 9th ACM/IFIP/USENIX International Conference on Middleware. Springer-Verlag New York, Inc., New York, NY, 306--325. Google ScholarDigital Library
- Wright, M., Chodzko, J., and Luk, D. 2010. Principles and Applications of Distributed Event-Based Systems. IGI Global, 1--18.Google Scholar
- Wu, E., Diao, Y., and Rizvi, S. 2006. High-performance complex event processing over streams. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD'06). ACM, New York, NY, 407--418. Google ScholarDigital Library
- Wu, K.-L., Hildrum, K. W., Fan, W., Yu, P. S., Aggarwal, C. C., George, D. A., Gedik, B., Bouillet, E., Gu, X., Luo, G., and Wang, H. 2007. Challenges and experience in prototyping a multimodal stream analytic and monitoring application on system s. In Proceedings of the 33rd International Conference on Very Large Databases (VLDB'07). 1185--1196. Google ScholarDigital Library
- Xu, J., Tang, X., and Lee, W.-C. 2006. Time-critical on-demand data broadcast: Algorithms, analysis, and performance evaluation. IEEE Trans. Parallel Distrib. Syst. 17, 3--14. Google ScholarDigital Library
- Yalagandula, P. and Dahlin, M. 2004. A scalable distributed information management system. In Proceedings of the Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications (SIGCOMM'04). ACM, New York, NY, 379--390. Google ScholarDigital Library
- Zhou, Y., Ooi, B. C., Tan, K.-L., and Wu, J. 2006. Efficient dynamic operator placement in a locally distributed continuous query system. In Proceedings of the OTM Conferences. 54--71. Google ScholarDigital Library
- Zimmer, D. 1999. On the semantics of complex events in active database management systems. In Proceedings of the 15th International Conference on Data Engineering (ICDE'99). IEEE Computer Society, Los Alamitos, CA, 392. Google ScholarDigital Library
Index Terms
- Processing flows of information: From data stream to complex event processing
Recommendations
Processing flows of information: from data stream to complex event processing
DEBS '11: Proceedings of the 5th ACM international conference on Distributed event-based systemAn increasing number of distributed applications requires processing continuously flowing data from geographically distributed sources at unpredictable rate to obtain timely responses to complex queries. Examples of such applications come from the most ...
Taming velocity and variety simultaneously in big data with stream reasoning: tutorial
DEBS '16: Proceedings of the 10th ACM International Conference on Distributed and Event-based SystemsMany "big data" applications must tame velocity (processing data in-motion) and variety (processing many different types of data) simultaneously.
The research on knowledge representation and reasoning has focused on the variety of data, devising data ...
Towards a Patterns Catalog for Data Stream Processing Architectures
SBSI '16: Proceedings of the XII Brazilian Symposium on Information Systems on Brazilian Symposium on Information Systems: Information Systems in the Cloud Computing Era - Volume 1As a result of technological advances, many computerized devices are communicating over the internet, and with that comes a growing number of distributed applications that require continuous processing of large data stream source, geographically ...
Comments