Skip to main content
SpringerLink
Log in
Book cover

International Conference on Database and Expert Systems Applications

DEXA 2004: Database and Expert Systems Applications pp 720–729Cite as

A System for Processing Continuous Queries over Infinite Data Streams

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 3180))

Abstract

This paper investigates the use of an off the shelf database management system for the processing of continuous queries. It describes the utilization of existing features in a DBMS and their adoption to synchronize processing of unlimited data streams and discusses the performance of the proposed solution. It provides a solution for the inherent limitations in the architecture of a DBMS to be able to react to continual inputs from several sources. The outcome of this paper shows that it is possible to process continuous data streams from several sources and in some ways a better performance is also achievable.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Abadi, D., Carney, D., Cetintemel, U., Cherniack, M., Convey, C., Erwin, C., Galvez, E., Hatoun, M., Hwang, J., Maskey, A., Rasin, A., Singer, A., Stonebraker, M., Tatbul, N., Xing, Y., Yan, R., Zdonik, S.: A data stream management system. In: Proceedings of the 2003 ACM SIGMOD International Conference on Management of Data, San Deigo, CA, June 2003, pp. 663–663 (2003)

    Google Scholar 

  2. Abadi, D., Carney, D., Cetintemel, U., Cherniack, M., Convey, C., Lee, S., Stonebraker, M., Tatbul, N., Zdonik, S.: A New Model and Architecture for Data Stream Management. VLDB Journal (2003)

    Google Scholar 

  3. Babcock, B., Babu, S., Datar, M., Motwani, R., Widom, J.: Models and Issues in Data Stream Systems. In: Proceedings of 21st ACM Symposium on Principles of Database Systems (PODS 2002), Madison, Wisconsin, pp. 1–16 (2002)

    Google Scholar 

  4. Arasu, A., Babcock, B., Babu, S., Cieslewicz, J., Datar, M., Ito, K., Motwani, R., Srivastava, U., Widom, J.: STREAM: The Stanford Stream Data Manager. In: Bulletin of technical committee on Data Engineering, pp. 19–26. IEEE Computer Society, Los Alamitos (2003)

    Google Scholar 

  5. Babcock, B., Babu, S., Datar, M., Motvani, R.: Chain: Operator scheduling for memory minimization in data stream systems. In: Proceedings of the 2003 ACM SIGMOD International Conference on Management of Data, pp. 253–264 (2003)

    Google Scholar 

  6. Carney, D., Cetintemel, U., Rasin, A., Zdonik, S., Cherniack, M., Stonebraker, M.: Operator Scheduling in a Data Stream Manager. In: Proceedings of the 29th International Conference on Very Large Data Bases, VLDB 2003 (2003)

    Google Scholar 

  7. Chen, J.: NiagraCQ: A scalable continuous query system for Internet databases. In: Proc. of the 2000 ACM SIGMOD Intl. Conf. on Management of Data, pp. 379–390 (2000)

    Google Scholar 

  8. Cranor, C., Johnson, T., Spatscheck, O., Shkapenyuk, V.: The Gigascope Stream Database. In: Bulletin of technical committee on Data Engineering, pp. 27–32. IEEE Computer Society, Los Alamitos (2003)

    Google Scholar 

  9. Cola, J.L., Pouzet, M.: Type-based Initialization Analysis of a Synchronous Data-flow Language. Electronic Notes in Theoretical Computer Science 65(5) (2002)

    Google Scholar 

  10. Hellerstein, J.M., Hass, P.J., Wang, H.: Online Aggregation. In: Proceedings of the 1997 ACM SIGMOD International Conference on Management of Data, pp. 171–182 (1997)

    Google Scholar 

  11. Lars, B., Mark, L.: Incremental Computation of Time-Varying Query Expressions. IEEE Transactions on Knowledge and Data Engineering 7(4), 583–590 (1995)

    Article  Google Scholar 

  12. Madden, S., Shah, M., Hellerstein, J.M., Raman, V.: Continuously adaptive continuous queries over streams. In: Proceedings of the 2002 ACM SIGMOD International Conference on Management of Data, Madison, Wisconsin, June 4-6, pp. 49–60 (2002)

    Google Scholar 

  13. Krishnamurthy, S., Chandrasekaran, S., Cooper, O., Deshpande, A., Franklin, M.J., Hellerstein, J., Hong, W., Madden, S.R., Reiss, F., Shah, M.A.: TelegraphCQ: An architectural status report. Bulletin of the Technical Committee on Data Engineering, 11–18 (2003)

    Google Scholar 

  14. Shanmugasundaram, J., Tufte, K., DeWitt, D.J., Naughton, J.F., Maier, D.: Architecting a network query engine for producing partial results. In: Proc. of the 2000 Intl. Workshop on the Web and Databases, pp. 17–22 (2000)

    Google Scholar 

  15. Srinivasan, V., Carey, M.J.: Compensation-Based On-Line Query Processing. In: Proceedings of the 1992 ACM SIGMOD International Conference on Management of Data, pp. 331–340 (1991)

    Google Scholar 

  16. Zdonik, S., Stonebraker, M., Cherniack, M., Cetintemel, U., Balazinska, M., Balakrishnan, H.: The Aurora and Medusa Projects. In: Bulletin of technical committee on Data Engineering, pp. 3–10. IEEE Computer Society, Los Alamitos (2003)

    Google Scholar 

  17. Abadi, D., Carney, D., Cetintemel, U., Cherniack, M., Convey, C., Lee, S., Stonebraker, M., Tatbul, N., Zdonik, S.: Aurora: A New Model and Architecture for Data Stream Management. VLDB Journal 12(2) (2003)

    Google Scholar 

  18. Motwani, R., Widom, J., Arasu, A., Babcock, B., Babu, S., Datar, M., Manku, G., Olston, C., Rosenstein, J., Varma, R.: Query Processing, Resource Management, and Approximation in a Data Stream Management System. CIDR (2003)

    Google Scholar 

  19. Sumii, E., Kobayashi, N.: Online-and-Offline Partial Evaluation: A Mixed Approach. In: PEMP 2000, ACM 2000, pp. 12–21 (2000)

    Google Scholar 

  20. Vossough, E., Getta, J.: Block Level Query Scrambling Algorithm within Distributed Multi-Database Environment. In: Proceedings of the DEXA 2001 12th International Workshop on Database and Expert Systems Applications, pp. 123–127 (2001)

    Google Scholar 

  21. Vossough, E., Getta, J.: Processing of Continuous Queries over Unlimited Data Streams. In: Hameurlain, A., Cicchetti, R., Traunmüller, R. (eds.) DEXA 2002. LNCS, vol. 2453, pp. 123–127. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  22. Vossough, E.: Adaptable Processing of Large Data Sets in Distributed Environments. In: Proceedings of the EDBT 8th International Conference on Extending Databases Technology, pp. 101–110 (2002)

    Google Scholar 

  23. Vossough, E., Getta, J.: Processing of Data Streams in Relational Database Systems. In: The 7th IASTED International Conference on Software Engineering and Applications, pp. 341–346. Marina del Rey, LA (2003)

    Google Scholar 

  24. Yellin, D.M.: INC: A Language for Incremental Computations, IBM T. J. Watson Research Center. ACM Transactions on Programming Languages and Systems (2), 211–236 (1991)

    Google Scholar 

  25. http://www.sontek.com/ysi.htm , http://www.ysi.com/index.html

  26. http://www.srl.caltech.edu/compastro/comp_disp.html

  27. http://www.traderbot.com

  28. http://www.unitracking.com

  29. http://www.yahoo.com

  30. http://www-3.ibm.com/software/data/informix/pubs/whitepapers.html

Download references

Author information

Authors and Affiliations

  1. Department of Computing and InformationTechnology, University of Western Sydney, Campbelltown, NSW 2560, Australia

    Ehsan Vossough

Authors
  1. Ehsan Vossough
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. University of Zaragoza, Ciudad Universitaria, Plaza San Francisco, 50009, Zaragoza

    Fernando Galindo

  2. Seikei University, Japan

    Makoto Takizawa

  3. Institute of Informatics in Business and Government, University of Linz, Altenbergerstr. 69, 4040, Linz, Austria

    Roland Traunmüller

Rights and permissions

Reprints and permissions

Copyright information

© 2004 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Vossough, E. (2004). A System for Processing Continuous Queries over Infinite Data Streams. In: Galindo, F., Takizawa, M., Traunmüller, R. (eds) Database and Expert Systems Applications. DEXA 2004. Lecture Notes in Computer Science, vol 3180. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30075-5_69

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-30075-5_69

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-22936-0

  • Online ISBN: 978-3-540-30075-5

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation