Abstract
Data stream processing has found enormous use in real time applications such as financial tickers, network and sensor monitoring, manufacturing processes and others. STREAM is Data Stream Management System which implements sliding window query model in its architecture. We explore the existing architectural model in an effort to achieve faster results and improve the overall system functionality. In this paper, we analyze the STREAM data manager for the possible optimization of the query processing. We discuss the potential inadequacies of the current query model and put forward the use of punctuations along with sliding windows to improve the memory utilization and query processing.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Madden, S., Franklin, M.J.: Fjording the stream: an architecture for queries over streaming sensor data. In: 18th International Conference on Data Engineering, pp. 555–566 (2002)
Hammad, M.A., Aref, W.G., Elmagarmid, A.K.: Stream window join: tracking moving objects in sensor-network databases. In: 15th International Conference on Scientific and Statistical Database Management, pp. 75–84 (2003)
Zhu, Y., Shasha, D.: StatStream: statistical monitoring of thousands of data streams in real time. In: 28th International Conference on Very Large Data Bases, pp. 358–369 (2002)
Madden, S., Franklin, M.J., Hellerstein, J.M., Hong, W.: The design of an acquisitional query processor for sensor networks. In: ACM SIGMOD International Conference on Management of Data, pp. 491–502 (2003)
Golab, L., Ozsu, M.T.: Issues in data stream management. SIGMOD Rec. 32(2), 5–14 (2003)
Babcock, B., Babu, S., Datar, M., Motwani, R., Widom, J.: Models and issues in data stream systems. In: Twenty-First ACM SIGMOD-SIGACT-SIGART Symposium on Principles of Database Systems, pp. 1–16 (2002)
Arasu, A., Babcock, B., Babu, S., McAlister, J., Widom, J.: Characterizing memory require-ments for queries over continuous data streams. ACM Transactions on Database Systems (TODS), 162–194 (2004)
Motwani, R., Widom, J., Arasu, A., Babcock, B., Babu, S., Datar, M., Manku, G., Olston, C., Rosenstein, J., Varma, R.: Query Processing, Resource Management, and Approximation in a Data Stream Management System. CIDR (2003)
Chandrasekaran, S., Cooper, O., Deshpande, A., Franklin, M.J., Hellerstein, J.M., Hong, W., Krishnamurthy, S., Madden, S.R., Reiss, F., Shah, M.A.: TelegraphCQ: continuous data-flow processing. In: ACM SIGMOD international Conference on Management of Data, pp. 668–668 (2003)
Cranor, C., Johnson, T., Spataschek, O., Shkapenyuk, V.: Gigascope: a stream database for network applications. In: ACM SIGMOD International Conference on Management of Data, pp. 647–651 (2003)
Cranor, C., Gao, Y., Johnson, T., Spataschek, O., Shkapenyuk, V.: Gigascope: high performance network monitoring with an SQL interface. ACM SIGMOD International Conference on Management of Data, p. 623ff. (2003)
Abadi, D., Carney, D., Çetintemel, U., Cherniack, M., Convey, C., Lee, S., Stonebraker, M., Tatbul, N., Zdonik, S.: Aurora: a new model and architecture for data stream management. The VLDB Journal 12, 120–139 (2003)
Arasu, A., Babu, S., Widom, J.: The CQL continuous query language: semantic foundations and query execution. The VLDB Journal, 121–142 (2006)
Wilschut, N., Apers, P.M.: Dataflow query execution in a parallel main-memory environment. In: First international Conference on Parallel and Distributed information Systems, pp. 68–77
Urhan, T., Franklin, M.: XJoin: A reactively scheduled pipelined join operator. IEEE Data Engineering Bulletin, 27–33 (2000)
Haas, P.J., Hellerstein, J.M.: Ripple joins for online aggregation. In: ACM SIGMOD international Conference on Management of Data, pp. 287–298 (1999)
Golab, L., Özsu, M.T.: Processing sliding window multi-joins in continuous queries over data streams. In: 29th international Conference on Very Large Data Bases. VLDB Endowment, vol. 29, pp. 500–511 (2003)
Kang, J., Naughton, J.F., Viglas, S.D.: Evaluating window joins over unbounded streams. In: 19th International Conference on Data Engineering,, pp. 341–352 (2003)
Babu, S., Srivastava, U., Widom, J.: Exploiting k-constraints to reduce memory overhead in continuous queries over data streams. ACM Trans. Database Syst. 29(3), 545–580 (2004)
Ding, L., Rundensteiner, E.A.: Evaluating window joins over punctuated streams. In: Thirteenth ACM international Conference on information and Knowledge Management, pp. 98–107 (2004)
Li, H., Chen, S., Tatemura, J., Agrawal, D., Candan, K.S., Hsiung, W.: Safety guarantee of continuous join queries over punctuated data streams. In: 32nd international Conference on Very Large Data Bases, pp. 19–30 (2006)
Motwani, R., Widom, J., Arasu, A., Babcock, B., Babu, S., Srivastava, U., Wang, Z.: STREAM: the Stanford stream data manager, http://infolab.stanford.edu/stream
Motwani, R., Widom, J., Arasu, A., Babcock, B., Babu, S., Srivastava, U., Wang, Z.: STREAM: the Stanford stream data manager, http://infolab.stanford.edu/stream/sqr
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Tiwari, L., Shahnasser, H. (2010). Exploiting Punctuations along with Sliding Windows to Optimize STREAM Data Manager. In: Zavoral, F., Yaghob, J., Pichappan, P., El-Qawasmeh, E. (eds) Networked Digital Technologies. NDT 2010. Communications in Computer and Information Science, vol 87. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-14292-5_12
Download citation
DOI: https://doi.org/10.1007/978-3-642-14292-5_12
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-14291-8
Online ISBN: 978-3-642-14292-5
eBook Packages: Computer ScienceComputer Science (R0)