Oana Jurca
Sebastian Michel
ABSTRACT
We address the problem of processing continuous multi-join queries, over distributed data streams, making use of existing work in the field of publish/subscribe systems. We show how these principles can be ported to data streams, by enriching the common query model with location dependent attributes. Users can subscribe to a set of sensor attributes, a service that requires processing multi-join correlation queries. The goal is to decrease the overall network traffic consumption by removing redundant subscriptions and eliminating unrequested events close to the publishing sensors. This is non-trivial, especially in the presence of multi-join queries without any central control mechanism. Our approach is based on the concept of filter-split-forward phases for efficient subscription filtering and placement inside the network. We report on a performance evaluation using a real-world dataset, showing the suitability of our approach to reduce the overall data traffic.
- Y. Ahmad et al. Network-aware query processing for stream-based applications. VLDB, 2004. Google Scholar
Digital Library
- I. F. Akyildiz et al. A survey on sensor networks. IEEE Communications Magazine, 40(4), 2002. Google ScholarDigital Library
- B. Chandramouli and J. Yang. End-to-end support for joins in large-scale publish/subscribe systems. VLDB, 2008. Google ScholarDigital Library
- P. Costa et al. Publish-subscribe on sensor networks: A semi-probabilistic approach. MASS, 2005.Google ScholarCross Ref
- M. Franklin et al. Design Considerations for High Fan-in Systems: The HiFi Approach. CIDR, 2005.Google Scholar
- P. B. Gibbons et al. IrisNet: An Architecture for a World-Wide Sensor Web. IEEE Pervasive Computing, 2(4), 2003. Google ScholarDigital Library
- C. Hall et al. A content-based networking protocol for sensor networks. Technical Report CU-CS-979-04, Department of Computer Science, University of Colorado, Aug. 2004.Google Scholar
- A. M. Ouksel et al. Efficient Probabilistic Subsumption Checking for Content-Based Publish/Subscribe Systems. Middleware, 2006. Google ScholarDigital Library
- P. Pietzuch et al. Network-aware operator placement for stream-processing systems. ICDE, 2006. Google ScholarDigital Library
- S. Rooney et al. Techniques for Integrating Sensors into the Enterprise Network. IEEE eTransactions on Network and Service Management, 2(1), 2006. Google ScholarDigital Library
- M. Sgroi et al. A service-based universal application interface for ad hoc wireless sensor and actuator networks. Ambient Intelligence, 2005.Google ScholarCross Ref
- J. Shneidman et al. Hourglass: An Infrastructure for Connecting Sensor Networks and Applications. Technical Report TR-21-04, Harvard University, EECS, 2004.Google Scholar
- E. Souto et al. Mires: a publish/subscribe middleware for sensor networks. Personal Ubiquitous Comput., 10(1), 2005. Google ScholarDigital Library
- D. Srivastava. Subsumption and indexing in constraint query languages with linear arithmetic constraints. Annals of Mathematics and Artificial Intelligence, 8(3--4), 1992.Google Scholar
- U. Srivastava et al. Operator placement for in-network stream query processing. PODS, 2005. Google ScholarDigital Library
Index Terms
- Processing publish/subscribe queries over distributed data streams
Recommendations
Top-k/w publish/subscribe: A publish/subscribe model for continuous top-k processing over data streams
Continuous processing of top-k queries over data streams is a promising technique for alleviating the information overload problem as it distinguishes relevant from irrelevant data stream objects with respect to a given scoring function over time. Thus ...
Massively multi-query join processing in publish/subscribe systems
SIGMOD '07: Proceedings of the 2007 ACM SIGMOD international conference on Management of dataThere has been much recent interest in XML publish/subscribe systems. Some systems scale to thousands of concurrent queries, but support a limited query language (usually a fragment of XPath 1.0). Other systems support more expressive languages, but do ...
A data stream publish/subscribe architecture with self-adapting queries
OTM'05: Proceedings of the 2005 Confederated international conference on On the Move to Meaningful Internet Systems - Volume >Part IIn data stream applications, streams typically arise from a geographically distributed collection of producers and may be queried by consumers, which may be distributed as well. In such a setting, a query can be seen as a subscription asking to be ...
Comments