Skip to main content

An Extensibility Approach for Spatio-temporal Stream Processing Using Microsoft StreamInsight

  • Conference paper
Book cover Advances in Spatial and Temporal Databases (SSTD 2011)

Abstract

Integrating spatial operators in commercial data streaming engines has gained tremendous interest in recent years. Whether to support such operators natively or to enable the operator through an extensibility framework is a challenging and interesting debate. In this paper we leverage the Microsoft StreamInsightTM extensibility framework to support spatial operators enabling developers to integrate their domain expertise within the query execution pipeline.

We first justify our choice of adopting an extensibility approach over a native support approach. Then, we present an example set of spatiotemporal operations, e.g., KNN search, and range search; implemented as user defined operators using the extensibility framework within Microsoft StreamInsight. More interestingly, the demo showcases the how embedded devices and smartphones are shaping the future of streaming spatiotemporal applications. The demo scenario specifically features a smartphone based input adapter that provides a continuous stream of moving object locations as well a continuous stream of moving queries. To demonstrate the scalability of the implemented extensibility framework, the demo includes a simulator that generates a larger set of stationary/moving queries and streams of stationary/moving objects.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Barga, R.S., Goldstein, J., Ali, M., Hong, M.: Consistent Streaming Through Time: A Vision for Event Stream Processing. In: Proceedings of CIDR, pp. 412–422 (2007)

    Google Scholar 

  2. Goldstein, J., Hong, M., Ali, M., Barga, R.: Consistency Sensitive Streaming Operators in CEDR. Tech. Report, MSR-TR-2007-158, Microsoft Research (2007)

    Google Scholar 

  3. Chandramouli, B., Goldstein, J., Maier, D.: On-the-fly Progress Detection in Iterative Stream Queries. In: VLDB (2009)

    Google Scholar 

  4. Chandramouli, B., Goldstein, J., Maier, D.: High-Performance Dynamic Pattern Matching over Disordered Streams. In: VLDB (2010)

    Google Scholar 

  5. Ali, M., et al.: Microsoft CEP Server and Online Behavioral Targeting. In: VLDB (2009)

    Google Scholar 

  6. Chandramouli, B., Ali, M., Goldstein, J., Sezgin, B., Sethu, B.: Data Stream Management Systems for Computational Finance. IEEE Computer 43(12), 45–52 (2010)

    Article  Google Scholar 

  7. Ali, M., Chandramouli, B., Raman, B.S., Katibah, E.: Spatio-Temporal Stream Processing in Microsoft StreamInsight. IEEE Data Eng. Bull. 33(2), 69–74 (2010)

    Google Scholar 

  8. Kazemitabar, J., Demiryurek, U., Ali, M., Akdogan, A., Shahabi, C.: Geospatial Stream Query Processing using Microsoft SQL Server StreamInsight. In: VLDB (2010)

    Google Scholar 

  9. Ali, M.H., Chandramouli, B., Raman, B.S., Katibah, E.: Real-time spatio-temporal analytics using Microsoft StreamInsight. In: ACM GIS (2010)

    Google Scholar 

  10. Ali, M., Chandramouli, B., Goldstein, J., Schindlauer, R.: The Extensibility Framework in Microsoft StreamInsight. In: ICDE (2011)

    Google Scholar 

  11. SQL Server Spatial Library, http://www.microsoft.com/sqlserver/2008/en/us/spatial-data.aspx (last accessed in March 2011)

  12. Pialorsi, P., Russo, M.: Programming Microsoft LINQ. Microsoft Press, Redmond (May 2008)

    Google Scholar 

  13. Bing Maps, http://www.bing.com/maps

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Miller, J. et al. (2011). An Extensibility Approach for Spatio-temporal Stream Processing Using Microsoft StreamInsight. In: Pfoser, D., et al. Advances in Spatial and Temporal Databases. SSTD 2011. Lecture Notes in Computer Science, vol 6849. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-22922-0_38

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-22922-0_38

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-22921-3

  • Online ISBN: 978-3-642-22922-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics