Skip to main content
SpringerLink
Log in
Book cover

The Annual International Conference on Geographic Information Science

GIScience 2016: Geographic Information Science pp 178–194Cite as

From Data Streams to Fields: Extending Stream Data Models with Field Data Types

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 9927))

Abstract

With ubiquitous live sensors and sensor networks, increasingly large numbers of individual sensors are deployed in physical space. Sensor data streams are a fundamentally novel mechanism to create and deliver observations to information systems, enabling us to represent spatio-temporal continuous phenomena such as radiation accidents, pollen distributions, or toxic plumes almost as instantaneously as they happen in the real world. While data stream engines (DSE) are available to process high-throughput updates, DSE support for phenomena that are continuous in both space and time is not available. This places the burden of handling any tasks related to the integration of potentially very large sets of concurrent sensor streams into higher-level abstractions on the user. In this paper, we propose a formal extension to stream data model languages based on the concept of fields to support high-level abstractions of continuous ST phenomena that are known to the DSE, and therefore, can be supported through queries and processing optimization. The proposed field data types are formalized in a data model language independent way using second order signatures. We formalize both the set of supported field types are as well as the embedding into stream data model languages.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Apache Spark (2016). http://spark.apache.org

  2. Ali, M.H., Aref, W.G., Bose, R., Elmagarmid, A.K., Helal, A., Kamel, I., Mokbel, M.F.: NILE-PDT: a phenomenon detection and tracking framework for data stream management systems. In: VLDB 2005, pp. 1295–1298. VLDB Endowment (2005)

    Google Scholar 

  3. Ali, M., Chandramouli, B., Raman, B., Katibah, E.: Spatio-temporal stream processing in Microsoft StreamInsight. IEEE Data Eng. Bull. 33(2), 69–74 (2010)

    Google Scholar 

  4. Arasu, A., Babu, S., Widom, J.: The CQL continuous query language: semantic foundations and query execution. VLDB J. 15(2), 121–142 (2005)

    Article  Google Scholar 

  5. Babu, S., Widom, J.: Continuous queries over data streams. ACM SIGMOD Rec. 30(3), 109 (2001)

    Article  Google Scholar 

  6. Baumann, P.: The OGC web coverage processing service (WCPS) standard. Geoinformatica 14(4), 447–479 (2010)

    Article  MathSciNet  Google Scholar 

  7. Camara, G., Egenhofer, M.J., Ferreira, K., Andrade, P., Queiroz, G., Sanchez, A., Jones, J., Vinhas, L.: Fields as a generic data type for big spatial data. In: Duckham, M., Pebesma, E., Stewart, K., Frank, A.U. (eds.) GIScience 2014. LNCS, vol. 8728, pp. 159–172. Springer, Heidelberg (2014)

    Google Scholar 

  8. Couclelis, H.: People manipulate objects (but cultivate fields): beyond the raster-vector debate in GIS. In: Frank, A.U., Campari, I., Formentini, U. (eds.) Theories and Methods of Spatio-Temporal Reasoning in Geographic Space. LNCS, vol. 639, pp. 65–77. Springer, Berlin (1992)

    Chapter  Google Scholar 

  9. Cova, T., Goodchild, M.: Extending geographical representation to include fields of spatial objects. Int. J. Geogr. Inf. Sci. 16(6), 509–532 (2002)

    Article  Google Scholar 

  10. Duckham, M., Zhong, X., Toohey, K.: Challenges to using decentralized spatial algorithms in the field: the risernet geosensor network case study. SIGSPATIAL Newlett. Spec. Issue “Geosens. Netw.” 7(2), 14–21 (2015)

    Article  Google Scholar 

  11. Erwig, M., Güting, R.H., Schneider, M., Vazirgiannis, M.: Spatio-temporal data types: an approach to modeling and querying moving objects in databases. GeoInformatica 3(3), 269–296 (1999)

    Article  Google Scholar 

  12. Faulkner, M., Olson, M., Chandy, R., Krause, J., Chandy, K., Krause, A.: The next big one: detecting earthquakes and other rare events from community-based sensors. In: International Conference on Information Processing in Sensor Networks (IPSN), pp. 13–24 (2011)

    Google Scholar 

  13. Ferreira, K.R., Camara, G., Monteiro, A.M.V.: An algebra for spatiotemporal data: from observations to events. Trans. GIS 18(2), 253–269 (2014)

    Article  Google Scholar 

  14. Galić, Z., Baranović, M., Križanović, K., Mešković, E.: Geospatial data streams: formal framework and implementation. Data Knowl. Eng. 91, 1–16 (2014)

    Article  Google Scholar 

  15. Galton, A.: A formal theory of objects and fields. In: Montello, D.R. (ed.) COSIT 2001. LNCS, vol. 2205, pp. 458–473. Springer, Heidelberg (2001)

    Google Scholar 

  16. Galton, A.: Fields and objects in space, time, and space-time. Spat. Cogn. Comput. 1, 39–68 (2004)

    Google Scholar 

  17. Güting, R.: Second-order signature: a tool for specifying data models, query processing, and optimization. In: SIGMOD 1993, pp. 277–286. ACM, New York (1993)

    Google Scholar 

  18. Güting, R., Michael, H., Erwig, M., Jensen, C., Lorentzos, N., Schneider, M., Vazirgiannis, M.: A foundation for representing and querying moving objects. 1(212), 1–37 (2000)

    Google Scholar 

  19. Hart, Q., Gertz, M.: Querying streaming geospatial image data. In: SSDBM 2005, Santa Barbara, CA, USA, pp. 147–150 (2005)

    Google Scholar 

  20. Huang, Y., Zhang, C.: New data types and operations to support geo-streams. In: Cova, T.J., Miller, H.J., Beard, K., Frank, A.U., Goodchild, M.F. (eds.) GIScience 2008. LNCS, vol. 5266, pp. 106–118. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  21. Kemp, K.: Fields as a framework for integrating GIS and environmental process models. Part 1: representing spatial continuity. Trans. GIS 1(3), 219–234 (1996)

    Article  MathSciNet  Google Scholar 

  22. Laurini, R., Paolino, L., Sebillo, M., Tortora, G., Vitiello, G.: A spatial SQL extension for continuous field querying. In: International Computer Software Applications Conference (COMPSAC 2004) vol. 2, pp. 78–81 (2004)

    Google Scholar 

  23. Liang, Q.: Towards the continuous spatio-temporal field model for sensor data streams. Dissertation, University of Maine (2015)

    Google Scholar 

  24. Nittel, S.: Real-time sensor data streams. SIGSPATIAL Newslett. Spec. Issue “Geosens. Netw.” 7(2), 22–28 (2015)

    Article  Google Scholar 

  25. Sanchez, L., Galache, J., Gutierrez, V., Hernandez, J.M., Bernat, J., Gluhak, A., Garcia, T.: SmartSantander: the meeting point between future internet research and experimentation and the smart cities. In: Future Network and Mobile Summit (FutureNetw), pp. 1–8 (2011)

    Google Scholar 

  26. Stonebraker, M., Çetintemel, U., Zdonik, S.: The 8 requirements of real-time stream processing. ACM SIGMOD Rec. 34(4), 42–47 (2005)

    Article  Google Scholar 

  27. Whittier, J., Liang, Q., Nittel, S.: Evaluating stream predicates over dynamic fields. In: Proceedings of 5th International ACM SIGSPATIAL Workshop on GeoStreaming, pp. 2–11 (2014)

    Google Scholar 

  28. Whittier, J., Nittel, S., Liang, Q., Plummer, M.: Towards window stream queries over continuous phenomena. In: Proceedings of 4th International ACM SIGSPATIAL Workshop on GeoStreaming, Orlando, FL, pp. 1–10 (2013)

    Google Scholar 

Download references

Acknowledgement

The authors would like to thank Mark Plummer for many, fruitful discussions and the National Science Foundation for supporting this work via Award No. 1527504.

Author information

Authors and Affiliations

  1. Spatial Informatics, School of Computing and Information Science, University of Maine, Orono, USA

    Qinghan Liang, Silvia Nittel & Torsten Hahmann

Authors
  1. Qinghan Liang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Silvia Nittel
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Torsten Hahmann
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Silvia Nittel .

Editor information

Editors and Affiliations

  1. University of Texas at Austin , Austin, Texas, USA

    Jennifer A. Miller

  2. University of California at Berkeley , Berkeley, California, USA

    David O'Sullivan

  3. University of Wisconsin-Madison , Madison, Wisconsin, USA

    Nancy Wiegand

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Liang, Q., Nittel, S., Hahmann, T. (2016). From Data Streams to Fields: Extending Stream Data Models with Field Data Types. In: Miller, J., O'Sullivan, D., Wiegand, N. (eds) Geographic Information Science. GIScience 2016. Lecture Notes in Computer Science(), vol 9927. Springer, Cham. https://doi.org/10.1007/978-3-319-45738-3_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-45738-3_12

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-45737-6

  • Online ISBN: 978-3-319-45738-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation