Abstract
The emergence of low-cost environmental sensors has presented an opportunity for environmental data, as a substantial pool of real-time and historical data becomes openly available. This environmental open data provides potential for new opportunities to enhance environmental applications. However consuming this data as it is currently available presents many challenges, including heterogeneous platforms and data schema, archaic data formats and limited scaling potential. We address these issues in our solution OpenSense.network. This paper describes in detail the development of the platform, including data model, system architecture and data collection approach. The presented architecture is able to serve huge amounts of data, through the deliberate employment of a decentralized time-series database in combination with a powerful spatial and relational database. Furthermore, we pay special attention to data consumption in our approach and suggest a web-friendly JSON-based API and a discoverable graphic user interface.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
- 2.
- 3.
- 4.
- 5.
Recently, 10-min and 1-min data was also added for some stations but these are not imported to OpenSense.network as of yet.
- 6.
- 7.
- 8.
Available at https://www.opensense.network/apidocs/.
- 9.
The map is available via https://www.opensense.network/.
- 10.
- 11.
- 12.
- 13.
- 14.
- 15.
References
Botts, M., Robin, A.: Opengis sensor model language (sensorml) implementation specification. OpenGIS Implement. Specificat. OGC 7 (2007)
Castell, N., Dauge, F.R., Schneider, P., Vogt, M., Lerner, U., Fishbain, B., Broday, D., Bartonova, A.: Can commercial low-cost sensor platforms contribute to air quality monitoring and exposure estimates? Environ. Int. 99, 293–302 (2017). https://doi.org/10.1016/j.envint.2016.12.007
Catlett, C., Malik, T., Goldstein, B., Giuffrida, J., Shao, Y., Panella, A., Eder, D., van Zanten, E., Mitchum, R., Thaler, S., et al.: Plenario: an open data discovery and exploration platform for urban science. IEEE Data Eng. Bullet. 37(4), 27–42 (2014)
Christin, D., Reinhardt, A., Kanhere, S.S., Hollick, M.: A survey on privacy in mobile participatory sensing applications. J. Syst. Softw. 84(11), 1928–1946 (2011). https://doi.org/10.1016/j.jss.2011.06.073
Datastax Documentation: Getting started with time series data modeling. www.academy.datastax.com/resources/getting-started-time-series-data-modeling. Accessed 15 May 2018
Kuhlenkamp, J., Klems, M., Röss, O.: Benchmarking scalability and elasticity of distributed database systems. VLDB Endowm. 1219–1230 (2014). https://doi.org/10.14778/2732977.2732995
Leighton, B., Cox, S.J.D., Car, N.J., Stenson, M.P., Vleeshouwer, J., Hodge, J.: A best of both worlds approach to complex, efficient, time series data delivery. In: Environmental Software Systems. Infrastructures, Services and Applications, pp. 371–379. Cham (2015). https://doi.org/10.1007/978-3-319-15994-2_37
Liang, S., Huang, C.Y., Khalafbeigi, T., et al.: OGC sensorthings API-part 1: Sensing. OGC Implementation Standard (2016). http://docs.opengeospatial.org/is/15-078r6/15-078r6.html. Accessed 15 May 2018
Sadalage, P.J., Fowler, M.: NoSQL Distilled: A Brief Guide to the Emerging World of Polyglot Persistence. Pearson Education (2012)
Schäfer, M., Strohmeier, M., Lenders, V., Martinovic, I., Wilhelm, M.: Bringing up opensky: a large-scale ads-b sensor network for research. In: Proceedings of the 13th International Symposium on Information Processing in Sensor Networks, pp. 83–94 (2014). https://doi.org/10.1109/IPSN.2014.6846743
Shadbolt, N., O’Hara, K., Berners-Lee, T., Gibbins, N., Glaser, H., Hall, W., Schraefel, M.C.: Linked open government data: lessons from data.gov.uk. IEEE Intelligen. Syst. 27(3), 16–24 (2012). https://doi.org/10.1109/MIS.2012.23
Wetz, P., Trinh, T.D., Do, B.L., Anjomshoaa, A., Kiesling, E., Tjoa, A.M.: Towards an environmental information system for semantic stream data. In: Proceedings of the 28th EnviroInfo Conference, pp. 637–644 (2014)
Acknowledgements
We are deeply indebted to our student assistant Gereon Dusella. His implementation efforts for the visual map interface and our helpful discussions concerning the continuous development of the overall prototype are greatly appreciated.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Borges, M.C., Pallas, F., Peise, M. (2018). Providing Open Environmental Data—The Scalable and Web-Friendly Way. In: Bungartz, HJ., Kranzlmüller, D., Weinberg, V., Weismüller, J., Wohlgemuth, V. (eds) Advances and New Trends in Environmental Informatics. Progress in IS. Springer, Cham. https://doi.org/10.1007/978-3-319-99654-7_2
Download citation
DOI: https://doi.org/10.1007/978-3-319-99654-7_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-99653-0
Online ISBN: 978-3-319-99654-7
eBook Packages: Computer ScienceComputer Science (R0)