Skip to main content
SpringerLink
Log in

Spatial-feature data cube for spatiotemporal remote sensing data processing and analysis

  • Published:
Computing Aims and scope Submit manuscript

Abstract

With the rapid development in Earth observation technology, a variety of satellite sensors have provided large and open sets of remote sensing data. However, traditional methods of analysis are no longer available for time-serial remote sensing data analysis that typically handles multidimensional spatio-temporal data models. Moreover, researchers have found it trivial and tedious to obtain ready-to-analyze data for Earth science models from regular Earth observation data. For an easy and efficient time-serial remote sensing data analysis, a spatial-featured data cube analysis tool based on multidimensional data model is proposed for time-serial remote sensing data processing and analysis. For the performance consideration, a distributed execution engine was also used for efficient implementation of large-scale tasks in parallel. Finally, through experiments on both normalized difference vegetation index product and water detection within a 20-year period, we confirmed that our approach is efficient and scalable for a long time-series analysis.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Ahmed TO (2008) Spatial on-line analytical processing (SOLAP): overview and current trends. In: 2008 international conference on advanced computer theory and engineering, pp 1095–1099

  2. Apache (2017) Hadoop web site. http://hadoop.apache.org/. Accessed 05 Dec 2017

  3. Asante KO, Macuacua RD, Artan GA et al (2007) Developing a flood monitoring system from remotely sensed data for the Limpopo basin. IEEE Trans Geosci Remote Sens 45(6):1709–1714. https://doi.org/10.1109/TGRS.2006.883147

    Google Scholar 

  4. Assis LF, Ribeiro G et al (2016) Big data streaming for remote sensing time series analytics using MapReduce. In: XVII Brazilian symposium on geoinformatics

  5. Camara G, Assis LF et al (2016) Big earth observation data analytics: matching requirements to system architectures. In: Proceedings of the 5th ACM SIGSPATIAL international workshop on analytics for big geospatial data, BigSpatial ’16. ACM, New York, NY, USA, pp 1–6

  6. Chen W, Li X, He H et al (2017) Assessing different feature sets’ effects on land cover classification in complex surface-mined landscapes by ZiYuan-3 satellite imagery. Remote Sens 10(2):2–10

    Google Scholar 

  7. Chen W, Li X, He H et al (2018) A review of fine-scale land use and land cover classification in open-pit mining areas by remote sensing techniques. Remote Sens 10(1):2–14

    Google Scholar 

  8. Chen C, Liu X, Qiu T et al (2017) Latency estimation based on traffic density for video streaming in the internet of vehicles. Comput Commun 111:176–186. https://doi.org/10.1016/j.comcom.2017.08.010. http://www.sciencedirect.com/science/article/pii/S014036641730275X. Accessed 27 Nov 2017

  9. Fan J, Yan J, Ma Y et al (2018) Big data integration in remote sensing across a distributed metadata-based spatial infrastructure. Remote Sens 10(1):7

    Google Scholar 

  10. Gonzlez DB, Gonzlez LP (2013) Spatial data warehouses and SOLAP using open-source tools. In: 2013 XXXIX Latin American computing conference CLEI, pp 1–12

  11. Guo H, Wang L, Chen F et al (2014) Scientific big data and digital earth. Chin Sci Bull 59(35):5066–5073

    Google Scholar 

  12. Hoyer S, Hamman JJ (2017) xarray: N-d labeled arrays and datasets in Python. J Open Res Softw 5(3):1–3

    Google Scholar 

  13. Kennedy RE, Yang Z, Cohen WB (2010) Detecting trends in forest disturbance and recovery using yearly landsat time series: 1. landtrendr temporal segmentation algorithms. Remote Sens Environ 114(12):2897–2910

    Google Scholar 

  14. Li X, Chen G, Liu J et al (2017a) Effects of rapideye imagery’s red-edge band and vegetation indices on land cover classification in an arid region. Chin Geogr Sci 27(5):827–835

    Google Scholar 

  15. Li X, Chen W, Cheng X et al (2017b) Comparison and integration of feature reduction methods for land cover classification with rapideye imagery. Multimed Tools Appl 76(21):23041–23057

    Google Scholar 

  16. ODC (2017) Open data cube. http://datacube-core.readthedocs.io/en/latest/index.html. Accessed 13 Oct 2017

  17. OpenStreetMap (2017) The project that creates and distributes free geographic data for the world. http://www.openstreetmap.org. Accessed 24 Oct 2017

  18. Rivest S, Bdard Y, Proulx MJ, Nadeau M, Hubert F, Pastor J (2005) SOLAP technology: merging business intelligence with geospatial technology for interactive spatio-temporal exploration and analysis of data. ISPRS J Photogramm Remote Sens 60(1):17–33

    Google Scholar 

  19. Rocklin M (2015) Dask: parallel computation with blocked algorithms and task scheduling. In: Huff K, Bergstra J (eds) Proceedings of the 14th Python in science conference, pp 130–136

  20. Sakamoto T, Nguyen NV, Kotera A et al (2007) Detecting temporal changes in the extent of annual flooding within the Cambodia and the Vietnamese Mekong Delta from MODIS time-series imagery. Remote Sens Environ 109(3):295–313

    Google Scholar 

  21. SCIDB (2017) A database management system designed for multidimensional data. http://scidb.sourceforge.net/project.html. Accessed 01 Nov 2017

  22. Scotch M, Parmanto B (2005) SOVAT: spatial OLAP visualization and analysis tool. In: Proceedings of the Hawaii international conference on system sciences, p 142.2

  23. Shvachko K, Kuang H, Radia S et al (2010) The hadoop distributed file system. In: IEEE symposium on MASS storage systems and technologies, pp 1–10

  24. Song W, Wang L, Xiang Y et al (2017) Geographic spatiotemporal big data correlation analysis via the Hilbert–Huang transformation. J Comput Syst Sci 89:130–141

    MathSciNet  MATH  Google Scholar 

  25. Song W, Wang L, Liu P et al (2018) Improved t-SNE based manifold dimensional reduction for remote sensing data processing. Multimed Tools Appl. https://doi.org/10.1007/s11042-018-5715-0

  26. Thomsen E (2002) OLAP solutions: building multidimensional information systems. Wiley, Hoboken

    Google Scholar 

  27. Tian Y, Li X, Sangaiah AK et al (2018) Privacy-preserving scheme in social participatory sensing based on secure multi-party cooperation. Comput Commun 119:167–178. https://doi.org/10.1016/j.comcom.2017.10.007. http://www.sciencedirect.com/science/article/pii/S0140366417310599. Accessed 08 Feb 2018

  28. UCAR (2017) NetCDF file format and API. http://www.unidata.ucar.edu/software/netcdf/

  29. Wang L, Song W, Liu P (2016) Link the remote sensing big data to the image features via wavelet transformation. Clust Comput 19(2):793–810

    Google Scholar 

  30. Wang L, Zhang J, Liu P et al (2017) Spectral-spatial multi-feature-based deep learning for hyperspectral remote sensing image classification. Soft Comput 21(1):213–221

    MATH  Google Scholar 

  31. Yan J, Ma Y, Wang L et al (2017) A cloud-based remote sensing data production system. Future Gener Comput Syst 86:1154–1166. https://doi.org/10.1016/j.future.2017.02.044

  32. Yijiang Z (2012) The conceptual design on spatial data cube. In: 2012 2nd international conference on consumer electronics, communications and networks (CECNet), pp 645–648

  33. Zhang J, Yan J, Ma Y et al (2016) Infrastructures and services for remote sensing data production management across multiple satellite data centers. Clust Comput 19(3):1–18

    Google Scholar 

  34. Zhang L, Chen H, Sun X et al (2017) Designing spatial–temporal–spectral integrated storage structure of multi-dimensional remote sensing images. J Remote Sens 21(1):62–73

    Google Scholar 

Download references

Acknowledgements

This research was supported by the National Natural Science Foundation of China (No. 41401512), National Natural Science Foundation of China (No. 41471368), National Key Research and Development Plan of China (No. 2016YFA0600302), and Youth Innovation Promotion Association of the Chinese Academy of Sciences (No. Y6YR0300QM).

Author information

Authors and Affiliations

  1. Institute of Remote Sensing and Digital Earth, University of Chinese Academy of Sciences, Beijing, 100094, People’s Republic of China

    Dong Xu

  2. Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, Beijing, 100094, People’s Republic of China

    Yan Ma, Peng Liu & Lajiao Chen

  3. China University of Geosciences, Wuhan, 430074, People’s Republic of China

    Jining Yan

Authors
  1. Dong Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yan Ma
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jining Yan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Peng Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Lajiao Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Yan Ma or Jining Yan.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xu, D., Ma, Y., Yan, J. et al. Spatial-feature data cube for spatiotemporal remote sensing data processing and analysis. Computing 102, 1447–1461 (2020). https://doi.org/10.1007/s00607-018-0681-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00607-018-0681-y

Keywords

Mathematics Subject Classification

Search

Navigation