Skip to main content
Log in

Intelligent Classification Method of Remote Sensing Image Based on Big Data in Spark Environment

  • Published:
International Journal of Wireless Information Networks Aims and scope Submit manuscript

Abstract

In addition to providing interactive queries, Spark can also optimize the iteration workload. The processing of remote sensing image is also a hot topic in recent years. This paper improves the traditional image classification technology based on K-means algorithm, and proposes a new hyperspectral image clustering method combined with spectral clustering method. On the basis of feature dimensionality reduction of hyperspectral image data, K-means algorithm is used for rough clustering of images, and then spectral clustering method is used for quadratic clustering of the clustering results. Compared with the traditional K-means clustering algorithm, the simulation results show that this method can effectively improves the classification accuracy of image clustering. The comparison experiments between simulated data and real hyperspectral data show that this method has the best clustering performance compared with the single K-means or spectral clustering method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

References

  1. B. Min and R. C. C. Cheung, A Fast CU Size decision algorithm for the HEVC Intra Encoder, IEEE Transactions on Circuits and Systems for Video Technology., Vol. 25, No. 5, pp. 892–896, 2015.

    Article  Google Scholar 

  2. L. Gao, J. Li, M. Khodadadzadeh, et al., Subspace-basedsupport vector machines for hyperspectral image classifica-tion, IEEE Geoscience & Remote Sensing Letters, Vol. 12, No. 2, pp. 349–353, 2015.

    Article  Google Scholar 

  3. W. Hu, Y. Huang, L. Wei, et al., Deep convolutional neuralnetworks for hyperspectral image classification, Journal of Sensors, Vol. 2, pp. 1–12, 2015.

    Article  Google Scholar 

  4. L. Li, J. Yao, X. Lu, J. Tu and J. Shan, Optimal seamline detection for multiple image mosaicking via graph cuts, ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 113, pp. 1–16, 2016.

    Article  Google Scholar 

  5. Y. Zhang, B. Wang, Z. Zhang, Y. Duan, Y. Zhang, M. Sun and S. Ji, Fully automatic generation of geoinformation products with chinese zy-3 satellite imagery, Photogram Rec, Vol. 148, pp. 383–401, 2014.

    Article  Google Scholar 

  6. H. Shen, H. Li, Y. Qian, L. Zhang and Q. Yuan, An effective thin cloud removal procedure for visible remote sensing images, ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 96, p. 224, 2014.

    Article  Google Scholar 

  7. Z. Zhu and C. E. Woodcock, Automated cloud, cloud shadow, and snow detection in multitemporal Landsat data: an algorithm designed specifically for monitoring land cover change, Remote Sensing of Environment, Vol. 152, pp. 217–234, 2014.

    Article  Google Scholar 

  8. Q. Cheng, H. Shen, L. Zhang, Q. Yuan and C. Zeng, Cloud removal for remotely sensed images by similar pixel replacement guided with a spatio-temporal MRF model, ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 92, pp. 54–68, 2014.

    Article  Google Scholar 

  9. K. Rokni, A. Ahmad, K. Solaimani and S. Hazini, A new approach for surface water change detection: integration of pixel level image fusion and image classification techniques, International Journal of Applied Earth Observation, Vol. 34, pp. 226–234, 2015.

    Article  Google Scholar 

  10. M. K. Ghosh, L. Kumar and C. Roy, Monitoring the Coastline Change of Hatiya Island in Bangladesh using Remote Sensing Techniques, ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 101, pp. 137–144, 2014.

    Article  Google Scholar 

  11. J. Wang, Y. Zhao, C. Li, L. Yu, D. Liu and P. Gong, Mapping global land cover in 2001 and 2010 with spatial-temporal consistency at 250 m resolution, ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 103, pp. 38–47, 2014.

    Article  Google Scholar 

  12. W. Sun and Y. Xu, Financial Security Evaluation of the Electric Power Industry in China Based on a Back Propagation Neural Network Optimized by Genetic Algorithm, Energy, Vol. 101, pp. 366–379, 2016.

    Article  Google Scholar 

  13. G. Bello-Orgaz, J. J. Jung and D. Camacho, Social big data: recent achievements and new challenges, Information Fusion, Vol. 28, pp. 45–59, 2016.

    Article  Google Scholar 

  14. J. L. Reyes-Ortiz, L. Oneto and D. Anguita, Big Data Analytics in the Cloud: spark on Hadoop vs MPI/OpenMP on Beowulf, Procedia Computer Science, Vol. 28, pp. 45–59, 2015.

    Google Scholar 

  15. N. Kurinjivendhan and K. Thangadurai, Modified k-means algorithm and genetic approach for cluster optimization. International Conference on Data Mining and Advanced Computing. 2016.

  16. X. Li, L. Zhang, L. Y. Wang, et al., Effects of BOW model with affinity propagation and spatial pyramid matching on Polarimetric SAR image classification, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, Vol. 10, pp. 3314–3322, 2017.

    Article  Google Scholar 

  17. L. Liang, L. Di, L. Zhang, M. Deng, Z. Qin, S. Zhao and H. Lin, Estimation of crop LAI using hyperspectral vegetation indices and a hybrid inversion method, Remote Sensing of Environment, Vol. 165, pp. 12–134, 2015.

    Article  Google Scholar 

  18. W. Hu, Y. Huang, L. Wei, F. Zhang, H. Li and T. Wu, Deep Convolutional Neural Networks for Hyperspectral Image Classification, Journal of Sensors, Vol. 2015, p. 12, 2015.

    Article  Google Scholar 

  19. B. Liao, J. Xu, J. Lv and S. Zhou, An image retrieval method for binary images based on DBN and Softmax Classifier, IETE Technical Review, Vol. 32, No. 4, pp. 294–303, 2015.

    Article  Google Scholar 

  20. S. Istephan and M.-R. Siadat, Unstructured medical image query using big data—An epilepsy case study, Journal of Biomedical Informatics, Vol. 32, pp. 294–303, 2016.

    Google Scholar 

Download references

Acknowledgement

This paper was researched by the support of Shandong Provincial Natural Science Foundation, China, which No is ZR2018MF003.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Guangming Li.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xing, Z., Li, G. Intelligent Classification Method of Remote Sensing Image Based on Big Data in Spark Environment. Int J Wireless Inf Networks 26, 183–192 (2019). https://doi.org/10.1007/s10776-019-00440-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10776-019-00440-z

Keywords

Navigation