Abstract
In addition to providing interactive queries, Spark can also optimize the iteration workload. The processing of remote sensing image is also a hot topic in recent years. This paper improves the traditional image classification technology based on K-means algorithm, and proposes a new hyperspectral image clustering method combined with spectral clustering method. On the basis of feature dimensionality reduction of hyperspectral image data, K-means algorithm is used for rough clustering of images, and then spectral clustering method is used for quadratic clustering of the clustering results. Compared with the traditional K-means clustering algorithm, the simulation results show that this method can effectively improves the classification accuracy of image clustering. The comparison experiments between simulated data and real hyperspectral data show that this method has the best clustering performance compared with the single K-means or spectral clustering method.
References
B. Min and R. C. C. Cheung, A Fast CU Size decision algorithm for the HEVC Intra Encoder, IEEE Transactions on Circuits and Systems for Video Technology., Vol. 25, No. 5, pp. 892–896, 2015.
L. Gao, J. Li, M. Khodadadzadeh, et al., Subspace-basedsupport vector machines for hyperspectral image classifica-tion, IEEE Geoscience & Remote Sensing Letters, Vol. 12, No. 2, pp. 349–353, 2015.
W. Hu, Y. Huang, L. Wei, et al., Deep convolutional neuralnetworks for hyperspectral image classification, Journal of Sensors, Vol. 2, pp. 1–12, 2015.
L. Li, J. Yao, X. Lu, J. Tu and J. Shan, Optimal seamline detection for multiple image mosaicking via graph cuts, ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 113, pp. 1–16, 2016.
Y. Zhang, B. Wang, Z. Zhang, Y. Duan, Y. Zhang, M. Sun and S. Ji, Fully automatic generation of geoinformation products with chinese zy-3 satellite imagery, Photogram Rec, Vol. 148, pp. 383–401, 2014.
H. Shen, H. Li, Y. Qian, L. Zhang and Q. Yuan, An effective thin cloud removal procedure for visible remote sensing images, ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 96, p. 224, 2014.
Z. Zhu and C. E. Woodcock, Automated cloud, cloud shadow, and snow detection in multitemporal Landsat data: an algorithm designed specifically for monitoring land cover change, Remote Sensing of Environment, Vol. 152, pp. 217–234, 2014.
Q. Cheng, H. Shen, L. Zhang, Q. Yuan and C. Zeng, Cloud removal for remotely sensed images by similar pixel replacement guided with a spatio-temporal MRF model, ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 92, pp. 54–68, 2014.
K. Rokni, A. Ahmad, K. Solaimani and S. Hazini, A new approach for surface water change detection: integration of pixel level image fusion and image classification techniques, International Journal of Applied Earth Observation, Vol. 34, pp. 226–234, 2015.
M. K. Ghosh, L. Kumar and C. Roy, Monitoring the Coastline Change of Hatiya Island in Bangladesh using Remote Sensing Techniques, ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 101, pp. 137–144, 2014.
J. Wang, Y. Zhao, C. Li, L. Yu, D. Liu and P. Gong, Mapping global land cover in 2001 and 2010 with spatial-temporal consistency at 250 m resolution, ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 103, pp. 38–47, 2014.
W. Sun and Y. Xu, Financial Security Evaluation of the Electric Power Industry in China Based on a Back Propagation Neural Network Optimized by Genetic Algorithm, Energy, Vol. 101, pp. 366–379, 2016.
G. Bello-Orgaz, J. J. Jung and D. Camacho, Social big data: recent achievements and new challenges, Information Fusion, Vol. 28, pp. 45–59, 2016.
J. L. Reyes-Ortiz, L. Oneto and D. Anguita, Big Data Analytics in the Cloud: spark on Hadoop vs MPI/OpenMP on Beowulf, Procedia Computer Science, Vol. 28, pp. 45–59, 2015.
N. Kurinjivendhan and K. Thangadurai, Modified k-means algorithm and genetic approach for cluster optimization. International Conference on Data Mining and Advanced Computing. 2016.
X. Li, L. Zhang, L. Y. Wang, et al., Effects of BOW model with affinity propagation and spatial pyramid matching on Polarimetric SAR image classification, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, Vol. 10, pp. 3314–3322, 2017.
L. Liang, L. Di, L. Zhang, M. Deng, Z. Qin, S. Zhao and H. Lin, Estimation of crop LAI using hyperspectral vegetation indices and a hybrid inversion method, Remote Sensing of Environment, Vol. 165, pp. 12–134, 2015.
W. Hu, Y. Huang, L. Wei, F. Zhang, H. Li and T. Wu, Deep Convolutional Neural Networks for Hyperspectral Image Classification, Journal of Sensors, Vol. 2015, p. 12, 2015.
B. Liao, J. Xu, J. Lv and S. Zhou, An image retrieval method for binary images based on DBN and Softmax Classifier, IETE Technical Review, Vol. 32, No. 4, pp. 294–303, 2015.
S. Istephan and M.-R. Siadat, Unstructured medical image query using big data—An epilepsy case study, Journal of Biomedical Informatics, Vol. 32, pp. 294–303, 2016.
Acknowledgement
This paper was researched by the support of Shandong Provincial Natural Science Foundation, China, which No is ZR2018MF003.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Xing, Z., Li, G. Intelligent Classification Method of Remote Sensing Image Based on Big Data in Spark Environment. Int J Wireless Inf Networks 26, 183–192 (2019). https://doi.org/10.1007/s10776-019-00440-z
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10776-019-00440-z