Skip to main content
SpringerLink
Log in

Hyperspectral Data Feature Extraction Using Deep Learning Hybrid Model

  • Published:
Wireless Personal Communications Aims and scope Submit manuscript

Abstract

The original hyperspectral data served as the initial features has the characteristics of high dimension and redundancy, which is not suitable for the subsequent analysis, so extracting feature information is needed. The deep learning model has a strong ability in feature learning, but if the model has too many layers which will lead to the original information loss in the process of layer-by-layer feature learning and reduce the subsequent classification accuracy. To solve this problem, the paper proposed a deep learning model of hybrid structure with the contractive autoencoder and restricted boltzmann machine to extract the hyperspectral data feature information. First, through pre-processing the spectral data, the 2d spectrum data is converted into a one dimensional vector. Then, a hybrid model is constructed for unsupervised training and supervised learning for the hyperspectral data, and features are extracted from bottom to top gradually according to the hybrid model. Finally, the SVM classifier is adopted to enhance the classification ability of spectral data. The paper uses the hybrid model proposed to test for extracting features with two sets of AVIRIS data and compares with PCA and GCA methods. The experiment results show that the feature extraction algorithm based on hybrid depth model can get the better features, and have strong distinguish performance, and can get better classification accuracy by the SVM algorithm.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Jia, X., Kuo, B. C., & Crawford, M. M. (2013). Feature mining for hyper-spectral image classification. Proceedings of the IEEE, 101(3), 676–697.

    Article  Google Scholar 

  2. Huo, L. G., & Feng, X. C. (2014). Denoising of hyperspectral remote sensing image based on principal component analysis and dictionary learning. Journal of Electronics & Information Technology, 36(11), 2723–2729.

    Google Scholar 

  3. Cheng, S. X., Xie, C. Q., Wang, Q. N., et al. (2014). Different wavelengths selection methods for identification of early blight on tomato leaves by using hyperspectral imaging technique. Spectroscopy and Spectral Analysis, 34(5), 1362–1366.

    Google Scholar 

  4. Fan, L., Lv, J., & Deng, J. (2014). Classification of hyperspectral remote sensing images based on bands grouping and classification ensembles. Acta Optica Sinica, 34(9), 1–11.

    Google Scholar 

  5. Cheriyadat, A., & Bruce, L. (2003). Why principal component analysis is not an appropriate feature extraction method for hyperspectral data. Proceeding of IEEE Geoscience and Remote Sensing Symposium (IGARSS), 104(2), 3420–3422.

    Google Scholar 

  6. Sun, K., Geng, X., Tang, H., et al. (2015). A new target detection method using nonlinear PCA for hyperspectral imagery. Bulletin of Surveying and Mapping, 0(1), 105–108.

    Google Scholar 

  7. Liu, J. (2012). Kernel direct LDA subspace hyperspectral image terrain classification. Computer Science, 39(6), 274–277.

    Google Scholar 

  8. Feng, D. C., Chen, F., & Wen-Li, X. U. (2014). Detecting local manifold structure for unsupervised feature selection. Acta Automatica Sinica, 40(10), 2253–2261.

    Article  MATH  Google Scholar 

  9. Zhou, S., Tan, K., & Wu, L. (2014). Hyperspectral image classification based on ISOMAP algorithm using neighborhood distance. Remote Sensing Technology & Application, 29(4), 695–700.

    Google Scholar 

  10. Yan, L., & Roy, D. P. (2015). Improved time series land cover classification by missing-observation-adaptive nonlinear dimensionality reduction. Remote Sensing of Environment, 158, 478–491.

    Article  Google Scholar 

  11. Sun, W., Liu, C., Shi, B., et al. (2014). Dimensionality reduction with improved local tangent space alignment for hyperspectral imagery classification. Journal of Tongji University, 42(1), 0124–0130.

    Google Scholar 

  12. Li, Y., Su, H., Qi, C. R., et al. (2015). Joint embeddings of shapes and images via CNN image purification. ACM Transactions on Graphics, 34(6), 1–12.

    Google Scholar 

  13. Hinton, G., Deng, L., Yu, D., et al. (2012). Deep neural networks for acoustic modeling in speech recognition. IEEE Signal Processing Magazine, 29(6), 82–97.

    Article  Google Scholar 

  14. Dahl, G. E., Yu, D., Deng, L., et al. (2012). Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition. IEEE Trans on Audio, Speech and Language Processing, 20(1), 30–42.

    Article  Google Scholar 

  15. Xie, J., Zhang, L., You, J., et al. (2015). Effective texture classification by texton encoding induced statistical features. Pattern Recognition, 48(2), 447–457.

    Article  Google Scholar 

  16. Rifai, S., Vincent, P., Muller, X., Glorot, X., & Bengio, Y. (2011). Contractive auto-encoders: Explicit invariance during feature extraction. In Proceedings of the international conference on machine learning (ICML) (pp. 833–840).

  17. Erhan, D., Manzagol, P., Bengio, Y., Bengio, S., & Vincent, P. (2009). The difficulty of training deep architectures and the effect of unsupervised pretraining. In Proceedings of the international conference on artificial intelligence and statistics (AISTATS) (pp. 153–160).

  18. Hinton, G. E., & Ruslan, R. (2006). Reducing the dimensionality of data with neural networks. Science, 313(5786), 504–507.

    Article  MathSciNet  MATH  Google Scholar 

  19. Hjelm, R. D., Calhoun, V. D., Salakhutdinov, R., et al. (2014). Restricted Boltzmann machines for neuroimaging: An application in identifying intrinsic networks. Neuroimage, 96(8), 245–260.

    Article  Google Scholar 

  20. Barat, C., & Ducottet, C. (2016). String representations and distances in deep convolutional neural networks for image classification. Pattern Recognition, 54, 104–115.

    Article  Google Scholar 

  21. Wang, Y., Yao, H., & Zhao, S. (2015). Auto-encoder based dimensionality reduction. Neurocomputing, 184, 232–242.

    Article  Google Scholar 

  22. Ba, J., Grosse, R., & Salakhutdinov, R., et al. (2015). Learning wake-sleep recurrent attention models. In Conference on neural information processing systems, Canada (pp. 1–9).

  23. Hinton, G. E. (2010). A practical guide to training restricted Boltzmann machines. Department of Computer Science, University of Toronto, Montreal.

  24. Hinton, G. E. (2002). Training products of experts by minimizing contrastive divergence. Neural Computation, 14(8), 1771–1800.

    Article  MATH  Google Scholar 

  25. Schulz, H., Cho, K., & Raiko, T., et al. (2013). Two layers contractive encoding with shortcuts for semi-supervised learning. In Proceedings of the 20th international conference on neural information processing (pp. 450–457).

  26. Le Roux, N., & Bengio, Y. (2008). Representational power of restricted Boltzmann machines and deep belief networks. Neural Computation, 20(6), 1631–1649.

    Article  MathSciNet  MATH  Google Scholar 

  27. Zhang, C. X., Ji, N. N., & Wang, G. W. (2015). Restricted Boltzmann machines. Chinese Journal of Engineering Mathematics, 32(2), 159–173.

    MathSciNet  MATH  Google Scholar 

  28. Larochelle, H., Bengio, Y., Louradour, J., et al. (2009). Exploring strategies for training deep neural networks. Journal of Machine Learning Research, 10(6), 1–40.

    MATH  Google Scholar 

Download references

Acknowledgements

This work was supported by national and international scientific and technological cooperation special projects (No. 2015DFA00530), and supported by national natural science foundation of China (Nos. 61461042, 61461041).

Author information

Authors and Affiliations

  1. College of Computer and Information Engineering, Inner Mongolia Agricultural University, Hohhot, China

    Xinhua Jiang, Heru Xue, Xiaojing Gao, Yanqing Zhou & Jie Bai

  2. College of Physics and Electronic Information Science, Inner Mongolia Normal University, Hohhot, China

    Lina Zhang

Authors
  1. Xinhua Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Heru Xue
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Lina Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Xiaojing Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yanqing Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Jie Bai
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xinhua Jiang.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jiang, X., Xue, H., Zhang, L. et al. Hyperspectral Data Feature Extraction Using Deep Learning Hybrid Model. Wireless Pers Commun 102, 3529–3543 (2018). https://doi.org/10.1007/s11277-018-5389-y

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11277-018-5389-y

Keywords

Search

Navigation