Skip to main content
Springer Nature Link
Log in

Multi-dimensional, multi-branch hyperspectral remote sensing image classification with limited training samples

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Deep learning-based hyperspectral remote sensing image classification methods are currently a research hotspot. However, they suffer from issues such as large feature network parameter size, complex calculations, and the need for a large number of training data to achieve good classification results. Moreover, hyperspectral remote sensing images face challenges such as difficulty in obtaining the ground truth of land cover, limited availability of effective datasets for training, and endmember spectral variability, making it difficult for existing algorithm models to be widely adopted. To address these issues, this paper proposes a multi-branch classification model with multi-dimensional feature fusion, constructing lightweight deep network models for one-dimensional spectral, two-dimensional spatial, and three-dimensional depth feature extraction, respectively. This enriches feature information while reducing the parameters of each branch’s deep model, effectively improving the land cover classification accuracy using hyperspectral remote sensing images under limited training sample conditions. Experimental verification with open-source hyperspectral remote sensing datasets shows that the proposed classification method can obtain over 90% classification accuracy when the training set account for only 5% of the total dataset, which is significantly better than current mainstream deep network classification models.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

Data availability

No datasets were generated or analysed during the current study.

References

  1. Zhong, Y., Zhang, L., Huang, B.: An unsupervised artificial immune classifier for multi-hyperspectral remote sensing imagery[J]. IEEE Trans. Geosci. Remote Sens. 44(2), 420–431 (2006)

    Article  Google Scholar 

  2. Guangzhe, Z., Bing, T., Hongyan, F., et al.: Spatial-spectral classification of hyperspectral image via group tensor decomposition[J]. Neurocomputing. 316, 68–77 (2018)

    Article  Google Scholar 

  3. Paheding, S., Vijayan, K.A., Vasit, S.: Progressively expanded neural network for hyperspectral image classification: A new neural network paradigm for remote sensing image analysis[J]. ISPRS J. Photogrammetry Remote Sens. 146, 161–181 (2018)

    Article  Google Scholar 

  4. Chenming, L., Zelin, Q., Xueying, C., Zhonghao, C., Hongming, G., Zaijun, H.: Hybrid dilated convolution with multi-scale residual fusion network for hyperspectral image classification[J]. Micromachines. 12(5), 545 (2021)

    Article  Google Scholar 

  5. Mengbin, R., Ping, T., Zheng, Z.: Spatial-spectral relation network for hyperspectral image classification with limited training samples[J]. IEEE J. Sel. Top. Appl. Earth Observations Remote Sens. 12(12), 5086–5100 (2019)

    Article  Google Scholar 

  6. Shengxiang, Q., Jie, M., Jin, L., Yansheng, L., Jinwen, T.: Unsupervised ship detection based on saliency and S-HOG descriptor from optical satellite images[J]. IEEE Geosci. Remote Sens. Lett. 12(7), 1451–1455 (2015)

    Article  Google Scholar 

  7. Belgiu, M., Dragut, L.: Random forest in remote sensing: A review of applications and future directions[J]. ISPRS J. Photogrammetry Remote Sens. 114, 24–31 (2016)

    Article  Google Scholar 

  8. Haotian, Z., Yin, Z., Liang, C., Hao, S.: Ship detection in optical satellite images based on sparse representation[J]. Signal. Inform. Process. Netw. Computers, 164–171. (2017)

  9. Krizhevsky, A., Sutskever, L., Hinton, G.: Imagenet classification with deep convolutional neural networks[J]. Commun. ACM. 60(6), 84–90 (2017)

    Article  Google Scholar 

  10. Romaszewski, M., Glomb, P., Cholewa, M.: Semi-supervised hyperspectral classification from a small number of training samples using a cotraining approach[J]. ISPRS J. Photogrammetry Remote Sens. 121, 60–76 (2016)

    Article  Google Scholar 

  11. Zhongwei, L., Xingshuai, C., Leiquan, W., Hao, Z., Xue, Z., Yajing, Z.: Spectral and spatial global context attention for hyperspectral image classification[J]. Remote Sens. 13(4), 771 (2021)

    Article  Google Scholar 

  12. Xin, H., Yushi, C., Zhouhan, L.: Spatial-spectral transformer for hyperspectral image classification[J]. Remote Sens. 13(3), 498 (2021)

    Article  Google Scholar 

  13. Junru, Y., Changsheng, Q., Qiqiang, C., Jiantao, Q.: Spatial-spectral network for hyperspectral image classification: A 3D CNN and Bi-LSTM framework[J]. Remote Sens. 13(12), 2353 (2021)

    Article  Google Scholar 

  14. He, K., Zhang, X., Ren, S., Sun, J., Deep Residual Learning for Image Recognition:. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) - Las Vegas, NV, USA, 2016:770–778. (2016)

  15. Hochreiter, S., Schmidhuber, J.: Long short-term memory[J]. Neural Comput. 9(8), 1735–1780 (1997)

    Article  Google Scholar 

  16. Hyperspectral Remote Sensing Scenes[EB/OL]: Available: (2021). http://www.ehu.eus/ccwintco/index.php?title=Hyperspectral_Remote_Sensing_Scenes

  17. Xiaoguang, M., Erting, P., Yong, M., Xiaobing, D., Jun, H.: Spectral-spatial attention networks for hyperspectral image Classification[J]. Remote Sens. 11(8), 963 (2019)

    Article  Google Scholar 

  18. Sun, L., Zhao, G., Zheng, Y., Wu, Z.: Spectral–spatial feature tokenization transformer for hyperspectral image classification. IEEE Trans. Geosci. Remote Sens., (60): 1–14. (2022)

  19. Xu, H., Zeng, Z., Yao, W., et al.: CS2DT: Cross spatial–spectral dense transformer for hyperspectral image classification. IEEE Geosci. Remote Sens. Lett., (20):1–5. (2023)

  20. Yuan, D., Yu, D., Qian, Y., Xu, Y., Liu, Y.: S2Former: Parallel spectral–spatial transformer for hyperspectral image classification. Electronics. 12(18), 3937 (2023). https://doi.org/10.3390/electronics12183937

    Article  Google Scholar 

Download references

Funding

This research was funded by the National Natural Science Foundation of China under grant number 61801018, and the Fundamental Research Funds for the Central Universities under grant number FRF-BD-19–002 A.

Author information

Authors and Affiliations

  1. Department of Instrument Science and Technology, School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing, 100083, China

    Yiliang Zeng

  2. Beijing Institute of Computer Technology and Applications, Beijing, 100854, China

    Zhiwu Lv & Hao Zhang

  3. School of Electrical, Computer and Telecommunication Engineering, University of Wollongong, Northfields Ave Wollongong, Wollongong, NSW, 2522, Australia

    Jiahong Zhao

  4. Beijing Engineering Research Center of Industrial Spectrum Imaging, School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing, 100083, China

    Yiliang Zeng

Authors
  1. Yiliang Zeng
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Zhiwu Lv
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Hao Zhang
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Jiahong Zhao
    View author publications

    You can also search for this author inPubMed Google Scholar

Contributions

Conceptualization, Y.Z. and Z.L.; methodology, Y.Z.; software, Y.Z.; validation, Z.L., H.Z. and J.Z.; writing—original draft preparation, Y.Z. and Z.L.; writing—review and editing, J.Z.; fund-ing acquisition, Y.Z. All authors have read and agreed to the published version of the manu-script.

Corresponding author

Correspondence to Yiliang Zeng.

Ethics declarations

Competing interests

The authors declare no competing interests.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zeng, Y., Lv, Z., Zhang, H. et al. Multi-dimensional, multi-branch hyperspectral remote sensing image classification with limited training samples. SIViP 18, 7199–7210 (2024). https://doi.org/10.1007/s11760-024-03385-w

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-024-03385-w

Keywords