Skip to main content

Advertisement

SpringerLink
Log in

HRNet- and PSPNet-based multiband semantic segmentation of remote sensing images

  • S.I.: AI based Techniques and Applications for Intelligent IoT Systems
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

High-resolution remote sensing images have become mainstream remote sensing data, but there is an obvious "salt and pepper phenomenon" in the existing semantic segmentation methods of high-resolution remote sensing images. The purpose of this paper is to propose an improved deep convolutional neural network based on HRNet and PSPNet to segment and realize deep scene analysis and improve the pixel-level semantic segmentation representation of high-resolution remote sensing images. Based on hierarchical multiscale segmentation technology research, the main method is multiband segmentation; the vegetation, buildings, roads, waters and bare land rule sets in the experimental area are established, the classification is extracted, and the category is labeled at each pixel in the image. Using the image classification network structure, different levels of feature vectors can be used to meet the judgment requirements. The HRNet and PSPNet algorithms are used to analyze the scene and obtain the category labels of all pixels in an image. Experiments have shown that artificial intelligence uses the pyramid pooling module in the classification and recognition of CCF satellite images. In the context of integrating different regions, PSPNet affects the region segmentation accuracy. FCN, DeepLab and PSPNet are now the best methods and achieve 98% accuracy. However, the PSPNet object recognition algorithm has better advantages in specific areas. Experiments show that this method has high segmentation accuracy and good generalization ability and can be used in practical engineering.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Data availability

No data were used to support this study.

References

  1. Liu Y, Ren Q, Geng J et al (2018) Efficient patch-wise semantic segmentation for large-scale remote sensing images. Sensors 18(10):3232

    Article  Google Scholar 

  2. Zhongbin Su, Li W, Ma Z, Gao R (2022) An improved U-Net method for the semantic segmentation of remote sensing images. Appl Intell 52(3):3276–3288

    Article  Google Scholar 

  3. Moradkhani K, Fathi A (2022) Segmentation of waterbodies in remote sensing images using deep stacked ensemble model. Appl Soft Comput 124:109038

    Article  Google Scholar 

  4. Kemker R, Salvaggio C, Kanan C (2018) Algorithms for semantic segmentation of multispectral remote sensing imagery using deep learning. ISPRS J Photogramm Remote Sens 145:60–77

    Article  Google Scholar 

  5. Huang Y, Wang Q, Jia W et al. (2019) See More Than Once--Kernel-Sharing Atrous Convolution for Semantic Segmentation. arXiv preprint: arXiv:1908.09443

  6. Ogohara K, Gichu R (2022) Automated segmentation of textured dust storms on mars remote sensing images using an encoder-decoder type convolutional neural network. Comput Geosci 160:105043

    Article  Google Scholar 

  7. Panboonyuen T, Jitkajornwanich K, Lawawirojwong S et al (2019) Semantic segmentation on remotely sensed images using an enhanced global convolutional network with channel attention and domain specific transfer learning. Remote Sens 11(1):83

    Article  Google Scholar 

  8. Zhang Z, Huang J, Jiang T et al (2020) Semantic segmentation of very high-resolution remote sensing image based on multiple band combinations and patchwise scene analysis. J Appl Remote Sens 14(1):016502

    Article  Google Scholar 

  9. Liu Y, Shen C, Yu C et al. (2020) Efficient Semantic Video Segmentation with Per-frame Inference. arXiv preprint: arXiv:2002.11433

  10. Jamali-Rad H, Szabo A, Presutto M. (2020) Lookahead adversarial semantic segmentation. arXiv preprint: arXiv:2006.11227

  11. Alam M, Wang J-F, Cong G, Lv Y, Chen Y (2021) Convolutional neural network for the semantic segmentation of remote sensing images. Mob Networks Appl 26(1):200–215

    Article  Google Scholar 

  12. Dong R, Pan X, Li F (2019) DenseU-net-based semantic segmentation of small objects in urban remote sensing images. IEEE Access 7:65347–65356

    Article  Google Scholar 

  13. Ding L, Zhang J, Bruzzone L (2020) Semantic segmentation of large-size vhr remote sensing images using a two-stage multiscale training architecture. IEEE Trans Geosci Remote Sens 58(8):5367–5376

    Article  Google Scholar 

  14. Mohammadimanesh F, Salehi B, Mahdianpari M et al (2019) A new fully convolutional neural network for semantic segmentation of polarimetric SAR imagery in complex land cover ecosystem. ISPRS J Photogramm Remote Sens 151:223–236

    Article  Google Scholar 

  15. Jacquemart D, Mandin JY, Dana V et al (2021) A multispectrum fitting procedure to deduce molecular line parameters: application to the 3–0 band of 12C16O[J]. Eur Phys J D 14(1):55–69

    Article  Google Scholar 

  16. Guo Z, Wu G, Song X et al (2019) Super-resolution integrated building semantic segmentation for multi-source remote sensing imagery. IEEE Access 7:99381–99397

    Article  Google Scholar 

  17. Diakogiannis FI, Waldner F, Caccetta P et al (2020) Resunet-a: a deep learning framework for semantic segmentation of remotely sensed data. ISPRS J Photogramm Remote Sens 162:94–114

    Article  Google Scholar 

  18. Wang L, Li D, Zhu Y et al. (2020) Dual super-resolution learning for semantic segmentation. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 3774–3783

  19. Wang Z, Tang Z, Li Y et al. (2020) GSTO: Gated scale-transfer operation for multi-scale feature learning in pixel labeling. arXiv preprint: arXiv:2005.13363

  20. Sun K, Zhao Y, Jiang B et al. (2019) High-resolution representations for labeling pixels and regions. arXiv preprint: arXiv:1904.04514

  21. M Rustowicz R, Cheong R, Wang L et al. (2019) Semantic segmentation of crop type in africa: A novel dataset and analysis of deep learning methods. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 75–82

  22. Zheng Xu, Kamruzzaman MM, Shi J (2022) Method of generating face image based on text description of generating adversarial network. J Electron Imag 31(5):051411

  23. Venugopal N (2020) Automatic semantic segmentation with deeplab dilated learning network for change detection in remote sensing images. Neural Process Lett, pp 1–23

  24. Yang H, Yu B, Luo J et al (2019) Semantic segmentation of high spatial resolution images with deep neural networks. GIScience Remote Sens 56(5):749–768

    Article  Google Scholar 

  25. Broni-Bediako C, Murata Y, Mormille LH et al. (2021) Evolutionary NAS for aerial image segmentation with gene expression programming of cellular encoding. Neural Comput Appl.

Download references

Funding

This paper is funded by National Natural Science Foundation of China under Grant No. 62071136.

Author information

Authors and Affiliations

  1. College of Information and Communication Engineering, Harbin Engineering University, Harbin, 150001, Heilongjiang, China

    Yan Sun & Wenxi Zheng

Authors
  1. Yan Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wenxi Zheng
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yan Sun.

Ethics declarations

Conflict of interest

The author declares that there are no conflicts of interest regarding the publication of this article.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sun, Y., Zheng, W. HRNet- and PSPNet-based multiband semantic segmentation of remote sensing images. Neural Comput & Applic 35, 8667–8675 (2023). https://doi.org/10.1007/s00521-022-07737-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-022-07737-w

Keywords

Search

Navigation