Skip to main content

Semantic Segmentation of High Resolution Remote Sensing Images Based on Improved ResU-Net

  • Conference paper
  • First Online:

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1451))

Abstract

Image segmentation is an important basic link of remote sensing interpretation. High-resolution remote sensing images contain complex object information. The application of traditional segmentation methods is greatly restricted. In this paper, a remote sensing semantic segmentation algorithm is proposed based on ResU-Net combined with Atrous convolution. The traditional U-Net semantic segmentation network was improved as the backbone network, and the residual convolution unit was used to replace the original U-Net convolution unit to increase the depth of the network and avoid the disappearance of gradients. To detect more feature information, a multi-branch hole convolution module was added between the encoding and decoding modules to extract semantic features, and the expansion rate of the hole convolution was modified to make the network have a better effect on the small target category segmentation. Finally, the remote sensing image was classified by pixel to output the remote sensing image semantic segmentation result. The experimental results show that the accuracy and interaction ratio of the proposed algorithm in the ISPRS Vaihingen dataset are improved, which verifies its effectiveness.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Audebert, N., Le Saux, B., Lefevre, S.: Beyond RGB: very high resolution urban remote sensing with multimodal DeepNetworks. ISPRS J. Photogrammetry Remote Sens. 140, 20–32 (2017)

    Google Scholar 

  2. Ma, J., et al.: Building extraction of aerial images by a global and multi-scale encoder-decoder network. Remote Sens. 12(15), 2350 (2020)

    Article  Google Scholar 

  3. Ma, L., Liu, Y., Zhang, X., et al.: Deep learning in remote sensing applications: A meta-analysis and review. ISPRS J. Photogrammetry Remote Sens.152, 166–177(2019)

    Google Scholar 

  4. Jiang, N., Li, J.: An improved semantic segmentation method for remote sensing images based on neural network. Traitement du Signal 37(2), 271–278 (2020)

    Google Scholar 

  5. Wang, H., Wang, Y., Zhang,Q., et al.: Gated convolutional neural network for semantic segmentation in high-resolution images. Remote Sens. 9(5), 446 (2017)

    Google Scholar 

  6. Ding, L., Lorenzo, B.: Direction-aware Residual Network for Road Extraction in VHR Remote Sensing Images. CoRR abs/2005.07232 (2020)

    Google Scholar 

  7. Li, H., Qiu, K., Chen, L., et al.: SCAttNet: semantic segmentation network with spatial and channel attention mechanism for high-resolution remote sensing images. IEEE Geosci. Remote Sens. Lett. 18(5), 905–909 (2021)

    Article  Google Scholar 

  8. Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 39(4), 640–651 (2017)

    Article  Google Scholar 

  9. Badrinarayanan, V., Kendall, A., Cipolla, R.: SegNet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 39(12), 2481–2495 (2017)

    Article  Google Scholar 

  10. Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 234–241. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24574-4_28

    Chapter  Google Scholar 

  11. Alom, M, Z., Hasan, M., et al.: Recurrent Residual Convolutional Neural Network based on U-Net (R2U-Net) for MedicalImageSegmentation. CoRR abs/1802.06955 (2018).

    Google Scholar 

  12. Gu, Z., Cheng, J., Fu, H., et al.: CE-net: context encoder network for 2D medical image segmentation. IEEE Trans. Med. Imaging 38(10), 2281–2292 (2019)

    Article  Google Scholar 

  13. Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., Adam, H.: Encoder-decoder with Atrous separable convolution for semantic image segmentation. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds.) ECCV 2018. LNCS, vol. 11211, pp. 833–851. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01234-2_49

    Chapter  Google Scholar 

  14. Cheng, G., Wang, Y., Xu, S., et al.: Automatic road detection and centerline extraction via cascaded end-to-end convolutional neural network. IEEE Trans. Geosci. Remote Sens. 55(6), 3322–3337 (2017)

    Google Scholar 

  15. Chen, G., Zhang, X., Wang, Q., et al.: Symmetrical dense-shortcut deep fully convolutional networks for semantic segmentation of very-high-resolution remote sensing images. IEEE J. Sel. Topics Appl. Earth Obser. Remote Sens. 11(5), 1633–1644 (2018)

    Article  Google Scholar 

  16. Huang, H., et al.: UNet 3+: A Full-Scale Connected UNet for Medical Image Segmentation. CoRR abs/2004.08790 (2020)

    Google Scholar 

  17. He, C., Li, S., Xiong, D., et al.: Remote sensing image semantic segmentation based on edge information guidance. Remote Sens. 12(9), 1501 (2020)

    Article  Google Scholar 

  18. Shang, R., Zhang, J., Jiao, L., et al.: Multi-scale adaptive feature fusion network for semantic segmentation in remote sensing images. Remote Sens. 12(5), 872 (2020)

    Article  Google Scholar 

  19. Zhang, Z., Liu, Q., Wang, Y.: Road extraction by deep residual U-net. IEEE Geosci. Remote Sens. Lett. 15(5), 749–753 (2018)

    Article  Google Scholar 

  20. Wang, Y., Liang, B., Ding, M., et al.: Dense semantic labeling with atrous spatial pyramid pooling and decoder for high-resolution remote sensing imagery. Remote Sens. 11(1), 20 (2019)

    Article  Google Scholar 

  21. Chen,L ,C., Papandreou, G., Kokkinos, I., et al.:DeepLab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs. IEEE Trans. Pattern Anal. Mach. Intell. 40(4), 834–848 (2018)

    Google Scholar 

  22. Yang, M., et al.: DenseASPP for Semantic Segmentation in Street Scenes. CVPR, pp. 3684–3692 (2018)

    Google Scholar 

  23. Gerke, M. Use of the Stair Vision Library within the ISPRS 2D Semantic Labeling Benchmark (Vaihingen); Technical Report; University of Twente: Enschede, the Netherlands (2015)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Zhifang Wang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Chen, S., Zuo, Q., Wang, Z. (2021). Semantic Segmentation of High Resolution Remote Sensing Images Based on Improved ResU-Net. In: Zeng, J., Qin, P., Jing, W., Song, X., Lu, Z. (eds) Data Science. ICPCSEE 2021. Communications in Computer and Information Science, vol 1451. Springer, Singapore. https://doi.org/10.1007/978-981-16-5940-9_23

Download citation

  • DOI: https://doi.org/10.1007/978-981-16-5940-9_23

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-16-5939-3

  • Online ISBN: 978-981-16-5940-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics