Skip to main content

X-shape Feature Expansion Network for Salient Object Detection in Optical Remote Sensing Images

  • Conference paper
  • First Online:
Artificial Neural Networks and Machine Learning – ICANN 2023 (ICANN 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14260))

Included in the following conference series:

Abstract

Salient object detection in optical remote sensing images (RSI-SOD) is a valuable and challenging task. Some factors in RSI, such as the extreme complexity of scale and topological structure as well as the uncertainty of location of the salient object, significantly reduce the accuracy and completeness of salient object prediction. To address these issues, we propose a novel X-shape Feature Expansion Network (XFNet). Specifically, XFNet consists of a traditional encoder-decoder network, complemented by a new component called the X-shape Feature Expansion Module (XFEM). In XFEM, from the perspective of receptive field and multi-scale information, we utilize two branches to enhance the model’s receptive field and multi-scale information. Moreover, we design a core component in XFEM to facilitate the fusion of feature of each branch. Extensive experiments conducted on two commonly used datasets demonstrate that our approach outperforms 11 state-of-the-art methods, including NSI-SOD and RSI-SOD methods.

Supported by National Natural Science Foundation of China (61872164), Program of Science and Technology Development Plan of Jilin Province of China (20220201147GX) and Fundamental Research Funds for the Central Universities (2022-JCXK-02).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Li, G., Liu, Z., Shi, R., Wei, W.: Constrained fixation point based segmentation via deep neural network. Neurocomputing 368, 180–187 (2019)

    Article  Google Scholar 

  2. Ke, G., et al.: Saliency-guided quality assessment of screen content images. IEEE Trans. Multimedia 18(6), 1098–1110 (2016)

    Article  Google Scholar 

  3. Feng, W., Sui, H., Jihui, T., Huang, W., Sun, K.: A novel change detection approach based on visual saliency and random forest from multi-temporal high-resolution remote-sensing images. Int. J. Remote Sens. 39(22), 7998–8021 (2018)

    Article  Google Scholar 

  4. Dong, C., Liu, J., Fang, X.: Ship detection in optical remote sensing images based on saliency and a rotation-invariant descriptor. Remote Sens. 10(3), 400 (2018)

    Article  Google Scholar 

  5. Liu, Z., Zhao, D., Shi, Z., Jiang, Z.: Unsupervised saliency model with color Markov chain for oil tank detection. Remote Sens. 11(9), 1089 (2019)

    Article  Google Scholar 

  6. Pang, Y., Zhao, X., Zhang, L., Lu, H.: Multi-scale interactive network for salient object detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 9413–9422 (2020)

    Google Scholar 

  7. Zhao, J.-X., Liu, J.-J., Fan, D.-P., Cao, Y., Yang, J., Cheng, M.-M.: Egnet: edge guidance network for salient object detection. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 8779–8788 (2019)

    Google Scholar 

  8. Qin, X., Zhang, Z., Huang, C., Gao, C., Dehghan, M., Jagersand, M.: Basnet: boundary-aware salient object detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 7479–7489 (2019)

    Google Scholar 

  9. Li, C., Cong, R., Hou, J., Zhang, S., Qian, Y., Kwong, S.: Nested network with two-stream pyramid for salient object detection in optical remote sensing images. IEEE Trans. Geosci. Remote Sens. 57(11), 9156–9166 (2019)

    Article  Google Scholar 

  10. Li, C., et al.: A parallel down-up fusion network for salient object detection in optical remote sensing images. Neurocomputing 415, 411–420 (2020)

    Article  Google Scholar 

  11. Zhang, Q., et al.: Dense attention fluid network for salient object detection in optical remote sensing images. IEEE Trans. Image Process. 30, 1305–1317 (2020)

    Article  Google Scholar 

  12. Li, G., Liu, Z., Lin, W., Ling, H.: Multi-content complementation network for salient object detection in optical remote sensing images. IEEE Trans. Geosci. Remote Sens. 60, 1–13 (2021)

    Google Scholar 

  13. Jiang, H., Wang, J., Yuan, Z., Liu, T., Zheng, N., Li, S.: Automatic salient object segmentation based on context and shape prior. In: BMVC, vol. 6, p. 9 (2011)

    Google Scholar 

  14. Liu, Z., Zou, W., Le Meur, O.: Saliency tree: a novel saliency detection framework. IEEE Trans. Image Process. 23(5), 1937–1952 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  15. Zhang, P., Wang, D., Lu, H., Wang, H., Ruan, X.: Amulet: aggregating multi-level convolutional features for salient object detection. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 202–211 (2017)

    Google Scholar 

  16. Zhou, X., Shen, K., Liu, Z., Gong, C., Zhang, J., Yan, C.C.: Edge-aware multiscale feature integration network for salient object detection in optical remote sensing images. IEEE Trans. Geosci. Remote Sens. 60, 1–15 (2021)

    Google Scholar 

  17. Fan, D.-P., Cheng, M.-M., Liu, Y., Li, T., Borji, A.: Structure-measure: a new way to evaluate foreground maps. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 4548–4557 (2017)

    Google Scholar 

  18. Achanta, R., Hemami, S., Estrada, F., Susstrunk, S.: Frequency-tuned salient region detection. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1597–1604. IEEE (2009)

    Google Scholar 

  19. Fan, D.-P., Gong, C., Cao, Y., Ren, B., Cheng, M.-M., Borji, A.: Enhanced-alignment measure for binary foreground map evaluation. arXiv preprint arXiv:1805.10421 (2018)

  20. Deng, Z., et al.: R3net: recurrent residual refinement network for saliency detection. In: Proceedings of the 27th International Joint Conference on Artificial Intelligence, pp. 684–690. AAAI Press Menlo Park, CA, USA (2018)

    Google Scholar 

  21. Qin, X., Zhang, Z., Huang, C., Dehghan, M., Zaiane, O.R., Jagersand, M.: U2-net: going deeper with nested u-structure for salient object detection. Pattern Recogn. 106, 107404 (2020)

    Google Scholar 

  22. Li, J., Pan, Z., Liu, Q., Wang, Z.: Stacked u-shape network with channel-wise attention for salient object detection. IEEE Trans. Multimedia 23, 1397–1409 (2020)

    Article  Google Scholar 

  23. Binwei, X., Liang, H., Liang, R., Chen, P.: Locate globally, segment locally: a progressive architecture with knowledge review network for salient object detection. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, pp. 3004–3012 (2021)

    Google Scholar 

  24. Lin, Y., Sun, H., Liu, N., Bian, Y., Cen, J., Zhou, H.: Attention guided network for salient object detection in optical remote sensing images. In: Pimenidis, E., Angelov, P., Jayne, C., Papaleonidas, A., Aydin, M. (eds.) ICANN 2022. LNCS, vol. 13529, pp. 25–36. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-15919-0_3

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Minghui Sun .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Huang, L., Sun, M., Liang, Y., Qin, G. (2023). X-shape Feature Expansion Network for Salient Object Detection in Optical Remote Sensing Images. In: Iliadis, L., Papaleonidas, A., Angelov, P., Jayne, C. (eds) Artificial Neural Networks and Machine Learning – ICANN 2023. ICANN 2023. Lecture Notes in Computer Science, vol 14260. Springer, Cham. https://doi.org/10.1007/978-3-031-44195-0_21

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-44195-0_21

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-44194-3

  • Online ISBN: 978-3-031-44195-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics