Skip to main content
SpringerLink
Log in

Alternate guidance network for boundary-aware camouflaged object detection

  • Original Paper
  • Published:
Machine Vision and Applications Aims and scope Submit manuscript

Abstract

Camouflaged object, similar to the background, shows indistinct boundaries and low-contrast features, which brings great challenges to the detection task. Moreover, existing models still suffer from coarse object boundaries. Motivated by the complementary relationship between boundaries and camouflaged object regions, we propose an alternate guidance network named AGNet for better interaction between them. Specifically, we first propose feature selective module to select high discriminative features and simultaneously filter out noisy background features. The proposed AGNet follows a locate and refine manner, where multi-scale convolution is applied to expand receptive field for accurate initial coarse localization. Finally, a novel alternate guidance module is designed and embedded into each side-output to refine the previous localization progressively. Contributed by it, the complementary characteristic between the region and boundary features can be well captured, which is beneficial to obtain more complete detection. Experimental results on five COD datasets prove the effectiveness of our model, and it is superior to existing state-of-the-art models in object accuracy and boundary accuracy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Bi, H., Zhang, C., Wang, K., Tong, J., Zheng, F.: Rethinking camouflaged object detection: models and datasets. IEEE Trans. Circuits Syst. Video Technol 32(9), 5708–5724 (2022)

  2. Chen, J., Yuan, Z., Peng, J., Chen, L., Haozhe, H., Zhu, J., Liu, Y., Li, H.: Dasnet: dual attentive fully convolutional siamese networks for change detection of high resolution satellite images. IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens. 14, 1194–1206 (2020)

  3. Chen, L.C., Papandreou, G., Kokkinos, I., Murphy, K., Yuille, A.L.: Deeplab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs. arXiv:1606.00915 (2016)

  4. Chen, S., Yu, J., Xu, X., Chen, Z., Lu, L., Hu, X., Yang, Y.: Split-guidance network for salient object detection. Vis. Comput. 39, 1437–1451 (2023)

  5. Chen, Z., Xu, Q., Cong, R., Huang, Q.: Global context-aware progressive aggregation network for salient object detection. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, pp. 10599–10606 (2020)

  6. Chen, Z., Zhu, L., Wan, L., Wang, S., Feng, W., Heng, P.A.: A multi-task mean teacher for semi-supervised shadow detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 5611–5620 (2020)

  7. Cheng, X., Xiong, H., Fan, D.p., Zhong, Y., Harandi, M., Drummond, T., Ge, Z.: Implicit motion handling for video camouflaged object detection. arXiv preprint arXiv:2203.07363 (2022)

  8. Chu, H.K., Hsu, W.H., Mitra, N.J., Cohen-Or, D., Wong, T.T., Lee, T.Y.: Camouflage images. ACM Trans. Graph. 29(4), 51–1 (2010)

    Article  Google Scholar 

  9. Cong, R., Yang, N., Li, C., Fu, H., Zhao, Y., Huang, Q., Kwong, S.: Global-and-local collaborative learning for co-salient object detection. arXiv preprint arXiv:2204.08917 (2022)

  10. Cong, R., Zhang, Y., Fang, L., Li, J., Zhao, Y., Kwong, S.: Rrnet: Relational reasoning network with parallel multiscale attention for salient object detection in optical remote sensing images. IEEE Trans. Geosci. Remote Sens. 60, 1–11 (2022)

    Article  Google Scholar 

  11. Cuthill, I.: Camouflage. J. Zool. 308(2), 75–92 (2019)

    Article  Google Scholar 

  12. De Boer, P.T., Kroese, D.P., Mannor, S., Rubinstein, R.Y.: A tutorial on the cross-entropy method. Ann. Oper. Res. 134(1), 19–67 (2005)

    Article  MathSciNet  MATH  Google Scholar 

  13. Ding, H., Jiang, X., Liu, A.Q., Thalmann, N.M., Wang, G.: Boundary-aware feature propagation for scene segmentation. In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pp. 6819–6829 (2019)

  14. Fan, D.P., Cheng, M.M., Liu, Y., Li, T., Borji, A.: Structure-measure: A new way to evaluate foreground maps. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), pp. 4548–4557 (2017)

  15. Fan, D.P., Gong, C., Cao, Y., Ren, B., Cheng, M.M., Borji, A.: Enhanced-alignment measure for binary foreground map evaluation. arXiv preprint arXiv:1805.10421 (2018)

  16. Fan, D.P., Ji, G.P., Cheng, M.M., Shao, L.: Concealed object detection. arXiv preprint arXiv:2102.10274 (2021)

  17. Fan, D.P., Ji, G.P., Sun, G., Cheng, M.M., Shen, J., Shao, L.: Camouflaged object detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2777–2787 (2020)

  18. Fan, D.P., Ji, G.P., Zhou, T., Chen, G., Fu, H., Shen, J., Shao, L.: Pranet: parallel reverse attention network for polyp segmentation. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 263–273. Springer (2020)

  19. Fan, D.P., Zhou, T., Ji, G.P., Zhou, Y., Chen, G., Fu, H., Shen, J., Shao, L.: Inf-net: automatic covid-19 lung infection segmentation from CT images. IEEE Trans. Med. Imaging 39(8), 2626–2637 (2020)

    Article  Google Scholar 

  20. Fang, C., Tian, H., Zhang, D., Zhang, Q., Han, J., Han, J.: Densely nested top-down flows for salient object detection. Sci. China Inf. Sci. 65(8), 182103 (2022)

    Article  MathSciNet  Google Scholar 

  21. Fang, C., Tian, H., Zhang, D., Zhang, Q., Han, J., Han, J.: Densely nested top-down flows for salient object detection. Sci. China Inf. Sci. 65(8), 1–14 (2022)

    Article  MathSciNet  Google Scholar 

  22. Freixenet, J., Munoz, X., Raba, D., Martí, J., Cufí, X.: Yet another survey on image segmentation: region and boundary information integration. In: European Conference on Computer Vision, pp. 408–422. Springer (2002)

  23. Hu, J., Shen, L., Sun, G.: Squeeze-and-excitation networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 7132–7141 (2018)

  24. Kajiura, N., Liu, H., Satoh, S.: Improving camouflaged object detection with the uncertainty of pseudo-edge labels. In: ACM Multimedia Asia, pp. 1–7 (2021)

  25. Koonce, B.: Resnet 34. In: Convolutional Neural Networks with Swift for Tensorflow, pp. 51–61. Springer (2021)

  26. Le, T.N., Nguyen, T.V., Nie, Z., Tran, M.T., Sugimoto, A.: Anabranch network for camouflaged object segmentation. Comput. Vis. Image Underst. 184, 45–56 (2019)

    Article  Google Scholar 

  27. Le, T.N., Nguyen, T.V., Nie, Z., Tran, M.T., Sugimoto, A.: Anabranch network for camouflaged object segmentation. Comput. Vis. Image Underst. 184, 45–56 (2019)

    Article  Google Scholar 

  28. Li, A., Zhang, J., Lv, Y., Liu, B., Zhang, T., Dai, Y.: Uncertainty-aware joint salient object and camouflaged object detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 10071–10081 (2021)

  29. Li, L., Rigall, E., Dong, J., Chen, G.: Mas3k: an open dataset for marine animal segmentation. In: International Symposium on Benchmarking, Measuring and Optimization, pp. 194–212. Springer (2020)

  30. Lin, J., Wang, G., Lau, R.W.: Progressive mirror detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3697–3705 (2020)

  31. Liu, G., Fan, D.: A model of visual attention for natural image retrieval. In: 2013 International Conference on Information Science and Cloud Computing Companion, pp. 728–733. IEEE (2013)

  32. Liu, N., Han, J.: Dhsnet: deep hierarchical saliency network for salient object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 678–686 (2016)

  33. Liu, N., Han, J., Yang, M.H.: Picanet: learning pixel-wise contextual attention for saliency detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3089–3098 (2018)

  34. Liu, N., Zhang, N., Wan, K., Shao, L., Han, J.: Visual saliency transformer. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 4722–4732 (2021)

  35. Liu, Y., Han, J., Zhang, Q., Shan, C.: Deep salient object detection with contextual information guidance. IEEE Trans. Image Process. 29, 360–374 (2019)

    Article  MathSciNet  MATH  Google Scholar 

  36. Liu, Y., Zhang, D., Zhang, Q., Han, J.: Integrating part-object relationship and contrast for camouflaged object detection. IEEE Trans. Inf. Forens. Secur. 16, 5154–5166 (2021)

    Article  Google Scholar 

  37. Liu, Y., Zhang, D., Zhang, Q., Han, J.: Part-object relational visual saliency. IEEE Trans. Pattern Anal. Mach. Intell. 44(7), 3688–3704 (2022)

    Google Scholar 

  38. Luo, Z., Mishra, A., Achkar, A., Eichel, J., Li, S., Jodoin, P.M.: Non-local deep features for salient object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 6609–6617 (2017)

  39. Lv, Y., Zhang, J., Dai, Y., Li, A., Liu, B., Barnes, N., Fan, D.P.: Simultaneously localize, segment and rank the camouflaged objects. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 11591–11601 (2021)

  40. Lv, Y., Zhang, J., Dai, Y., Li, A., Liu, B., Barnes, N., Fan, D.P.: Simultaneously localize, segment and rank the camouflaged objects. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 11591–11601 (2021)

  41. Ma, M., Xia, C., Li, J.: Pyramidal feature shrinking for salient object detection. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, pp. 2311–2318 (2021)

  42. Margolin, R., Zelnik-Manor, L., Tal, A.: How to evaluate foreground maps? In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 248–255 (2014)

  43. Mei, H., Ji, G.P., Wei, Z., Yang, X., Wei, X., Fan, D.P.: Camouflaged object segmentation with distraction mining. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 8772–8781 (2021)

  44. Mei, H., Ji, G.P., Wei, Z., Yang, X., Wei, X., Fan, D.P.: Camouflaged object segmentation with distraction mining. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 8772–8781 (2021)

  45. Niu, Y., Geng, Y., Li, X., Liu, F.: Leveraging stereopsis for saliency analysis. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition, pp. 454–461 (2012)

  46. Pang, Y., Zhao, X., Xiang, T.Z., Zhang, L., Lu, H.: Zoom in and out: a mixed-scale triplet network for camouflaged object detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 2160–2170 (2022)

  47. Qin, X., Zhang, Z., Huang, C., Gao, C., Dehghan, M., Jagersand, M.: Basnet: Boundary-aware salient object detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 7479–7489 (2019)

  48. Skurowski, P., Abdulameer, H., Błaszczyk, J., Depta, T., Kornacki, A., Kozieł, P.: Animal camouflage analysis: Chameleon database. Unpubl. Manuscr. 2(6), 7 (2018)

  49. Stevens, M., Merilaita, S.: Animal camouflage: current issues and new perspectives. Philos. Trans. R. Soc. B: Biol. Sci. 364(1516), 423–427 (2009)

    Article  Google Scholar 

  50. Sun, Y., Chen, G., Zhou, T., Zhang, Y., Liu, N.: Context-aware cross-level fusion network for camouflaged object detection. arXiv preprint arXiv:2105.12555 (2021)

  51. Wang, F., Jiang, M., Qian, C., Yang, S., Li, C., Zhang, H., Wang, X., Tang, X.: Residual attention network for image classification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3156–3164 (2017)

  52. Wang, J., Chen, S., Lv, X., Xu, X., Hu, X.: Guided residual network for RGB-D salient object detection with efficient depth feature learning. Vis. Comput. 38, 1803–1814 (2022)

  53. Wang, X., Girshick, R., Gupta, A., He, K.: Non-local neural networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 7794–7803 (2018)

  54. Wei, J., Wang, S., Huang, Q.: F\(^3\)net: Fusion, feedback and focus for salient object detection. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, pp. 12321–12328 (2020)

  55. Woo, S., Park, J., Lee, J.Y., Kweon, I.S.: Cbam: convolutional block attention module. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 3–19 (2018)

  56. Wu, Y.H., Gao, S.H., Mei, J., Xu, J., Fan, D.P., Zhang, R.G., Cheng, M.M.: Jcs: an explainable covid-19 diagnosis system by joint classification and segmentation. IEEE Trans. Image Process. 30, 3113–3126 (2021)

    Article  Google Scholar 

  57. Wu, Z., Su, L., Huang, Q.: Cascaded partial decoder for fast and accurate salient object detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3907–3916 (2019)

  58. Wu, Z., Su, L., Huang, Q.: Stacked cross refinement network for edge-aware salient object detection. In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pp. 7264–7273 (2019)

  59. Xu, X., Zhu, M., Yu, J., Chen, S., Hu, X., Yang, Y.: Boundary guidance network for camouflage object detection. Image Vis. Comput. 114, 104283 (2021)

    Article  Google Scholar 

  60. Yan, J., Le, T.N., Nguyen, K.D., Tran, M.T., Do, T.T., Nguyen, T.V.: Mirrornet: bio-inspired camouflaged object segmentation. IEEE Access 9, 43290–43300 (2021)

    Article  Google Scholar 

  61. Yang, F., Zhai, Q., Li, X., Huang, R., Luo, A., Cheng, H., Fan, D.P.: Uncertainty-guided transformer reasoning for camouflaged object detection. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 4146–4155 (2021)

  62. Yuan, Y., Xie, J., Chen, X., Wang, J.: Segfix: Model-agnostic boundary refinement for segmentation. In: European Conference on Computer Vision (ECCV), pp. 489–506. Springer (2020)

  63. Zeng, Y., Zhang, P., Zhang, J., Lin, Z., Lu, H.: Towards high-resolution salient object detection. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 7234–7243 (2019)

  64. Zhai, Q., Li, X., Yang, F., Chen, C., Cheng, H., Fan, D.P.: Mutual graph learning for camouflaged object detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 12997–13007 (2021)

  65. Zhang, D., Han, J., Zhang, Y., Xu, D.: Synthesizing supervision for learning deep saliency network without human annotation. IEEE Trans. Pattern Anal. Mach. Intell. 42(7), 1755–1769 (2019)

    Article  Google Scholar 

  66. Zhang, D., Tian, H., Han, J.: Few-cost salient object detection with adversarial-paced learning. Adv. Neural. Inf. Process. Syst. 33, 12236–12247 (2020)

    Google Scholar 

  67. Zhang, J., Yu, X., Li, A., Song, P., Liu, B., Dai, Y.: Weakly-supervised salient object detection via scribble annotations. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 12546–12555 (2020)

  68. Zhang, J., Yu, X., Li, A., Song, P., Liu, B., Dai, Y.: Weakly-supervised salient object detection via scribble annotations. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 12546–12555 (2020)

  69. Zhao, J.X., Liu, J.J., Fan, D.P., Cao, Y., Yang, J., Cheng, M.M.: Egnet: Edge guidance network for salient object detection. In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pp. 8779–8788 (2019)

  70. Zhao, Z., Xia, C., Xie, C., Li, J.: Complementary trilateral decoder for fast and accurate salient object detection. In: Proceedings of the 29th ACM International Conference on Multimedia, pp. 4967–4975 (2021)

  71. Zhong, Y., Li, B., Tang, L., Kuang, S., Wu, S., Ding, S.: Detecting camouflaged object in frequency domain. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 4504–4513 (2022)

  72. Zhou, H., Xie, X., Lai, J.H., Chen, Z., Yang, L.: Interactive two-stream decoder for accurate and fast saliency detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 9141–9150 (2020)

  73. Zhou, P., Price, B., Cohen, S., Wilensky, G., Davis, L.S.: Deepstrip: High-resolution boundary refinement. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 10558–10567 (2020)

  74. Zhou, X., Shen, K., Weng, L., Cong, R., Zheng, B., Zhang, J., Yan, C.: Edge-guided recurrent positioning network for salient object detection in optical remote sensing images. IEEE Trans. Cybern. (2022)

  75. Zhu, J., Zhang, X., Zhang, S., Liu, J.: Inferring camouflaged objects by texture-aware interactive guidance network. In: Proceedings of the AAAI conference on artificial intelligence, vol. 35, pp. 3599–3607 (2021)

  76. Zhuge, M., Fan, D.P., Liu, N., Zhang, D., Xu, D., Shao, L.: Salient object detection via integrity learning. IEEE Trans. Pattern Anal. Mach. Intell. 45(3), 3738–3752 (2023)

Download references

Acknowledgements

This work was partially supported by the Natural Science Foundation of China (No. 61802336) and Yangzhou University “Qinglan Project.”

Author information

Authors and Affiliations

  1. School of Information Engineering, Yangzhou University, Yangzhou, China

    Jinhao Yu, Shuhan Chen, Lu Lu, Zeyu Chen, Xiuqi Xu, Xuelong Hu & Jinrong Zhu

Authors
  1. Jinhao Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shuhan Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Lu Lu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zeyu Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Xiuqi Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Xuelong Hu
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Jinrong Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Shuhan Chen.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yu, J., Chen, S., Lu, L. et al. Alternate guidance network for boundary-aware camouflaged object detection. Machine Vision and Applications 34, 69 (2023). https://doi.org/10.1007/s00138-023-01424-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s00138-023-01424-z

Keywords

Search

Navigation