Skip to main content

Advertisement

A self-correction algorithm for transparent object shadow detection

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Shadow detection for transparent objects is a challenging task. The difficulty arises from the fact that transparent objects and shadow regions are prone to occlusion, and the boundaries of transparent objects become more blurred due to optical effects, ultimately leading to incomplete shadow detection results. In this paper, a novel semisupervised shadow detection algorithm based on self-correction is proposed to address these problems. We construct a shadow detection module based on a hybrid attention mechanism CBAM and integrate the short-term memory capability of LSTM networks, assisting the model in accurately localizing shadow areas based on prior experience. To address the issue of easily overlooked shadow areas, we aim to minimize the difference between the predicted shadow mask and the real shadow mask as our optimization objective. We train the shadow self-correction module using binary cross-entropy loss to enhance the model’s ability to detect shadow areas that are prone to be overlooked. Furthermore, a pretrained boundary detector is utilized to obtain the boundary information between the predicted and real shadow masks. The shadow detection model is then optimized under the constraint of boundary consistency, enabling the model to more accurately identify the boundaries of shadow regions and enhancing the shadow detection performance. The experimental results indicate that, compared to existing shadow detection algorithms, the proposed algorithm performs well in terms of both transparent and nontransparent object shadow detection.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Availability of data and materials

The authors confirm that the data supporting the findings of this study are available within the article.

References

  1. Kang S, Kim J, Jang IS, Lee BD (2023) C2shadowgan: cycle-in-cycle generative adversarial network for shadow removal using unpaired data. Appl Intell 53:15067–15079

    Article  Google Scholar 

  2. Xu Z, Chen X (2023) A two-stage progressive shadow removal network. Appl Intell 53(21):25296–25309

    Article  Google Scholar 

  3. Luo S, Zhang J, Xiao N, Qiang Y, Li K, Zhao J, Meng L, Song P (2022) Das-net: A lung nodule segmentation method based on adaptive dual-branch attention and shadow mapping. Appl Intell 52:15617–15631

  4. Nadimi S, Bhanu B (2004) Physical models for moving shadow and object detection in video. IEEE Trans Pattern Anal Mach Intell 26(8):1079–1087

    Article  MATH  Google Scholar 

  5. Wang H, Suter D (2007) A consensus-based method for tracking: Modelling background scenario and foreground appearance. Pattern Recognit 40(3):1091–1105

    Article  MATH  Google Scholar 

  6. Leone A, Distante C (2007) Shadow detection for moving objects based on texture analysis. Pattern Recognit 40(4):1222–1233

    Article  MATH  Google Scholar 

  7. Panagopoulos A, Wang C, Samaras D, Paragios N (2011) Illumination estimation and cast shadow detection through a higher-order graphical model. In: IEEE conference on computer vision and pattern recognition, pp 673–680. IEEE

  8. Guo R, Dai Q, Hoiem D (2012) Paired regions for shadow detection and removal. IEEE Trans Pattern Anal Mach Intell 35(12):2956–2967

    Article  MATH  Google Scholar 

  9. Vicente TFY, Hoai M, Samaras D (2017) Leave-one-out kernel optimization for shadow detection and removal. IEEE Trans Pattern Anal Mach Intell 40(3):682–695

    Article  MATH  Google Scholar 

  10. Wang Y, Tan T, Loe K-F, Wu J-K (2005) A probabilistic approach for foreground and shadow segmentation in monocular image sequences. Pattern Recognit 38(11):1937–1946

    Article  MATH  Google Scholar 

  11. Zhu L, Deng Z, Hu X, Fu C-W, Xu X, Qin J, Heng P-A (2018) Bidirectional feature pyramid network with recurrent attention residual modules for shadow detection. In: Proceedings of the european conference on computer vision (ECCV) 2018, pp 121–136

  12. Le H, Vicente TFY, Nguyen V, Hoai M, Samaras D (2018) A+d net: Training a shadow detector with adversarial shadow attenuation. In: Proceedings of the european conference on computer vision (ECCV) 2018, pp 662–678

  13. Tian J, Qi X, Qu L, Tang Y (2016) New spectrum ratio properties and features for shadow detection. Pattern Recognit 51:85–96

    Article  MATH  Google Scholar 

  14. Mohajerani S, Saeedi P (2019) Shadow detection in single rgb images using a context preserver convolutional neural network trained by multiple adversarial examples. IEEE Trans Image Process 28(8):4117–4129

    Article  MATH  Google Scholar 

  15. Gomes V, Barcellos P, Scharcanski J (2017) Stochastic shadow detection using a hypergraph partitioning approach. Pattern Recognit 63:30–44

    Article  MATH  Google Scholar 

  16. Tian J, Sun J, Tang Y (2009) Tricolor attenuation model for shadow detection. IEEE Trans Image Process 18(10):2355–2363

    Article  MathSciNet  MATH  Google Scholar 

  17. Huang X, Hua G, Tumblin J, Williams L (2011) What characterizes a shadow boundary under the sun and sky? In: IEEE international conference on computer vision pp 898–905. IEEE

  18. Lalonde J-F, Efros AA, Narasimhan SG (2010) Detecting ground shadows in outdoor consumer photographs. In: European conference on computer vision, pp 322–335. Springer

  19. Guo R, Dai Q, Hoiem D (2011) Single-image shadow detection and removal using paired regions. In: IEEE conference on computer vision and pattern recognition, pp 2033–2040. IEEE

  20. Hu X, Fu C-W, Zhu L, Qin J, Heng P-A (2019) Direction-aware spatial context features for shadow detection and removal. IEEE Trans Pattern Anal Mach Intell 42(11):2795–2808

    Article  MATH  Google Scholar 

  21. Wang J, Li X, Yang J (2018) Stacked conditional generative adversarial networks for jointly learning shadow detection and shadow removal. In: Proceedings of the IEEE conference on computer vision and pattern recognition 2018, pp 1788–1797

  22. Jin Y, Sharma A, Tan RT (2021) Dc-shadownet: Single-image hard and soft shadow removal using unsupervised domain-classifier guided network. In: Proceedings of the IEEE/CVF international conference on computer vision 2021, pp 5027–5036

  23. Obeso AM, Benois-Pineau J, Vázquez MSG, Acosta AÁR (2022) Visual vs internal attention mechanisms in deep neural networks for image classification and object detection. Pattern Recognit 123:108411

    Article  MATH  Google Scholar 

  24. Du W, Wang Y, Qiao Y (2017) Recurrent spatial-temporal attention network for action recognition in videos. IEEE Trans Image Process 27(3):1347–1360

    Article  MathSciNet  MATH  Google Scholar 

  25. Liu J, Wang G, Duan L-Y, Abdiyeva K, Kot AC (2017) Skeleton-based human action recognition with global context-aware attention lstm networks. IEEE Trans Image Process 27(4):1586–1599

    Article  MathSciNet  MATH  Google Scholar 

  26. Guo M-H, Xu T-X, Liu J-J, Liu Z-N, Jiang P-T, Mu T-J, Zhang S-H, Martin RR, Cheng M-M, Hu S-M (2022) Attention mechanisms in computer vision: A survey. Comput Vis Med 1–38

  27. Hu J, Shen L, Sun G (2018) Squeeze-and-excitation networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition 2018, pp 7132–7141

  28. Fu J, Liu J, Tian H, Li Y, Bao Y, Fang Z, Lu H (2019) Dual attention network for scene segmentation. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 3146–3154

  29. Li X, Wang W, Hu X, Yang J (2019) Selective kernel networks. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition 2019, pp 510–519

  30. Tarvainen A, Valpola H (2017) Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results. Proc Adv Neural Inf Process Syst 30

  31. Xie Q, Dai Z, Hovy E, Luong T, Le Q (2020) Unsupervised data augmentation for consistency training. Proc Adv Neural Inf Process Syst 33:6256–6268

    MATH  Google Scholar 

  32. Lee D-H, et al (2013) Pseudo-label: The simple and efficient semi-supervised learning method for deep neural networks. In: Workshop on challenges in representation learning, ICML, vol 3, pp 896

  33. Miyato T, Maeda S-I, Koyama M, Ishii S (2018) Virtual adversarial training: a regularization method for supervised and semi-supervised learning. IEEE Trans Pattern Anal Mach Intell 41(8):1979–1993

    Article  Google Scholar 

  34. Berthelot D, Carlini N, Goodfellow I, Papernot N, Oliver A, Raffel CA (2019) Mixmatch: A holistic approach to semi-supervised learning. Proc Adv Neural Inf Process Syst 32

  35. Chen Z, Zhu L, Wan L, Wang S, Feng W, Heng P-A (2020) A multi-task mean teacher for semi-supervised shadow detection. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition 2020, pp 5611–5620

  36. Wu W, Chen X-D, Yang W, Yong J-H (2023) Exploring better target for shadow detection. Knowl-Based Syst 273:110614

    Article  MATH  Google Scholar 

  37. Lu D, Yan Z, Xu C, Li J, Zhang R, Wen S (2021) Tsd: A new dataset for shadow detection of transparent objects. In: 2021 WRC symposium on advanced robotics and automation (WRC SARA), pp 86–91. IEEE

  38. Woo S. Park J, Lee J-Y, Kweon IS (2018) Cbam: Convolutional block attention module. In: Proceedings of the European conference on computer vision (ECCV) 2018, pp. 3–19

  39. Shi X, Chen Z, Wang H, Yeung D-Y, Wong W-K, Woo W-c (2015) Convolutional lstm network: A machine learning approach for precipitation nowcasting. Adv Neural Inf Process Syst 28

  40. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition 2016, pp 770–778

  41. Chen X-D, Wu W, Yang W, Qin H, Wu X, Mao X (2023) Make segment anything model perfect on shadow detection. IEEE Trans Geosci Remote Sens 61:1–13

    MATH  Google Scholar 

  42. Zheng Q, Qiao X, Cao Y, Lau RW (2019) Distraction-aware shadow detection. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition 2019, pp 5167–5176

  43. Hu X, Wang T, Fu C-W, Jiang Y, Wang Q, Heng P-A (2021) Revisiting shadow detection: A new benchmark dataset for complex world. IEEE Trans Image Process 30:1925–1934

    Article  MATH  Google Scholar 

  44. Zhou K, Wu W, Shao Y-L, Fang J-L, Wang X-Q, Wei D (2022) Shadow detection via multi-scale feature fusion and unsupervised domain adaptation. J Vis Commun Image Represent 88:103596

    Article  Google Scholar 

  45. Valanarasu JMJ, Patel VM (2023) Fine-context shadow detection using shadow removal. In: 2023 IEEE/CVF winter conference on applications of computer vision (WACV), pp 1705–1714

Download references

Acknowledgements

The work was partly supported by the National Natural Science Foundation of China (62273296) and the Hebei innovation capability improvement plan project (22567619H).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Shuhuan Wen.

Ethics declarations

Competing interests

All authors disclosed no relevant relationships.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Li, J., Wen, S., Chen, R. et al. A self-correction algorithm for transparent object shadow detection. Appl Intell 55, 275 (2025). https://doi.org/10.1007/s10489-024-06001-z

Download citation

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10489-024-06001-z

Keywords