Abstract
Shadow detection for transparent objects is a challenging task. The difficulty arises from the fact that transparent objects and shadow regions are prone to occlusion, and the boundaries of transparent objects become more blurred due to optical effects, ultimately leading to incomplete shadow detection results. In this paper, a novel semisupervised shadow detection algorithm based on self-correction is proposed to address these problems. We construct a shadow detection module based on a hybrid attention mechanism CBAM and integrate the short-term memory capability of LSTM networks, assisting the model in accurately localizing shadow areas based on prior experience. To address the issue of easily overlooked shadow areas, we aim to minimize the difference between the predicted shadow mask and the real shadow mask as our optimization objective. We train the shadow self-correction module using binary cross-entropy loss to enhance the model’s ability to detect shadow areas that are prone to be overlooked. Furthermore, a pretrained boundary detector is utilized to obtain the boundary information between the predicted and real shadow masks. The shadow detection model is then optimized under the constraint of boundary consistency, enabling the model to more accurately identify the boundaries of shadow regions and enhancing the shadow detection performance. The experimental results indicate that, compared to existing shadow detection algorithms, the proposed algorithm performs well in terms of both transparent and nontransparent object shadow detection.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Availability of data and materials
The authors confirm that the data supporting the findings of this study are available within the article.
References
Kang S, Kim J, Jang IS, Lee BD (2023) C2shadowgan: cycle-in-cycle generative adversarial network for shadow removal using unpaired data. Appl Intell 53:15067–15079
Xu Z, Chen X (2023) A two-stage progressive shadow removal network. Appl Intell 53(21):25296–25309
Luo S, Zhang J, Xiao N, Qiang Y, Li K, Zhao J, Meng L, Song P (2022) Das-net: A lung nodule segmentation method based on adaptive dual-branch attention and shadow mapping. Appl Intell 52:15617–15631
Nadimi S, Bhanu B (2004) Physical models for moving shadow and object detection in video. IEEE Trans Pattern Anal Mach Intell 26(8):1079–1087
Wang H, Suter D (2007) A consensus-based method for tracking: Modelling background scenario and foreground appearance. Pattern Recognit 40(3):1091–1105
Leone A, Distante C (2007) Shadow detection for moving objects based on texture analysis. Pattern Recognit 40(4):1222–1233
Panagopoulos A, Wang C, Samaras D, Paragios N (2011) Illumination estimation and cast shadow detection through a higher-order graphical model. In: IEEE conference on computer vision and pattern recognition, pp 673–680. IEEE
Guo R, Dai Q, Hoiem D (2012) Paired regions for shadow detection and removal. IEEE Trans Pattern Anal Mach Intell 35(12):2956–2967
Vicente TFY, Hoai M, Samaras D (2017) Leave-one-out kernel optimization for shadow detection and removal. IEEE Trans Pattern Anal Mach Intell 40(3):682–695
Wang Y, Tan T, Loe K-F, Wu J-K (2005) A probabilistic approach for foreground and shadow segmentation in monocular image sequences. Pattern Recognit 38(11):1937–1946
Zhu L, Deng Z, Hu X, Fu C-W, Xu X, Qin J, Heng P-A (2018) Bidirectional feature pyramid network with recurrent attention residual modules for shadow detection. In: Proceedings of the european conference on computer vision (ECCV) 2018, pp 121–136
Le H, Vicente TFY, Nguyen V, Hoai M, Samaras D (2018) A+d net: Training a shadow detector with adversarial shadow attenuation. In: Proceedings of the european conference on computer vision (ECCV) 2018, pp 662–678
Tian J, Qi X, Qu L, Tang Y (2016) New spectrum ratio properties and features for shadow detection. Pattern Recognit 51:85–96
Mohajerani S, Saeedi P (2019) Shadow detection in single rgb images using a context preserver convolutional neural network trained by multiple adversarial examples. IEEE Trans Image Process 28(8):4117–4129
Gomes V, Barcellos P, Scharcanski J (2017) Stochastic shadow detection using a hypergraph partitioning approach. Pattern Recognit 63:30–44
Tian J, Sun J, Tang Y (2009) Tricolor attenuation model for shadow detection. IEEE Trans Image Process 18(10):2355–2363
Huang X, Hua G, Tumblin J, Williams L (2011) What characterizes a shadow boundary under the sun and sky? In: IEEE international conference on computer vision pp 898–905. IEEE
Lalonde J-F, Efros AA, Narasimhan SG (2010) Detecting ground shadows in outdoor consumer photographs. In: European conference on computer vision, pp 322–335. Springer
Guo R, Dai Q, Hoiem D (2011) Single-image shadow detection and removal using paired regions. In: IEEE conference on computer vision and pattern recognition, pp 2033–2040. IEEE
Hu X, Fu C-W, Zhu L, Qin J, Heng P-A (2019) Direction-aware spatial context features for shadow detection and removal. IEEE Trans Pattern Anal Mach Intell 42(11):2795–2808
Wang J, Li X, Yang J (2018) Stacked conditional generative adversarial networks for jointly learning shadow detection and shadow removal. In: Proceedings of the IEEE conference on computer vision and pattern recognition 2018, pp 1788–1797
Jin Y, Sharma A, Tan RT (2021) Dc-shadownet: Single-image hard and soft shadow removal using unsupervised domain-classifier guided network. In: Proceedings of the IEEE/CVF international conference on computer vision 2021, pp 5027–5036
Obeso AM, Benois-Pineau J, Vázquez MSG, Acosta AÁR (2022) Visual vs internal attention mechanisms in deep neural networks for image classification and object detection. Pattern Recognit 123:108411
Du W, Wang Y, Qiao Y (2017) Recurrent spatial-temporal attention network for action recognition in videos. IEEE Trans Image Process 27(3):1347–1360
Liu J, Wang G, Duan L-Y, Abdiyeva K, Kot AC (2017) Skeleton-based human action recognition with global context-aware attention lstm networks. IEEE Trans Image Process 27(4):1586–1599
Guo M-H, Xu T-X, Liu J-J, Liu Z-N, Jiang P-T, Mu T-J, Zhang S-H, Martin RR, Cheng M-M, Hu S-M (2022) Attention mechanisms in computer vision: A survey. Comput Vis Med 1–38
Hu J, Shen L, Sun G (2018) Squeeze-and-excitation networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition 2018, pp 7132–7141
Fu J, Liu J, Tian H, Li Y, Bao Y, Fang Z, Lu H (2019) Dual attention network for scene segmentation. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 3146–3154
Li X, Wang W, Hu X, Yang J (2019) Selective kernel networks. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition 2019, pp 510–519
Tarvainen A, Valpola H (2017) Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results. Proc Adv Neural Inf Process Syst 30
Xie Q, Dai Z, Hovy E, Luong T, Le Q (2020) Unsupervised data augmentation for consistency training. Proc Adv Neural Inf Process Syst 33:6256–6268
Lee D-H, et al (2013) Pseudo-label: The simple and efficient semi-supervised learning method for deep neural networks. In: Workshop on challenges in representation learning, ICML, vol 3, pp 896
Miyato T, Maeda S-I, Koyama M, Ishii S (2018) Virtual adversarial training: a regularization method for supervised and semi-supervised learning. IEEE Trans Pattern Anal Mach Intell 41(8):1979–1993
Berthelot D, Carlini N, Goodfellow I, Papernot N, Oliver A, Raffel CA (2019) Mixmatch: A holistic approach to semi-supervised learning. Proc Adv Neural Inf Process Syst 32
Chen Z, Zhu L, Wan L, Wang S, Feng W, Heng P-A (2020) A multi-task mean teacher for semi-supervised shadow detection. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition 2020, pp 5611–5620
Wu W, Chen X-D, Yang W, Yong J-H (2023) Exploring better target for shadow detection. Knowl-Based Syst 273:110614
Lu D, Yan Z, Xu C, Li J, Zhang R, Wen S (2021) Tsd: A new dataset for shadow detection of transparent objects. In: 2021 WRC symposium on advanced robotics and automation (WRC SARA), pp 86–91. IEEE
Woo S. Park J, Lee J-Y, Kweon IS (2018) Cbam: Convolutional block attention module. In: Proceedings of the European conference on computer vision (ECCV) 2018, pp. 3–19
Shi X, Chen Z, Wang H, Yeung D-Y, Wong W-K, Woo W-c (2015) Convolutional lstm network: A machine learning approach for precipitation nowcasting. Adv Neural Inf Process Syst 28
He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition 2016, pp 770–778
Chen X-D, Wu W, Yang W, Qin H, Wu X, Mao X (2023) Make segment anything model perfect on shadow detection. IEEE Trans Geosci Remote Sens 61:1–13
Zheng Q, Qiao X, Cao Y, Lau RW (2019) Distraction-aware shadow detection. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition 2019, pp 5167–5176
Hu X, Wang T, Fu C-W, Jiang Y, Wang Q, Heng P-A (2021) Revisiting shadow detection: A new benchmark dataset for complex world. IEEE Trans Image Process 30:1925–1934
Zhou K, Wu W, Shao Y-L, Fang J-L, Wang X-Q, Wei D (2022) Shadow detection via multi-scale feature fusion and unsupervised domain adaptation. J Vis Commun Image Represent 88:103596
Valanarasu JMJ, Patel VM (2023) Fine-context shadow detection using shadow removal. In: 2023 IEEE/CVF winter conference on applications of computer vision (WACV), pp 1705–1714
Acknowledgements
The work was partly supported by the National Natural Science Foundation of China (62273296) and the Hebei innovation capability improvement plan project (22567619H).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Competing interests
All authors disclosed no relevant relationships.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Li, J., Wen, S., Chen, R. et al. A self-correction algorithm for transparent object shadow detection. Appl Intell 55, 275 (2025). https://doi.org/10.1007/s10489-024-06001-z
Accepted:
Published:
DOI: https://doi.org/10.1007/s10489-024-06001-z