ABSTRACT
Shadows are the obstacle parts of a vision-based during the driving an autonomous vehicle (AV). The shadow also can be detected as an object. It is feared the AV’s system doesn’t well-work or hits another object. Many methods of the images and video shadow detection and removal in the AVs. However, to handle the various backgrounds on the video shadow and objects, we need to exploit many scenarios of single video shadow detection, removal, and semantic segmentation. We propose a new novelty method in the shadow video detection and removal which is combined with the re-coloring method in the segmentation process. It’s namely the D-ViShaDeRec. We also propose a new modified Sobel algorithm which has a kernel size of 5 × 5. The D-ViShaDeRec’s outcomes show , , , , , and of the recall, selectivity, precision, NPV, accuracy, and F1-Score, respectively.
Supplemental Material
Available for Download
- [1] A. Ecins, et al. 2014. Shadow Free Segmentation in Still Images Using Local Density Measure. Proceedings of 2014 IEEE International Conference on Computational Photography (ICCP). https://doi.org/10.1109/ICCPHOT.2014.6831803Google ScholarCross Ref
- [2] A. Yoneyama, et al. 2003. Moving cast Moving Cast Shadow Elimination for Robust Vehicle Extraction Based on 2D Joint Vehicle/Shadow Models. Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, 2003. 229–236. https://doi.org/10.1109/AVSS.2003.1217926Google ScholarCross Ref
- [3] S. Nadhimi, Math B. Bhanu. 2004. Physical models for moving shadow and object detection in video. Journal of IEEE Transactions on Pattern Analysis and Machine Intelligence. 26(8), 1079–1087. https://doi.org/10.1109/TPAMI.2004.51Google ScholarDigital Library
- [4] C. Benedek, Math T. Sziranyi. 2008. Bayesian Foreground and Shadow Detection in Uncertain Frame Rate Surveillance Videos. Journal of IEEE Transactions on Image Processing. 174, 608–621. https://doi.org/10.1109/TIP.2008.916989Google ScholarDigital Library
- [5] D. Joshua, Math Rhandley. 2016. Moving Shadow Detection and Removal for Video-based Traffic Monitoring. Proceedings of 2016 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA). https://doi.org/10.1109/APSIPA.2016.7820722Google Scholar
- [6] H. Le, Math D. Samaras. 2021. Physics-based Shadow Image Decomposition for Shadow Removal. Journal of IEEE Transactions on Pattern Analysis and Machine Intelligence. 1-14. https://doi.org/10.48550/arXiv.2012.13018Google Scholar
- [7] H. M. Le, et al. 2016. Geodesic Distance Histogram Feature for Video Segmentation. Proceedings of Asian Conference on Computer Vision (ACCV). https://doi.org/10.48550/arXiv.1704.00077Google Scholar
- [8] N. Inoue, Math T. Yamasaki. 2021. Learning From Synthetic Shadows for Shadow Detection and Removal. Journal of IEEE Transactions on Circuits and Systems for Video Technology. 3111, 4187-4197. https://doi.org/10.1109/TCSVT.2020.3047977Google ScholarDigital Library
- [9] N. John, et al. 2015. A Reliable Method for Detecting Road Regions from a Single Image Based on Color Distribution and Vanishing Point Location. Procedia Computer Science. 58, 2-9. https://doi.org/10.1016/j.procs.2015.08.002Google ScholarCross Ref
- [10] M. Gryka, et al. 2015. Learning to Remove Soft Shadows. Journal of ACM Transactions on Graphics. 345, 1-15. http://dx.doi.org/10.1145/2732407Google ScholarDigital Library
- [11] N. Kligler, et al. 2018. Document Enhancement Using Visibility Detection. Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2374-2382. https://doi.org/10.1109/CVPR.2018.00252Google ScholarCross Ref
- [12] R. Cucchiara, et al. 2003. Detecting moving objects, ghosts, and shadows in video streams. Journal of IEEE Transactions on Pattern Analysis and Machine Intelligence. 2510, 1337-1342. https://doi.org/10.1109/TPAMI.2003.1233909Google ScholarDigital Library
- [13] R. Guo, et al. 2013. Paired Regions for Shadow Detection and Removal. Journal of IEEE Transactions on Pattern Analysis and Machine Intelligence. 3512,2956–2967. https://doi.org/10.1109/TPAMI.2012.214Google ScholarDigital Library
- [14] Risnandar and R. Wardoyo. 2020.D-ISDET: Double Intensity of Image Shadow Detection and Elimination in Autonomous Vehicle. 2020 International Conference on Radar, Antenna, Microwave, Electronics, and Telecommunications (ICRAMET2020). pp. 22-27. https://doi.org/10.1109/ICRAMET51080.2020.9298659.Google Scholar
- [15] S. Bako, et al. 2016. Removing Shadows from Images of Documents. Journal of Asian Conference on Computer Vision (ACCV). 173–183. http://dx.doi.org/10.1007/978-3-319-54187-7Math12Google Scholar
- [16] S. H. Khan, et al. 2016. Automatic Shadow Detection and Removal from a Single Image. Journal of IEEE Transactions on Pattern Analysis and Machine Intelligence. 383, 431–446. https://doi.org/10.1109/TPAMI.2015.2462355Google ScholarDigital Library
- [17] S. Surkutlawar, Math R. R. K. Kulkarni. 2013. Shadow Suppression Using RGB and HSV Color Space in Moving Object Detection. International Journal of Advanced Computer Science and Applications. 4, 164-169. https://dx.doi.org/10.14569/IJACSA.2013.040126Google Scholar
- [18] T. F. Y. Vicente, et al. 2016. Large-scale Training of Shadow Detectors with Noisily-annotated Shadow Examples. Proceedings in: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds) Computer Vision- ECCV. 816–832. https://doi.org/10.1007/978-3-319-46466-4Math49Google ScholarCross Ref
- [19] T. Muller, Math B. Erdnüβ. 2019. Brightness Correction and Shadow Removal for Video Change Detection with UAVs. Proceedings of Autonomous Systems: Sensors, Processing and Security for Vehicles Math Infrastructure. http://dx.doi.org/10.1117/12.2518618Google ScholarCross Ref
- [20] A. Tiwari, et al. 2016. A Survey on Shadow Detection and Removal in Images and Video Sequences. Proceedings of 6th International Conference - Cloud System and Big Data Engineering (Confluence). 518-523. http://dx.doi.org/10.1109/CONFLUENCE.2016.7508175Google ScholarCross Ref
- [21] X. C. Zhang, et al. 2020. Portrait Shadow Manipulation. Journal of ACM Transactions on Graphics. 394, 78:1-14. https://doi.org/10.48550/arXiv.2005.08925Google Scholar
- [22] X. Hu, et al. 2020. Direction-Aware Spatial Context Features for Shadow Detection and Removal. Journal of IEEE Transactions on Pattern Analysis and Machine Intelligence. 2795-2808. https://doi.org/10.1109/TPAMI.2019.2919616Google ScholarCross Ref
- [23] X. Hu, et al. 2019. Mask-ShadowGAN: Learning to Remove Shadows From Unpaired Data. Proceedings of IEEE/CVF International Conference on Computer Vision (ICCV). 2472–2481. https://doi.org/10.1109/ICCV.2019.00256Google ScholarCross Ref
- [24] Y. H. Lin, et al. 2020. BEDSR-Net: A Deep Shadow Removal Network from a Single Document Image. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 12905–12914. https://doi.org/10.1109/CVPR42600.2020.01292Google ScholarCross Ref
- [25] Y. Wang, et al. 2020. People as Scene Probes. People as Scene Probes. Proceedings of Computer Vision-ECCV. 438-454. https://doi.org/10.48550/arXiv.2007.09209Google Scholar
- [26] X. Yuan, et al. 2018. Automatic removal of complex shadows from indoor videos using transfer learning and dynamic thresholding. Computers & Electrical Engineerin. 702018, 813-825. https://doi.org/10.1016/j.compeleceng.2017.12.026Google ScholarCross Ref
- [27] A. Mishra and B. Chaurasia. 2017. Modified Hue over Intensity Ratio Based Method for Shadow Detection and Removal in Arial Images. International Journal of Advanced Engineering and Management. 3 5, 101-105. https://doi.org/10.24999/IJOAEM/00205-26Google Scholar
- [28] M. Shilpa, M.T. Gopalakrishna, and C. Naveena. 2020. Approach for shadow detection and removal using machine learning techniques. IET Image Process. 14 13, 2998-3005. https://doi.org/10.1049/iet-ipr.2020.0001Google Scholar
Index Terms
- D-ViShaDeRec: Double Intensity of Video Shadow Detection, Removal, and Re-coloring in Autonomous Vehicle
Recommendations
Soft shadows from extended light sources with penumbra deep shadow maps
GI '05: Proceedings of Graphics Interface 2005This paper presents a new method of precomputing high-quality soft shadows that can be cast on a static scene as well as on dynamic objects added to that scene. The method efficiently merges the visibility computed from many shadow maps into a penumbra ...
Shadow Removal in Indoor Scenes
AVSS '08: Proceedings of the 2008 IEEE Fifth International Conference on Advanced Video and Signal Based SurveillanceIn this paper, we propose a shadow removal algorithm for indoor scenes. This algorithm uses three types of constraints: chromaticity consistency, texture consistency and range of shadow intensity. The chromaticity consistency is verified in both HSV and ...
Fitted virtual shadow maps
GI '07: Proceedings of Graphics Interface 2007Too little shadow map resolution and resulting undersampling artifacts, perspective and projection aliasing, have long been a fundamental problem of shadowing scenes with shadow mapping.
We present a new smart, real-time shadow mapping algorithm that ...
Comments