skip to main content
10.1145/3575882.3575936acmotherconferencesArticle/Chapter ViewAbstractPublication Pagesic3inaConference Proceedingsconference-collections
research-article

D-ViShaDeRec: Double Intensity of Video Shadow Detection, Removal, and Re-coloring in Autonomous Vehicle

Authors Info & Claims
Published:27 February 2023Publication History

ABSTRACT

Shadows are the obstacle parts of a vision-based during the driving an autonomous vehicle (AV). The shadow also can be detected as an object. It is feared the AV’s system doesn’t well-work or hits another object. Many methods of the images and video shadow detection and removal in the AVs. However, to handle the various backgrounds on the video shadow and objects, we need to exploit many scenarios of single video shadow detection, removal, and semantic segmentation. We propose a new novelty method in the shadow video detection and removal which is combined with the re-coloring method in the segmentation process. It’s namely the D-ViShaDeRec. We also propose a new modified Sobel algorithm which has a kernel size of 5 × 5. The D-ViShaDeRec’s outcomes show , , , , , and of the recall, selectivity, precision, NPV, accuracy, and F1-Score, respectively.

Skip Supplemental Material Section

Supplemental Material

ic3ina2022-54.mp4

mp4

45.8 MB

References

  1. [1] A. Ecins, et al. 2014. Shadow Free Segmentation in Still Images Using Local Density Measure. Proceedings of 2014 IEEE International Conference on Computational Photography (ICCP). https://doi.org/10.1109/ICCPHOT.2014.6831803Google ScholarGoogle ScholarCross RefCross Ref
  2. [2] A. Yoneyama, et al. 2003. Moving cast Moving Cast Shadow Elimination for Robust Vehicle Extraction Based on 2D Joint Vehicle/Shadow Models. Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, 2003. 229–236. https://doi.org/10.1109/AVSS.2003.1217926Google ScholarGoogle ScholarCross RefCross Ref
  3. [3] S. Nadhimi, Math B. Bhanu. 2004. Physical models for moving shadow and object detection in video. Journal of IEEE Transactions on Pattern Analysis and Machine Intelligence. 26(8), 1079–1087. https://doi.org/10.1109/TPAMI.2004.51Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. [4] C. Benedek, Math T. Sziranyi. 2008. Bayesian Foreground and Shadow Detection in Uncertain Frame Rate Surveillance Videos. Journal of IEEE Transactions on Image Processing. 174, 608–621. https://doi.org/10.1109/TIP.2008.916989Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. [5] D. Joshua, Math Rhandley. 2016. Moving Shadow Detection and Removal for Video-based Traffic Monitoring. Proceedings of 2016 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA). https://doi.org/10.1109/APSIPA.2016.7820722Google ScholarGoogle Scholar
  6. [6] H. Le, Math D. Samaras. 2021. Physics-based Shadow Image Decomposition for Shadow Removal. Journal of IEEE Transactions on Pattern Analysis and Machine Intelligence. 1-14. https://doi.org/10.48550/arXiv.2012.13018Google ScholarGoogle Scholar
  7. [7] H. M. Le, et al. 2016. Geodesic Distance Histogram Feature for Video Segmentation. Proceedings of Asian Conference on Computer Vision (ACCV). https://doi.org/10.48550/arXiv.1704.00077Google ScholarGoogle Scholar
  8. [8] N. Inoue, Math T. Yamasaki. 2021. Learning From Synthetic Shadows for Shadow Detection and Removal. Journal of IEEE Transactions on Circuits and Systems for Video Technology. 3111, 4187-4197. https://doi.org/10.1109/TCSVT.2020.3047977Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. [9] N. John, et al. 2015. A Reliable Method for Detecting Road Regions from a Single Image Based on Color Distribution and Vanishing Point Location. Procedia Computer Science. 58, 2-9. https://doi.org/10.1016/j.procs.2015.08.002Google ScholarGoogle ScholarCross RefCross Ref
  10. [10] M. Gryka, et al. 2015. Learning to Remove Soft Shadows. Journal of ACM Transactions on Graphics. 345, 1-15. http://dx.doi.org/10.1145/2732407Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. [11] N. Kligler, et al. 2018. Document Enhancement Using Visibility Detection. Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2374-2382. https://doi.org/10.1109/CVPR.2018.00252Google ScholarGoogle ScholarCross RefCross Ref
  12. [12] R. Cucchiara, et al. 2003. Detecting moving objects, ghosts, and shadows in video streams. Journal of IEEE Transactions on Pattern Analysis and Machine Intelligence. 2510, 1337-1342. https://doi.org/10.1109/TPAMI.2003.1233909Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. [13] R. Guo, et al. 2013. Paired Regions for Shadow Detection and Removal. Journal of IEEE Transactions on Pattern Analysis and Machine Intelligence. 3512,2956–2967. https://doi.org/10.1109/TPAMI.2012.214Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. [14] Risnandar and R. Wardoyo. 2020.D-ISDET: Double Intensity of Image Shadow Detection and Elimination in Autonomous Vehicle. 2020 International Conference on Radar, Antenna, Microwave, Electronics, and Telecommunications (ICRAMET2020). pp. 22-27. https://doi.org/10.1109/ICRAMET51080.2020.9298659.Google ScholarGoogle Scholar
  15. [15] S. Bako, et al. 2016. Removing Shadows from Images of Documents. Journal of Asian Conference on Computer Vision (ACCV). 173–183. http://dx.doi.org/10.1007/978-3-319-54187-7Math12Google ScholarGoogle Scholar
  16. [16] S. H. Khan, et al. 2016. Automatic Shadow Detection and Removal from a Single Image. Journal of IEEE Transactions on Pattern Analysis and Machine Intelligence. 383, 431–446. https://doi.org/10.1109/TPAMI.2015.2462355Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. [17] S. Surkutlawar, Math R. R. K. Kulkarni. 2013. Shadow Suppression Using RGB and HSV Color Space in Moving Object Detection. International Journal of Advanced Computer Science and Applications. 4, 164-169. https://dx.doi.org/10.14569/IJACSA.2013.040126Google ScholarGoogle Scholar
  18. [18] T. F. Y. Vicente, et al. 2016. Large-scale Training of Shadow Detectors with Noisily-annotated Shadow Examples. Proceedings in: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds) Computer Vision- ECCV. 816–832. https://doi.org/10.1007/978-3-319-46466-4Math49Google ScholarGoogle ScholarCross RefCross Ref
  19. [19] T. Muller, Math B. Erdnüβ. 2019. Brightness Correction and Shadow Removal for Video Change Detection with UAVs. Proceedings of Autonomous Systems: Sensors, Processing and Security for Vehicles Math Infrastructure. http://dx.doi.org/10.1117/12.2518618Google ScholarGoogle ScholarCross RefCross Ref
  20. [20] A. Tiwari, et al. 2016. A Survey on Shadow Detection and Removal in Images and Video Sequences. Proceedings of 6th International Conference - Cloud System and Big Data Engineering (Confluence). 518-523. http://dx.doi.org/10.1109/CONFLUENCE.2016.7508175Google ScholarGoogle ScholarCross RefCross Ref
  21. [21] X. C. Zhang, et al. 2020. Portrait Shadow Manipulation. Journal of ACM Transactions on Graphics. 394, 78:1-14. https://doi.org/10.48550/arXiv.2005.08925Google ScholarGoogle Scholar
  22. [22] X. Hu, et al. 2020. Direction-Aware Spatial Context Features for Shadow Detection and Removal. Journal of IEEE Transactions on Pattern Analysis and Machine Intelligence. 2795-2808. https://doi.org/10.1109/TPAMI.2019.2919616Google ScholarGoogle ScholarCross RefCross Ref
  23. [23] X. Hu, et al. 2019. Mask-ShadowGAN: Learning to Remove Shadows From Unpaired Data. Proceedings of IEEE/CVF International Conference on Computer Vision (ICCV). 2472–2481. https://doi.org/10.1109/ICCV.2019.00256Google ScholarGoogle ScholarCross RefCross Ref
  24. [24] Y. H. Lin, et al. 2020. BEDSR-Net: A Deep Shadow Removal Network from a Single Document Image. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 12905–12914. https://doi.org/10.1109/CVPR42600.2020.01292Google ScholarGoogle ScholarCross RefCross Ref
  25. [25] Y. Wang, et al. 2020. People as Scene Probes. People as Scene Probes. Proceedings of Computer Vision-ECCV. 438-454. https://doi.org/10.48550/arXiv.2007.09209Google ScholarGoogle Scholar
  26. [26] X. Yuan, et al. 2018. Automatic removal of complex shadows from indoor videos using transfer learning and dynamic thresholding. Computers & Electrical Engineerin. 702018, 813-825. https://doi.org/10.1016/j.compeleceng.2017.12.026Google ScholarGoogle ScholarCross RefCross Ref
  27. [27] A. Mishra and B. Chaurasia. 2017. Modified Hue over Intensity Ratio Based Method for Shadow Detection and Removal in Arial Images. International Journal of Advanced Engineering and Management. 3 5, 101-105. https://doi.org/10.24999/IJOAEM/00205-26Google ScholarGoogle Scholar
  28. [28] M. Shilpa, M.T. Gopalakrishna, and C. Naveena. 2020. Approach for shadow detection and removal using machine learning techniques. IET Image Process. 14 13, 2998-3005. https://doi.org/10.1049/iet-ipr.2020.0001Google ScholarGoogle Scholar

Index Terms

  1. D-ViShaDeRec: Double Intensity of Video Shadow Detection, Removal, and Re-coloring in Autonomous Vehicle

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in
          • Published in

            cover image ACM Other conferences
            IC3INA '22: Proceedings of the 2022 International Conference on Computer, Control, Informatics and Its Applications
            November 2022
            415 pages
            ISBN:9781450397902
            DOI:10.1145/3575882

            Copyright © 2022 ACM

            © 2022 Association for Computing Machinery. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of a national government. As such, the Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            • Published: 27 February 2023

            Permissions

            Request permissions about this article.

            Request Permissions

            Check for updates

            Qualifiers

            • research-article
            • Research
            • Refereed limited
          • Article Metrics

            • Downloads (Last 12 months)26
            • Downloads (Last 6 weeks)1

            Other Metrics

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader

          HTML Format

          View this article in HTML Format .

          View HTML Format