skip to main content
10.1145/3591569.3591616acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiciitConference Proceedingsconference-collections
research-article

Robust Autonomous Driving Control using Auto-Encoder and End-to-End Deep Learning under Rainy Conditions

Published: 13 July 2023 Publication History

Abstract

A key element of autonomous vehicles is lane-keeping. To keep an automobile in its lane, numerous artificial intelligence technologies and vision systems are employed. Despite being widely used, current systems function effectively in favorable weather. Downstream computer vision models may perform worse due to rain and other weather-related obstacles. For this reason, rain, snow, and mist noise must be detected, recognized, and removed by vision systems to improve system performance. For these issues, the autoencoder neural network is particularly common. The main goal of using an autoencoder for image deraining is to maintain originality because autoencoders adhere to the backpropagation procedure instead of the traditional techniques, which results in the signal coming out being ultimately the altered version of the input signal. This study covers a method for reducing the amount of rain in photos utilizing image processing, deep learning methods with autoencoder implementation, and end-to-end learning to determine the best steering rotation setting for retaining a vehicle in its lane using a donkey car. After training, the end-to-end model may be able to directly guide the car using the information from the front view camera, unlike the conventional method which manually breaks down the autonomous driving issue into specific details. The convolutional neural network (CNN) model takes raw images as input and generates the proper steering angles. The AI Kit Donkey Car is used in this study to collect data, train models, and evaluate them. According to the experimental results, the combination of the deraining method and end-to-end deep learning produces good performance in rainy situations.

References

[1]
Yigang Sun, Xiaoye Duan, Hongying Zhang and Zhijing Yu, "A removal algorithm of rain and snow from images based on fuzzy connectedness," 2010 International Conference on Computer Application and System Modeling (ICCASM 2010), 2010, pp. V5-478-V5-481.
[2]
H. Dong and X. Zhao, “Detection and removal of rain and snow from videos based on frame difference method,” Proc. 2015 27th Chinese Control Decis. Conf., pp. 5139–5143, 2015. https://doi.org/10.1109/CCDC.2015.7162843.
[3]
L. Zhao, Q. Wang, Q. Zou, Y. Zhang, and Y. Chen, “Privacy-preserving collaborative deep learning with unreliable participants,” IEEE Transactions on Information Forensics and Security, vol. PP, pp. 1–1. 939 713, 2019.
[4]
Q. Wang, M. Du, X. Chen, Y. Chen, P. Zhou, X. Chen, and X. Huang, “Privacy-preserving collaborative model learning: The case of word vector training,” IEEE Transactions on Knowledge and Data Engineering, vol. 30, no. 12, pp. 2381–2393, 2018.
[5]
K. O'Shea and R. Nash, “An Introduction to Convolutional Neural Networks,” in Neural and Evolutionary Computing, 2015, pp. 1–11, https://doi.org/10.48550/arXiv.1511.08458.
[6]
X. Fu, J. Huang, D. Zeng, Y. Huang, X. Ding, and J. Paisley, “Removing rain from single images via a deep detail network,” in Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, 2017, vol. 2017-Janua, pp. 1715–1723. https://doi.org/10.1109/CVPR.2017.186.
[7]
Mao, Xiao-Jiao, Shen, Chunhua, and Yang, Yu-Bin. “Image restoration using convolutional auto-encoders with symmetric skip connections,” In Proc. NIPS, 2016. https://doi.org/10.48550/arXiv.1606.08921.
[8]
O. Ronneberger, P. Fischer, and T. Brox, “U-net: Convolutional networks for biomedical image segmentation,” in Medical Image Computing and Computer-Assisted Intervention (MICCAI), N. Navab, J. Hornegger, W. M. Wells, and A. F. Frangi, Eds. Munich, Germany: Springer International Publishing, 2015, pp. 234–241. https://doi.org/10.48550/arXiv.1505.04597.
[9]
V. Badrinarayanan, A. Kendall and R. Cipolla, "SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation," in IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 39, no. 12, pp. 2481-2495, 1 Dec. 2017.
[10]
P. Viswanath, M. Mody, S. Nagori, J. Jones and H. Garud, “Virtual Simulation Platforms for Automated Driving: Key Care-About and Usage Model”, In proceedings, AVM track, Electronic Imaging, 2018.
[11]
Hoang Tran Ngoc and Luyl-Da Quach, “Adaptive Lane Keeping Assist for an Autonomous Vehicle based on Steering Fuzzy-PID Control in ROS” International Journal of Advanced Computer Science and Applications(IJACSA), 13(10), 2022. http://dx.doi.org/10.14569/IJACSA.2022.0131086.
[12]
M. Bojarski, D. Del Testa, D. Dworakowski, B. Firner, B. Flepp, P. Goyal, L. D. Jackel, M. Monfort, U. Muller, J. Zhang, X. Xhang and J. Zhao, “End to End Learning for Self-Driving Cars”, arXiv: 1604.07316, 2016. https://doi.org/10.48550/arXiv.1604.07316.
[13]
Leonard, J. (2009). A Perception-Driven Autonomous Urban Vehicle. In: Buehler, M., Iagnemma, K., Singh, S. (eds) The DARPA Urban Challenge. Springer Tracts in Advanced Robotics, vol 56. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-03991-1_5.
[14]
Danwei Wang and Feng Qi, "Trajectory planning for a four-wheel-steering vehicle," Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164), 2001, pp. 3320-3325 vol.4.
[15]
F. Torabi, G. Warnell, and P. Stone, “Behavioral cloning from observation,” in IJCAI International Joint Conference on Artificial Intelligence, 2018, vol. 2018-July, pp. 4950–4957.
[16]
“Kaggle: Your Home for Data Science.”.
[17]
I. Culjak, D. Abram, T. Pribanic, H. Dzapo and M. Cifrek, "A brief introduction to OpenCV," 2012 Proceedings of the 35th International Convention MIPRO, 2012, pp. 1725-1730.
[18]
I. Goodfellow, Y. Bengio, and A. Courville, Deep learning. The MIT Press, 2016. https://doi.org/10.1007/s10710-017-9314-z.
[19]
P. Vincent, H. Larochelle, Y. Bengio and P. Manzagol. “Extracting and composing robust features with denoising autoencoders.” Proceedings of the 25th international conference on Machine learning. ACM, 2008.
[20]
Askari R., Auto Encoders, https://reyhaneaskari.github.io/AE.htm.
[21]
Riesenhuber, M., Poggio, T. Hierarchical models of object recognition in cortex. Nat Neurosci 2, 1019–1025 (1999). https://doi.org/10.1038/14819.
[22]
C. Nwankpa, W. Ijomah, A. Gachagan, and S. Marshall, “Activation Functions: Comparison of trends in Practice and Research for Deep Learning,” Nov. 2018. https://doi.org/10.48550/arXiv.1811.03378.
[23]
Maas, A.L., Hannun, A.Y. and Ng, A.Y. (2013) Rectifier Nonlinearities Improve Neural Network Acoustic Models. Proceedings of the 30th International Conference on Machine Learning, Atlanta, 16-21 June 2013, 3.
[24]
G. Huang, Z. Liu, L. Van Der Maaten and K. Q. Weinberger, "Densely Connected Convolutional Networks," 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017, pp. 2261-2269.
[25]
D.-A. Clevert, T. Unterthiner, and S. Hochreiter, “Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs),” Nov. 2015. https://doi.org/10.48550/arXiv.1511.07289.
[26]
M. Abadi, P. Barham, J. Chen, Z. Chen, A. Davis, J. Dean, M. Devin, S. Ghemawat, G. Irving, M. Isard, M. Kudlur, J. Levenberg, R. Monga, S. Moore, D. G. Murray, B. Steiner, P. Tucker, V. Vasudevan, P. Warden, M. Wicke, Y. Yu, and X. Zheng, “Tensorflow: A system for large-scalemachine learning,” in 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16), 2016, pp. 265–283. https://doi.org/10.48550/arXiv.1605.08695.
[27]
D. P. Kingma, J. Ba, “Adam: A Method for Stochastic Optimization”, arXiv: 1412.6980, 2014. https://doi.org/10.48550/arXiv.1412.6980.

Cited By

View all
  • (2025)Integration of Deep Learning Vision Systems in Collaborative Robotics for Real-Time ApplicationsApplied Sciences10.3390/app1503133615:3(1336)Online publication date: 27-Jan-2025
  • (2025)Enhancing semantic scene segmentation for indoor autonomous systems using advanced attention-supported improved UNetSignal, Image and Video Processing10.1007/s11760-024-03779-w19:2Online publication date: 6-Jan-2025
  • (2024)The Method of Restoring Lost Information from Sensors Based on Auto-Associative Neural NetworksApplied System Innovation10.3390/asi70300537:3(53)Online publication date: 20-Jun-2024
  • Show More Cited By

Index Terms

  1. Robust Autonomous Driving Control using Auto-Encoder and End-to-End Deep Learning under Rainy Conditions
        Index terms have been assigned to the content through auto-classification.

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image ACM Other conferences
        ICIIT '23: Proceedings of the 2023 8th International Conference on Intelligent Information Technology
        February 2023
        310 pages
        ISBN:9781450399616
        DOI:10.1145/3591569
        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 13 July 2023

        Permissions

        Request permissions for this article.

        Check for updates

        Qualifiers

        • Research-article
        • Research
        • Refereed limited

        Conference

        ICIIT 2023

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)69
        • Downloads (Last 6 weeks)3
        Reflects downloads up to 27 Feb 2025

        Other Metrics

        Citations

        Cited By

        View all
        • (2025)Integration of Deep Learning Vision Systems in Collaborative Robotics for Real-Time ApplicationsApplied Sciences10.3390/app1503133615:3(1336)Online publication date: 27-Jan-2025
        • (2025)Enhancing semantic scene segmentation for indoor autonomous systems using advanced attention-supported improved UNetSignal, Image and Video Processing10.1007/s11760-024-03779-w19:2Online publication date: 6-Jan-2025
        • (2024)The Method of Restoring Lost Information from Sensors Based on Auto-Associative Neural NetworksApplied System Innovation10.3390/asi70300537:3(53)Online publication date: 20-Jun-2024
        • (2024)Deep Learning-Based Lane-Keeping Assist System for Self-Driving Cars Using Transfer Learning and Fine TuningJournal of Advances in Information Technology10.12720/jait.15.3.322-32915:3(322-329)Online publication date: 2024
        • (2024)Steering Angle Prediction for Autonomous Vehicles Using Deep Transfer LearningJournal of Advances in Information Technology10.12720/jait.15.1.138-14615:1(138-146)Online publication date: 2024
        • (2024)Security and Privacy Relate Future Aspects of Artificial Intelligence-Powered Electric Vehicle Technology2024 11th International Conference on Electrical Engineering, Computer Science and Informatics (EECSI)10.1109/EECSI63442.2024.10776351(428-433)Online publication date: 26-Sep-2024
        • (2024)Collision Risk Assessment for Intelligent Vehicles Considering Multi-Dimensional UncertaintiesIEEE Access10.1109/ACCESS.2024.335438312(57780-57795)Online publication date: 2024
        • (2024)Assessment of the state of the art in the performance and utilisation level of automated vehiclesInternational Journal of Sustainable Engineering10.1080/19397038.2024.236683917:1(537-553)Online publication date: 18-Jun-2024
        • (2024)Artificial neural network-based positioning error modeling and compensation for low-cost encoders of four-wheeled vehiclesEvolutionary Intelligence10.1007/s12065-024-00935-617:5-6(4295-4302)Online publication date: 2-May-2024
        • (2024)Fine-tuned depth-augmented U-Net for enhanced semantic segmentation in indoor autonomous vision systemsJournal of Real-Time Image Processing10.1007/s11554-024-01578-722:1Online publication date: 6-Dec-2024
        • Show More Cited By

        View Options

        Login options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format.

        HTML Format

        Figures

        Tables

        Media

        Share

        Share

        Share this Publication link

        Share on social media