Skip to main content

Advertisement

Springer Nature Link
Log in

Research on Multi-tasking Smart Cars Based on Autonomous Driving Systems

  • Original Research
  • Published:
SN Computer Science Aims and scope Submit manuscript

Abstract

Using fewer sensors to achieve more autonomous driving tasks has become a challenge. Some of the existing research implements a single neural network model and achieves the goal of input information diversification and multi-task autonomous driving functionality by adding external devices. However, it adds the burden of designing complex modules. Existing methods with only one sensor (camera) can only achieve two tasks of road tracking and obstacle avoidance. In contrast to existing research, this paper proposed a novel Autonomous Driving System (ADS) that is capable of performing five tasks simultaneously with a single camera: road tracking (Task 1), turn sign recognition (Task 2), lane changing and obstacle avoidance when encountering other cars (Task 3), stopping when encountering obstacles (Task 4), and traffic light recognition (Task 5). The ADS fuses the End-to-end model (Efficientnet_b0-SA-RE) and the Safety-assisted model (Efficientnet_b0-CA), which can be switched between to perform autonomous driving tasks depending on the different road conditions. Additionally, a new Robustness Error (RE) loss function and a new Smoothing Activation (SA) function are presented to optimize both models. The ADS also contains our proposed novel Custom Conversion Scheme (CCS), which integrates TensorRT and half-precision technology (FP16) for accelerating the model, and successfully deploys the dual model on the embedded device Jetson Nano. Furthermore, the untrained environment Track 1–4 is designed to test smart cars. The experimental results demonstrate that our method can complete five tasks simultaneously and achieve a F1 score of 85% in the most challenging Track 4, which is 32% higher than existing methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20

Similar content being viewed by others

Explore related subjects

Discover the latest articles and news from researchers in related subjects, suggested using machine learning.

Data availability

The data that support the findings of this study are available for the corresponding author upon reasonable request.

References

  1. Tsiakas K, Kostavelis I, Giakoumis D, Tzovaras D. Road tracking in semi-structured environments using spatial distribution of lidar data. In: ICPR International Workshops and Challenges, Lecture Notes in Computer Science. vol 12667. Springer; 2021, p. 432–445

  2. Kumar A, Saini T, Pandey PB, Agarwal AP, Agarwal AN, Agarwal B. Vision-based outdoor navigation of self-driving car using lane detection. Int J Inf Tecnol. 2022;14:215–27.

    Article  Google Scholar 

  3. Li Y, Qu J. Intelligent road tracking and real-time acceleration-deceleration for autonomous driving using modified convolutional neural networks. Curr Appl. Sci Technol. 2022;22(6):26

    Google Scholar 

  4. Sun Z, Zou J, He D, Zhu W. Path-tracking control for autonomous vehicles using double-hidden-layer output feedback neural network fast nonsingular terminal sliding mode. Neural Comput Appl. 2022;34:5135–50.

    Article  Google Scholar 

  5. Peng B, Sun Q, Li SE, Kum D, Yin Y, Wei J, Gu T. End-to-end autonomous driving through dueling double deep q-network. Automot Innov. 2021;4:328–37.

    Article  Google Scholar 

  6. Arunmozhi A, Gotadki S, Park J, Gosavi U. Stop sign and stop line detection and distance calculation for autonomous vehicle control. In: 2018 IEEE International Conference on electro/information technology (EIT). Rochester; 2018, p. 0356–0361. https://doi.org/10.1109/EIT.2018.8500268.

  7. Liu Y, Wang X, Li L, Cheng S, Chen Z. A novel lane change decision-making model of autonomous vehicle based on support vector machine. IEEE Access. 2019;7:26543–50.

    Article  Google Scholar 

  8. Rhee J, Seo J. Low-cost curb detection and localization system using multiple ultrasonic sensors. Sensors. 2000;19(6):1389.

    Article  Google Scholar 

  9. Vijitkunsawat W, Chantngarm P. Comparison of machine learning algorithm’s on self-driving car navigation using nvidia jetson nano. In: 2020 17th International Conference on electrical engineering/electronics, computer, telecommunications and information Technology (ECTI-CON). IEEE, 2020; p. 201–204. https://doi.org/10.1109/ECTI-CON49241.2020.9158311

  10. Lopez L, Fuentes O. Color-based road sign detection and tracking. International Conference Image Analysis and Recognition (ICIAR). Berlin: Springer; 2007, p. 1138–1147. https://doi.org/10.1007/978-3-540-74260-9_101

  11. Swaminathan V, Arora S, Bansal R, Rajalakshmi R. Autonomous driving system with road sign recognition using convolutional neural networks. In: 2019 International Conference on Computational intelligence in data science (ICCIDS). IEEE, 2019; p. 1–4. https://doi.org/10.1109/ICCIDS.2019.8862152.

  12. Dewi C, Chen RC, Liu YT, Jiang X, Hartomo KD. Yolo v4 for advanced traffic sign recognition with synthetic training data generated by various gan. IEEE Access. 2021;9:97228–42.

    Article  Google Scholar 

  13. Vu VS, Nguyen DN. Application of MobileNet-SSD deep neural network for real-time object detection and lane tracking on an autonomous vehicle. In: IFToMM Asian Conference on Mechanism and Machine Science. Springer; 2021, p. 559–65. https://doi.org/10.1007/978-3-030-91892-7_53

  14. Fang R, Cai C. Computer vision based obstacle detection and target tracking for autonomous vehicles. In: MATEC Web of Conferences. EDP Sciences; 2021, Vol. 336, p. 07004. https://doi.org/10.1051/matecconf/202133607004.

  15. Ding S, Qu J. Smart car with road tracking and obstacle avoidance based on Resnet18-CBAM. In: 2022 7th International Conference on business and industrial research (ICBIR). IEEE, 2022; p. 582–85. https://doi.org/10.1109/ICBIR54589.2022.9786406.

  16. Yao Z, Wang L, Liu K, Li Y. Motion prediction for autonomous vehicles using ResNet-based model. In: 2021 2nd International Conference on education, knowledge and information management (ICEKIM). IEEE, 2021; p. 323–27. https://doi.org/10.1109/ICEKIM52309.2021.00078

  17. Gautam S, Kumar A. Automatic traffic light detection for self-driving cars using transfer learning. In: Intelligent Sustainable Systems. Lecture Notes in Networks and Systems, vol. 3. 2022; p. 597–606.

  18. Gao H, Cheng B, Wang J, Li K, Zhao J, Li D. Object classification using CNN-based fusion of vision and LIDAR in autonomous vehicle environment. IEEE Trans Industr Inf. 2018;14(9):4224–31.

    Article  Google Scholar 

  19. Tan M, Le Q. Efficientnet: Rethinking model scaling for convolutional neural networks. In: Proceedings of the 36th International Conference on Machine Learning. PMLR, 2019; vol 97, pp 6105–6114.

  20. Krizhevsky A, Sutskever I, Hinton GE. Imagenet classification with deep convolutional neural networks. Communications of the ACM. 2017;60(6):84–90.

    Article  Google Scholar 

  21. Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. In: 3rd International Conference on Learning Represe-ntations (ICLR). 2014. p. 1–14

  22. He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on computer vision and pattern recognition (CVPR). 2016; p. 770–78.

  23. Hou Q, Zhou D, Feng J. Coordinate attention for efficient mobile network design. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2021; p. 13713–22

  24. Girshick R. Fast r-cnn. In: Proceedings of the IEEE International Conference on computer vision. 2015; p. 1440–48.

  25. Xu J. A novel deep neural network based method for house price prediction. In: 2021 International Conference of social computing and digital economy (ICSCDE) IEEE, 2021; p. 12–16. https://doi.org/10.1109/ICSCDE54196.2021.00012.

  26. Chu W, Keerthi SS, Ong CJ. Bayesian support vector regression using a unified loss function. IEEE Trans Neural Networks. 2004;15(1):29–44.

    Article  Google Scholar 

  27. Ramachandran P, Zoph B, Le Q V. (2017). Searching for activation functions. arXiv preprint arXiv:1710.05941.

  28. Misra D. (2019). Mish: A self regularized non-monotonic activation function. arXiv preprint arXiv:1908.08681.

  29. Glorot X, Bordes A, Bengio Y. Deep sparse rectifier neural networks. In: Proceedings of the Fourteenth International Conference on artificial intelligence and statistics. 2011; vol 15, pp 315–23.

  30. Xu H, Guo M, Nedjah N, Zhang J, Li P. Vehicle and pedestrian detection algorithm based on lightweight YOLOv3-promote and semi-precision acceleration. IEEE Trans Intell Transport Syst. 2022;23:19760–71.

    Article  Google Scholar 

  31. Febbo R, Flood B, Halloy J. Lau P, Wong K, Ayala A. Autonomous vehicle control using a deep neural network and jetson nano. In: Practice and Experience in Advanced Research Computing. 2020; p. 333–38. https://doi.org/10.1145/3311790.3396669.

Download references

Acknowledgements

The first author conducted the experiments and drafted the manuscript. The last author guided and advised the experiment and co-drafted the manuscript. The first and second authors each contributed 50% equally to this work.

Author information

Authors and Affiliations

  1. Faculty of Engineering and Technology, Panyapiwat Institute of Management, Nonthaburi, Thailand

    Shukai Ding & Jian Qu

Authors
  1. Shukai Ding
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Jian Qu
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Shukai Ding.

Ethics declarations

Conflict of Interest

On behalf of all the authors, the corresponding author states that there is no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ding, S., Qu, J. Research on Multi-tasking Smart Cars Based on Autonomous Driving Systems. SN COMPUT. SCI. 4, 292 (2023). https://doi.org/10.1007/s42979-023-01740-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s42979-023-01740-1

Keywords