Skip to main content
Log in

Architecture design and implementation of image based autonomous car: THUNDER-1

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Autonomous driving with high velocity is a research hotspot which challenges the scientists and engineers all over the world. This paper proposes a scheme of indoor autonomous car based on ROS which combines the method of Deep Learning using Convolutional Neural Network (CNN) with statistical approach using liDAR images and achieves a robust obstacle avoidance rate in cruise mode. In addition, the design and implementation of autonomous car are also presented in detail which involves the design of Software Framework, Hector Simultaneously Localization and Mapping (Hector SLAM) by Teleoperation, Autonomous Exploration, Path Plan, Pose Estimation, Command Processing, and Data Recording (Co- collection). what’s more, the schemes of outdoor autonomous car, communication, and security are also discussed. Finally, all functional modules are integrated in nVidia Jetson TX1.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

References

  1. Aldibaja M, Suganuma N, Yoneda K (2017) Robust Intensity Based Localization Method for Autonomous Driving on Snow-wet Road Surface. IEEE Trans Ind Info 1

  2. Alheeti KMA, Gruebler A, Mcdonald-Maier KD (2015) An intrusion detection system against malicious attacks on the communication network of driverless cars. Consumer Comm Network Conf 916–921

  3. Bag S (2017) Deep Learning Localization for Self-driving Cars

  4. Carlone L, Ng MK, Du J, Bona B, Indri M (2011) Simultaneous Localization and Mapping Using Rao-Blackwellized Particle Filters in Multi Robot Systems. J Int Robot Syst 63:283–307

    Article  Google Scholar 

  5. Chu K, Kim J, Jo K, Sunwoo M (2015) Real-time path planning of autonomous vehicles for unstructured road navigation. Int J Automot Technol 16:653–668

    Article  Google Scholar 

  6. Dolgov D, Thrun S, Montemerlo M, Diebel J (2009) Path Planning for Autonomous Driving in Unknown Environments, Experimental Robotics, The Eleventh International Symposium, ISER 2008 13–16, 2008, Athens, Greece, 55–64

  7. Endres F, Hess J, Sturm J, Cremers D, Burgard W (2017) 3-D Mapping With an RGB-D Camera. IEEE Trans Robot 30:177–187

    Article  Google Scholar 

  8. Fernandes LC, Souza JR, Pessin G, Shinzato PY, Sales D, Mendes C, Prado M, Klaser R, Magalhães AC, Hata A (2014) CaRINA Intelligent Robotic Car: Architectural design and applications. J Syst Archit 60:372–392

    Article  Google Scholar 

  9. Garip MT, Gursoy ME, Reiher P, Gerla M (2015) Congestion Attacks to Autonomous Cars Using Vehicular Botnets, The Workshop on Security of Emerging NETWORKING Technologies

  10. Grisetti G, Stachniss C, Burgard W (2007) Improved Techniques for Grid Mapping With Rao-Blackwellized Particle Filters. IEEE Trans Robot 23:34–46

    Article  Google Scholar 

  11. International S (2014) Taxonomy and Definitions for Terms Related to On-Road Motor Vehicle Automated Driving Systems

  12. Jalalmaab M, Fidan B, Jeon S and Falcone P (2015) Model predictive path planning with time-varying safety constraints for highway autonomous driving, International Conference on Advanced Robotics 213–217

  13. Kang MC, Chae SH, Sun JY, Lee SH, Ko SJ (2017) An enhanced obstacle avoidance method for the visually impaired using deformable grid. IEEE Trans Consum Electron 63:169–177

    Article  Google Scholar 

  14. Kohlbrecher S, Meyer J, Graber T, Petersen K, Klingauf U, Stryk OV (2013) Hector Open Source Modules for Autonomous Mapping and Navigation with Rescue Robots. Springer, Berlin

    Google Scholar 

  15. Kohlbrecher S, Stryk OV, Meyer J and Klingauf U (2011) A flexible and scalable SLAM system with full 3D motion estimation. IEEE Int Sympos Saf Sec Rescue Robot 155–160

  16. Lee SH, Chung CC (2017) Robust Multirate On-Road Vehicle Localization for Autonomous Highway Driving Vehicles. IEEE Trans Control Syst Technol 25:577–589

    Article  Google Scholar 

  17. Mur-Artal R and Tardos JD (2015) Probabilistic Semi-Dense Mapping from Highly Accurate Feature-Based Monocular SLAM, Robotics: Science and Systems

  18. Oliveira M, Santos V, Sappa AD, Dias P, Moreira AP (2016) Incremental texture mapping for autonomous driving. Robotics & Autonomous Systems 84:113–128

    Article  Google Scholar 

  19. Pink O, Becker J, Kammel S (2015) Automated driving on public roads: Experiences in real traffic, it. Info Technol 57:223–230

    Google Scholar 

  20. Rosolia U, Bruyne SD and Alleyne AG (2016) Autonomous Vehicle Control: A Nonconvex Approach for Obstacle Avoidance. IEEE Trans Control Syst Technol 1–16

  21. Sallab AAA, Abdou M, Perot E and Yogamani S (2016) Deep Reinforcement Learning framework for Autonomous Driving, NIPS 2016 Workshop - MLITS

  22. Schellekens M (2016) Car hacking: Navigating the regulatory landscape. Comput Law Sec Rev Int J Technol Law Pract 32:307–315

    Article  Google Scholar 

  23. Taş ÖŞ, F. KUHNT, J. M. ZöLLNER and C. STILLER (2016) Functional system architectures towards fully automated driving, Intelligent Vehicles Symposium

  24. Tijmons S, Croon GCHED, Remes BDW, Wagter CD, Mulder M (2017) Obstacle Avoidance Strategy using Onboard Stereo Vision on a Flapping Wing MAV. IEEE Trans Robot 33:858–874

    Article  Google Scholar 

  25. Ulbrich S, Reschka A, Rieken J, Ernst S, Bagschik G, Dierkes F, Nolte M and Maurer M (2017) Towards a Functional System Architecture for Automated Vehicles

  26. Wolcott RW, Eustice RM (2017) Robust LIDAR localization using multiresolution Gaussian mixture maps for autonomous driving. Int J Robot Res 36:027836491769656

    Article  Google Scholar 

Download references

Acknowledgements

The research of autonomous car are funded by Sci-Tech Support Plan of Sichuan Province, China [Grant Numbers: 2016GZ0343].

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Chengmin Zhou.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhou, C., Li, F. & Cao, W. Architecture design and implementation of image based autonomous car: THUNDER-1. Multimed Tools Appl 78, 28557–28573 (2019). https://doi.org/10.1007/s11042-018-5816-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-018-5816-9

Keywords

Navigation