Skip to main content

Fast On-Road Object Detector on ROS-Based Mobile Robot

  • Conference paper
  • First Online:
Algorithms and Architectures for Parallel Processing (ICA3PP 2021)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 13156))

  • 2139 Accesses

Abstract

The application environment of mobile robot is gradually expanding from indoor to outdoor. Vision-based detection, which acquires traffic information through the camera, is a state-of-the-art auxiliary technology. In this paper, a robotic middleware Robot Operating System (ROS) is applied to detect object and control application based on embedded processor. And, we present an effective On-road object detector which is suitable for embedded GPU by improving the performance of Single Shot MultiBox Detector (SSD). Our approach is to construct detection network by using depth-wise separable convolution for saving computing resource and present multi-category clustering to adjust the generated default boxes for optimizing accuracy. Experiments on KITTI dataset show that the proposed network runs 2.1 times faster than original SSD network on embedded GPU and maintains 71% mean average precision. Finally, a mobile robot is designed based on the detector and controller to demonstrate On-road assisted driving intuitively.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Liu, W., et al.: SSD: single shot multibox detector. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9905, pp. 21–37. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46448-0_2

    Chapter  Google Scholar 

  2. Ren, S., He, K.: Faster R-CNN: towards real-time object detection with region proposal networks. In: Cortes, C., Lee, D.D. (eds.) International Conference on Neural Information Processing Systems, vol. 1, pp. 91–99. MIT Press, Montreal (2015)

    Google Scholar 

  3. Quigley, M., Gerkey, B., Smart, W.D.: Programming Robots with ROS: A Practical Introduction to the Robot Operating System, 1st edn. O’Reilly Media, Sebastopol (2015)

    Google Scholar 

  4. He, K., Ma, X.: Real-time monitoring for the mining robot based on an improved SIFT matching algorithm. In: 2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI), pp. 1–5. IEEE, Shanghai (2015)

    Google Scholar 

  5. Wang, X.: Autonomous Mobile Robot Visual SLAM Based on Improved CNN Method. IOP Conf. Ser. Mater. Sci. Eng. 466(1), 012114 (2018)

    Article  Google Scholar 

  6. Chollet F.: Xception: Deep Learning with Depthwise Separable Convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.1251–1258, IEEE, Hawaii (2017)

    Google Scholar 

  7. Embedded Linux Wiki. Jetson TK1, http://elinux.org/Jetson_TK1

  8. Chang, Y., Chung, P.: Deep learning for object identification in ROS-based mobile robots. In: 2018 IEEE International Conference on Applied System Innovation (ICASI), pp. 66–69. IEEE, Chiba (2018)

    Google Scholar 

  9. Zhang, Y., Bi, S.: The implementation of CNN-based object detector on ARM embedded platforms. In: 2018 IEEE 16th International Conference on Dependable, Autonomic and Secure Computing, 16th International Conference on Pervasive Intelligence and Computing, 4th International Conference on Big Data Intelligence and Computing and Cyber Science and Technology Congress (DASC/PiCom/DataCom/CyberSciTech), pp. 379−382. IEEE, Athens (2018)

    Google Scholar 

  10. Girshick, R.: Region-based convolutional networks for accurate object detection and segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 38(1), 142–158 (2016)

    Article  Google Scholar 

  11. Girshick, R.: Fast R-CNN. In: IEEE International Conference on Computer Vision (ICCV), pp. 1440–1448, IEEE, Santiago (2015)

    Google Scholar 

  12. Simonyan, K., Zisserman, A.: Very Deep Convolutional Networks for Large-Scale Image Recognition. In: Neural Information Processing Systems (NIPS), Montréal (2015)

    Google Scholar 

  13. Xianbao, C., Guihua, Q., Yu, J., Zhaomin, Z.: An improved small object detection method based on Yolo V3. Pattern Anal. Appl. 24(3), 1347–1355 (2021). https://doi.org/10.1007/s10044-021-00989-7

    Article  Google Scholar 

  14. Yang, W., Zhang, W.: Real-time Traffic Signs Detection Based on YOLO Network Model. In: 2020 International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery (CyberC), pp. 354–357, IEEE, Chongqing (2020)

    Google Scholar 

  15. Xie, X., Han, X.: Visualization and Pruning of SSD with the base network VGG16. In: International Conference on Deep Learning Technologies. ACM, Chengdu (2017)

    Google Scholar 

  16. Urtasun, R., Lenz, P.: Are we ready for autonomous driving? The KITTI vision benchmark suite. In: IEEE Conference on Computer Vision & Pattern Recognition, pp. 3354–3361, IEEE, Providence (2012)

    Google Scholar 

  17. Hartigan, J.A.: Algorithm AS 136: a K-means clustering algorithm. J. Roy. Stat. Soc. 28(1), 100–108 (1979)

    MATH  Google Scholar 

  18. Zhang, F.: Vehicle detection in urban traffic surveillance images based on convolutional neural networks with feature concatenation. Sensors 19(3), 594 (2019)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Min Li .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Wang, G., Song, Q., Li, T., Li, M. (2022). Fast On-Road Object Detector on ROS-Based Mobile Robot. In: Lai, Y., Wang, T., Jiang, M., Xu, G., Liang, W., Castiglione, A. (eds) Algorithms and Architectures for Parallel Processing. ICA3PP 2021. Lecture Notes in Computer Science(), vol 13156. Springer, Cham. https://doi.org/10.1007/978-3-030-95388-1_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-95388-1_7

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-95387-4

  • Online ISBN: 978-3-030-95388-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics