Abstract
The application environment of mobile robot is gradually expanding from indoor to outdoor. Vision-based detection, which acquires traffic information through the camera, is a state-of-the-art auxiliary technology. In this paper, a robotic middleware Robot Operating System (ROS) is applied to detect object and control application based on embedded processor. And, we present an effective On-road object detector which is suitable for embedded GPU by improving the performance of Single Shot MultiBox Detector (SSD). Our approach is to construct detection network by using depth-wise separable convolution for saving computing resource and present multi-category clustering to adjust the generated default boxes for optimizing accuracy. Experiments on KITTI dataset show that the proposed network runs 2.1 times faster than original SSD network on embedded GPU and maintains 71% mean average precision. Finally, a mobile robot is designed based on the detector and controller to demonstrate On-road assisted driving intuitively.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Liu, W., et al.: SSD: single shot multibox detector. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9905, pp. 21–37. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46448-0_2
Ren, S., He, K.: Faster R-CNN: towards real-time object detection with region proposal networks. In: Cortes, C., Lee, D.D. (eds.) International Conference on Neural Information Processing Systems, vol. 1, pp. 91–99. MIT Press, Montreal (2015)
Quigley, M., Gerkey, B., Smart, W.D.: Programming Robots with ROS: A Practical Introduction to the Robot Operating System, 1st edn. O’Reilly Media, Sebastopol (2015)
He, K., Ma, X.: Real-time monitoring for the mining robot based on an improved SIFT matching algorithm. In: 2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI), pp. 1–5. IEEE, Shanghai (2015)
Wang, X.: Autonomous Mobile Robot Visual SLAM Based on Improved CNN Method. IOP Conf. Ser. Mater. Sci. Eng. 466(1), 012114 (2018)
Chollet F.: Xception: Deep Learning with Depthwise Separable Convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.1251–1258, IEEE, Hawaii (2017)
Embedded Linux Wiki. Jetson TK1, http://elinux.org/Jetson_TK1
Chang, Y., Chung, P.: Deep learning for object identification in ROS-based mobile robots. In: 2018 IEEE International Conference on Applied System Innovation (ICASI), pp. 66–69. IEEE, Chiba (2018)
Zhang, Y., Bi, S.: The implementation of CNN-based object detector on ARM embedded platforms. In: 2018 IEEE 16th International Conference on Dependable, Autonomic and Secure Computing, 16th International Conference on Pervasive Intelligence and Computing, 4th International Conference on Big Data Intelligence and Computing and Cyber Science and Technology Congress (DASC/PiCom/DataCom/CyberSciTech), pp. 379−382. IEEE, Athens (2018)
Girshick, R.: Region-based convolutional networks for accurate object detection and segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 38(1), 142–158 (2016)
Girshick, R.: Fast R-CNN. In: IEEE International Conference on Computer Vision (ICCV), pp. 1440–1448, IEEE, Santiago (2015)
Simonyan, K., Zisserman, A.: Very Deep Convolutional Networks for Large-Scale Image Recognition. In: Neural Information Processing Systems (NIPS), Montréal (2015)
Xianbao, C., Guihua, Q., Yu, J., Zhaomin, Z.: An improved small object detection method based on Yolo V3. Pattern Anal. Appl. 24(3), 1347–1355 (2021). https://doi.org/10.1007/s10044-021-00989-7
Yang, W., Zhang, W.: Real-time Traffic Signs Detection Based on YOLO Network Model. In: 2020 International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery (CyberC), pp. 354–357, IEEE, Chongqing (2020)
Xie, X., Han, X.: Visualization and Pruning of SSD with the base network VGG16. In: International Conference on Deep Learning Technologies. ACM, Chengdu (2017)
Urtasun, R., Lenz, P.: Are we ready for autonomous driving? The KITTI vision benchmark suite. In: IEEE Conference on Computer Vision & Pattern Recognition, pp. 3354–3361, IEEE, Providence (2012)
Hartigan, J.A.: Algorithm AS 136: a K-means clustering algorithm. J. Roy. Stat. Soc. 28(1), 100–108 (1979)
Zhang, F.: Vehicle detection in urban traffic surveillance images based on convolutional neural networks with feature concatenation. Sensors 19(3), 594 (2019)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 Springer Nature Switzerland AG
About this paper
Cite this paper
Wang, G., Song, Q., Li, T., Li, M. (2022). Fast On-Road Object Detector on ROS-Based Mobile Robot. In: Lai, Y., Wang, T., Jiang, M., Xu, G., Liang, W., Castiglione, A. (eds) Algorithms and Architectures for Parallel Processing. ICA3PP 2021. Lecture Notes in Computer Science(), vol 13156. Springer, Cham. https://doi.org/10.1007/978-3-030-95388-1_7
Download citation
DOI: https://doi.org/10.1007/978-3-030-95388-1_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-95387-4
Online ISBN: 978-3-030-95388-1
eBook Packages: Computer ScienceComputer Science (R0)