Skip to main content
SpringerLink
Log in

Real-time obstacle detection with motion features using monocular vision

  • Original Article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

Real-time obstacle detection by monocular vision is a challenging problem in autonomous navigation of vehicles and driver-assistance systems. In this paper, we introduce an approach of real-time obstacle detection which can effectively tell apart obstacles from shadows and road surface markings. We propose the followings: (1) a two consecutive frames (TCF) model to find the differences between obstacles and the ground plane by motion features; (2) a filter to increase probabilities of obstacle regions; (3) an updating process to reduce false positives and update the algorithm when the vehicle moves on. We perform experiments on two datasets and our autonomous vehicle. The results show that our method is effective in various conditions and meets the real-time requirement.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

References

  1. Labayrade, R., Aubert, D., Tarel, J.P.: Real time obstacle detection in stereovision on non flat road geometry through. Intell. Veh. Symp. 2, 646–651 (2002)

    Google Scholar 

  2. Broggi, A., Caraffi, C., Fedriga, R. I., et al.: Obstacle detection with stereo vision for off-road vehicle navigation. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Workshops, pp. 65–65 (2005)

  3. Turk, M.A., Marra, M.: Color road segmentation and video obstacle detection. In: Cambridge Symposium Intelligent Robotics Systems. International Society for Optics and Photonics, pp. 136–142 (1987)

  4. Alvarez, J.M., Gevers, T., LeCun, Y., et al.: Road scene segmentation from a single image. In: Computer VisionCECCV. Springer, pp. 376–389 (2012)

  5. Kuhnl, T., Kummert, F.: Fritsch J, pp. 800–806. Monocular road segmentation using slow feature analysis. In: Intelligent Vehicles Symposium (IV) (2011)

  6. Braillon, C., Pradalier, C., Crowley, J.L. et al.: Real-time moving obstacle detection using optical flow models. In: Intelligent Vehicles Symposium, pp. 466–471 (2006)

  7. Jung, B., Sukhatme, G.S.: Real-time motion tracking from a mobile robot. Int. J. Soc. Robot. 2(1), 63–78 (2010)

    Article  Google Scholar 

  8. Crespo, J.L., Zorrilla, M., Bernardos, P., et al.: Moving objects forecast in image sequences using autoregressive algorithms. Vis. Comput. 25(4), 309–323 (2009)

    Article  Google Scholar 

  9. Erhan, I.: Measuring traffic flow and classifying vehicle types: a surveillance video based approach. Turk. J. Electr. Eng. Comput. Sci. 19, 607–620 (2011)

    Google Scholar 

  10. Edgar, M.: http://www.metanamorph.com

  11. Bergen, J.R., Anandan, P., Hanna, K.J., et al.: Hierarchical model-based motion estimation. In: Computer Vision-ECCV. Springer, pp. 237–252 (1992)

  12. Goldman, R.N.: More matrices and transformations: shear and pseudo-perspective. Gr. Gems II, 338–341 (1991)

    Article  Google Scholar 

  13. Geiger, A., Lenz, P., Urtasun, R.: Are we ready for autonomous driving? The KITTI vision benchmark suite. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3354–3361 (2012)

  14. Geiger, A., Lenz, P., Stiller, C., et al.: Vision meets Robotics: The KITTI Dataset

  15. Brostow, G.J., Fauqueur, J., Cipolla, R.: Semantic object classes in video: a high-definition ground truth database. Pattern Recognit. Lett. 30(2), 88–97 (2009)

    Article  Google Scholar 

  16. Straforini, M., Coelho, C., Campani, M.: Extraction of vanishing points from images of indoor and outdoor scenes. Image Vis. Comput. 11(2), 91–99 (1993)

    Article  Google Scholar 

  17. Kong, H., Audibert, J.Y., Ponce, J.: Vanishing point detection for road detection. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2009, pp. 96–103 (2009)

  18. Bosse, M., Rikoski, R., Leonard, J., et al.: Vanishing points and three-dimensional lines from omni-directional video. Vis. Comput. 19(6), 417–430 (2003)

    Article  Google Scholar 

  19. Tomasi, C., Kanade, T.: Detection and tracking of point features. Carnegie Mellon Univ, School of Computer Science (1991)

  20. Shi, J., Tomasi, C.: Good features to track. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 593–600 (1994)

  21. Bouguet, J.Y., Pyramidal implementation of the affine lucas kanade feature tracker description of the algorithm. Intel Corporation (2001)

Download references

Acknowledgments

This research was supported by the “Strategic Priority Research Program-Network Video Communication and Control” of the Chinese Academy of Sciences (Grant No. XDA06030900), and by the Applications & Demonstrations of New Complex Forms of TV Business (Grant No.2012BAH73F02).

Author information

Authors and Affiliations

  1. University of Science and Technology of China, Hefei, Anhui, 230026, People’s Republic of China

    Baozhi Jia, Rui Liu & Ming Zhu

Authors
  1. Baozhi Jia
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Rui Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ming Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Baozhi Jia.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Jia, B., Liu, R. & Zhu, M. Real-time obstacle detection with motion features using monocular vision. Vis Comput 31, 281–293 (2015). https://doi.org/10.1007/s00371-014-0918-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-014-0918-5

Keywords

Search

Navigation