Skip to main content
Log in

Vision-based approach towards lane line detection and vehicle localization

  • Original Paper
  • Published:
Machine Vision and Applications Aims and scope Submit manuscript

Abstract

Localization of the vehicle with respect to road lanes plays a critical role in the advances of making the vehicle fully autonomous. Vision based road lane line detection provides a feasible and low cost solution as the vehicle pose can be derived from the detection. While good progress has been made, the road lane line detection has remained an open one, given challenging road appearances with shadows, varying lighting conditions, worn-out lane lines etc. In this paper, we propose a more robust vision-based approach with respect to these challenges. The approach incorporates four key steps. Lane line pixels are first pooled with a ridge detector. An effective noise filtering mechanism will next remove noise pixels to a large extent. A modified version of sequential RANdom Sample Consensus) is then adopted in a model fitting procedure to ensure each lane line in the image is captured correctly. Finally, if lane lines on both sides of the road exist, a parallelism reinforcement technique is imposed to improve the model accuracy. The results obtained show that the proposed approach is able to detect the lane lines accurately and at a high success rate compared to current approaches. The model derived from the lane line detection is capable of generating precise and consistent vehicle localization information with respect to road lane lines, including road geometry, vehicle position and orientation.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23
Fig. 24
Fig. 25
Fig. 26
Fig. 27

Similar content being viewed by others

References

  1. Aufrere, R., Chapuis, R., Chausse, F.: A model-driven approach for real-time road recognition. Mach. Vis. Appl. 13(2), 95–107 (2001)

    Article  Google Scholar 

  2. Borkar, A., Hayes, M., Smith, M.T.: A novel lane detection system with efficient ground truth generation. Intell. Transp. Syst. IEEE Trans. 13(1), 365–374 (2012)

    Article  Google Scholar 

  3. Bouguet, J.Y.: Camera calibration toolbox for matlab. (2010-07). http://www.vision.caltech.edu/bouguetj/calib_doc/

  4. Danescu, R., Nedevschi, S.: Probabilistic lane tracking in difficult road scenarios using stereovision. Intell. Transp. Syst. IEEE Trans. 10(2), 272–282 (2009)

    Article  Google Scholar 

  5. David, F., Scharstein, D.: Multi-model estimation in the presence of outliers. Master’s thesis, Middlebury College (2011)

  6. Fritsch, J., Kuhnl, T., Kummert, F.: Monocular road terrain detection by combining visual and spatial information. Intell. Transp. Syst. IEEE Trans. 15(4), 1586–1596 (2014)

    Article  Google Scholar 

  7. Gopalan, R., Hong, T., Shneier, M., Chellappa, R.: A learning approach towards detection and tracking of lane markings. Intell. Transp. Syst. IEEE Trans. 13(3), 1088–1098 (2012)

    Article  Google Scholar 

  8. Guiducci, A.: Parametric model of the perspective projection of a road with applications to lane keeping and 3d road reconstruction. Comput. Vis. Image Underst. 73(3), 414–427 (1999)

    Article  MATH  Google Scholar 

  9. Gyory, G.: Obstacle detection methods for stereo vision as driving aid. In: Advanced Robotics, 2003. International Conference on, IEEE, pp. 477–481 (2003)

  10. Hillel, A.B., Lerner, R., Levi, D., Raz, G.: Recent progress in road and lane detection: a survey. Mach. Vis. Appl. 25(3), 727–745 (2014)

    Article  Google Scholar 

  11. Kang, D.J., Jung, M.H.: Road lane segmentation using dynamic programming for active safety vehicles. Pattern Recogn. Lett. 24(16), 3177–3185 (2003)

    Article  Google Scholar 

  12. Kim, Z.: Robust lane detection and tracking in challenging scenarios. Intell. Transp. Syst. IEEE Trans. 9(1), 16–26 (2008)

    Article  Google Scholar 

  13. Li, H., Nashashibi, F.: Robust real-time lane detection based on lane mark segment features and general a priori knowledge. In: Robotics and Biomimetics (ROBIO), 2011 IEEE International Conference on, IEEE, pp. 812–817 (2011)

  14. Li, Q., Zheng, N., Cheng, H.: An adaptive approach to lane markings detection. In: Intelligent transportation systems, 2003. Proceedings., IEEE, vol. 1, pp. 510–514 (2003)

  15. Liu, W., Zhang, H., Duan, B., Yuan, H., Zhao, H.: Vision-based real-time lane marking detection and tracking. In: Intelligent transportation systems, 2008. ITSC 2008. 11th International IEEE Conference on, IEEE, pp. 49–54 (2008)

  16. López, A., Serrat, J., Canero, C., Lumbreras, F., Graf, T.: Robust lane markings detection and road geometry computation. Int. J. Autom. Technol. 11(3), 395–407 (2010)

    Article  Google Scholar 

  17. McCall, J.C., Trivedi, M.M.: Video-based lane estimation and tracking for driver assistance: survey, system, and evaluation. Intell. Transp. Syst. IEEE Trans. 7(1), 20–37 (2006)

    Article  Google Scholar 

  18. Nedevschi, S., Schmidt, R., Graf, T., Danescu, R., Frentiu, D., Marita, T., Oniga, F., Pocol, C.: 3d lane detection system based on stereovision. In: Intelligent transportation systems, 2004. Proceedings. The 7th International IEEE Conference on, IEEE, pp. 161–166 (2004)

  19. Press, W.H.: Numerical recipes in Fortran 77: the art of scientific computing, vol. 1. Cambridge University Press (1992)

  20. Sampson, P.D.: Fitting conic sections to very scattered data: an iterative refinement of the bookstein algorithm. Comput. Graph. Image Process. 18(1), 97–108 (1982)

    Article  Google Scholar 

  21. Sivaraman, S., Trivedi, M.M.: Integrated lane and vehicle detection, localization, and tracking: a synergistic approach. Intell. Transp. Syst. IEEE Trans. 14(2), 906–917 (2013)

    Article  Google Scholar 

  22. Sun, T.Y., Tsai, S.J., Chan, V.: Hsi color model based lane-marking detection. In: Intelligent transportation systems conference, ITSC’06. IEEE, pp. 1168–1172 (2006)

  23. Tapia-Espinoza, R., Torres-Torriti, M.: A comparison of gradient versus color and texture analysis for lane detection and tracking. In: Robotics symposium (LARS), 2009 6th Latin American, IEEE, pp. 1–6 (2009)

  24. Thorpe, C., Hebert, M.H., Kanade, T., Shafer, S.A.: Vision and navigation for the carnegie-mellon navlab. Pattern Anal. Mach. Intell. IEEE Trans. 10(3), 362–373 (1988)

    Article  Google Scholar 

  25. Wang, J., Schroedl, S., Mezger, K., Ortloff, R., Joos, A., Passegger, T.: Lane keeping based on location technology. Intell. Transp. Syst. IEEE Trans. 6(3), 351–356 (2005)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Xinxin Du.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (mp4 5717 KB)

Supplementary material 2 (mp4 5705 KB)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Du, X., Tan, K.K. Vision-based approach towards lane line detection and vehicle localization. Machine Vision and Applications 27, 175–191 (2016). https://doi.org/10.1007/s00138-015-0735-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00138-015-0735-5

Keywords

Navigation