Abstract
A new computer vision strategy is developed by using the Vanishing Point from camera frames for lateral control. A vehicle kinematic model is derived based on a tricycle in order to analyze the system states in the control strategy. The roots loci of the system are analyzed to understand the influence of each state in the closed-loop. On each frame, two system states are extracted from the lane lines in the perspective view by using a vanishing point-based technique with the inverse perspective mapping. A state feedback controller is developed, and computational simulations are carried out in a Blender environment using a small car model. The validation of the proposed Vanishing Point technique is carried out by several computational simulations, which also confirm the effects of each state in the final controlled system response.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Alon, Y., Ferencz, A., & Shashua, A. (2006). Off-road path following using region classification and geometric projection constraints. In 2006 IEEE computer society conference on computer vision and pattern recognition (CVPR’06), New York, NY, USA, 2006 (pp. 689–696).
Aly, M. (2008) Real time detection of lane markers in urban streets. In 2008 IEEE intelligent vehicles symposium. IEEE.
Ballard, D. H. (1981). Generalizing the Hough transform to detect arbitrary shapes. Pattern Recognition, 13(2), 111–122.
Bergen, J. R., & Shvaytser, H. (1991). A probabilistic algorithm for computing Hough transforms. Journal of Algorithms, 12(4), 639–656.
Bertozzi, M., & Broggi, A. (1998). GOLD: A parallel real-time stereo vision system for generic obstacle and lane detection. IEEE Transactions on Image Processing, 7(1), 62–81.
Borkar, A., Monson, H., & Smith, M. T. (2009). Robust lane detection and tracking with Ransac and Kalman filter. In 2009 16th IEEE international conference on image processing (ICIP). IEEE .
Broggi, A. (1995). Robust real-time lane and road detection in critical shadow conditions. In Proceedings of international symposium on computer vision (ISCV), Coral Gables, FL, USA, 1995 (pp 353–358).
Dalai, F., & Pan, M. (2013). Game development with blender.
Hillel, A. B., et al. (2014). Recent progress in road and lane detection: A survey. Machine Vision and Applications, 25(3), 727–745.
Hua, L., Feng, M., & Wang, X. (2012). Inverse perspective mapping based urban road markings detection. In 2012 IEEE 2nd international conference on cloud computing and intelligence systems (Vol. 3). IEEE.
Jiang, R., et al. (2009). New lane model and distance transform for lane detection and tracking. Springer, Berlin: In International conference on computer analysis of images and patterns.
Kang, C. M., et al. (2015). Lateral control for autonomous lane keeping system on highways. In 2015 15th international conference on control, automation and systems (ICCAS), Busan (pp 1728–1733).
Karl, K. (1994). Extracting road curvature and orientation from image edge points without perceptual grouping into features. In Proceedings of the intelligent vehicles’ 94 symposium. IEEE.
Kong, H., Audibert, J., & Ponce, J. (2009). Vanishing point detection for road detection. In 2009 IEEE conference on computer vision and pattern recognition, Miami, FL, 2009 (pp. 96–103).
Lipski, C., et al. (2008) A fast and robust approach to lane marking detection and lane tracking. In 2008 IEEE southwest symposium on image analysis and interpretation. IEEE.
McCall, J. C., & Trivedi, M. M. (2006). Video-based lane estimation and tracking for driver assistance: Survey, system, and evaluation. IEEE Transactions on Intelligent Transportation Systems, 7, 20–37.
Muad, A. M., et al. (2004). Implementation of inverse perspective mapping algorithm for the development of an automatic lane tracking system. In 2004 IEEE region 10 conference TENCON 2004. IEEE.
Rosenbrook, H. H. (1963). The stability of linear time-dependent control systems. International Journal of Electronics, 15(1), 73–80.
Schuster, R., Ansari, N., & Bani-Hashemi, A. (1993). Steering a robot with vanishing points. IEEE Transactions on Robotics and Automation, 9(4), 491–498.
Seo, Y.-W., & Hwangbo, M. (2015). A computer vision system for lateral localization. Journal of Field Robotics, 32, 1004–1014.
Taylor, C. J., KoSeckd, J., Blasi, R., & Malik, J. (1999). A comparative study of vision-based lateral control strategies for autonomous highway driving. The International Journal of Robotics Research, 18(5), 442–453.
Terrell, W. J. (2009). Stability and stabilization: An introduction. New Jersy: Princeton University Press.
Thuilot, B., et al. (2002). Automatic guidance of a farm tractor relying on a single CP-DGPS. Autonomous Robots, 13(1), 53–71.
Tunçer, Ö., Güvenç, L. , Coşkun, F., & Karsligil, E., (2010). Vision based lane keeping assistance control triggered by a driver inattention monitor. In 2010 IEEE international conference on systems, man and cybernetics, Istanbul (pp. 289–297).
Yue, W., Shen, D., & Teoh, E. K. (2000). Lane detection using spline model. Pattern Recognition Letters, 21(8), 677–689.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Nagy, T.K., Costa, E.C.M. Development of a lane keeping steering control by using camera vanishing point strategy. Multidim Syst Sign Process 32, 845–861 (2021). https://doi.org/10.1007/s11045-021-00763-2
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11045-021-00763-2