Skip to main content
SpringerLink
Log in

Video-Based Driver Assistance--From Basic Functions to Applications

  • Published:
International Journal of Computer Vision Aims and scope Submit manuscript

Abstract

Image sequences recorded with cameras mounted in a moving vehicle provide information about the vehicle's environment which has to be analysed in order to really support the driver in actual traffic situations. One type of information is the lane structure surrounding a vehicle. Therefore, we systematically developed and investigated driver assistance functions which make explicit use of the lane structure represented by lane borders and lane markings. With increasing computing power of standard PCs it was possible to realize more complex driver assistance with general purpose hardware. Investigations with a video-based lane departure warning system and a lane change assistant for highways will be discussed in detail.

We integrated our lane keeping assistant in some experimental cars and performed systematic experiments in real traffic situations which enables the experience of video-based driver assistance on a high level--the action of a system. This allows us to assess whether a driver assistance system really understands the actual traffic situation which is the basis for reliable systems accepted by the user.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Batavia, P.H., Pomerleau, D.A., and Thorpe, C.E. 1998. Predicting lane position for roadway departure prevention. IEEE International Conference on Intelligent Vehicles. Oct. 28–30, Stuttgart, Germany, Vol. 1, pp. 5–10.

    Google Scholar 

  • Beucher, S. and Bilodeau, M. 1994. Road segmentation and obstacle detection by a fast watershed transformation. '94 Symposium, Oct. 24–26, 1994, Paris, France, pp. 296–301.

  • Carlsson, S. and Eklundh, J.-O. 1990. Object detection using model based prediction and motion parallax. '90, Antibes, France, April 23–27, 1990, O. Faugeras (Ed.). Lecture Notes in Computer Science, 427, Springer-Verlag: Berlin, pp. 297–306.

    Google Scholar 

  • Crisman, J.D. and Thorpe, C.E. 1993. SCARF: A color vision system that tracks roads and intersections. IEEE Transactions on Robotics and Automation, 9:49–58.

    Google Scholar 

  • Dickmanns, E.D., Behringer, R., Dickmanns, D., Hildebrandt, T., Maurer, M., Thomanek, F., and Schiehlen, J. 1994. The seeing passenger car ‘VaMoRs-P’. '94 Symposium, Oct. 24–26, 1994, Paris, France, pp. 68–73.

  • Dickmanns, E.D. and Graefe, V. 1988. Dynamic monocular machine vision and applications of dynamic monocular machine vision. Int. Journal of Machine Vision and Application, 1:223–240 and 241–261.

    Google Scholar 

  • Dickmanns, E.D. and Mysliwetz, B. 1992. Recursive 3D road and relative ego-state recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, PAMI-14:199–214.

    Article  Google Scholar 

  • Enkelmann, W. 1997. Entwicklung von Systemen zur Interpretation von Straβenverkehrsszenen durch Bildfolgenauswertung. Habilitation, Fakultät für Informatik, Universität Karlsruhe (TH), Juli 1996. Infix-Verlag, Sankt Augustin.

    Google Scholar 

  • Enkelmann, W., Struck, G., and Geisler, J. 1995. ROMA--A system for model based analysis of road markings. '95 Symposium, Sept. 25–26, 1995, Detroit/MI, pp. 356–360.

  • Fairclough, S.H. 1997. Monitoring driver fatigue via driving performance. In Ergonomics and Safety of Intelligent Driver Interfaces, Y.I. Noy (Ed.). Lawrence Erlbaum Associates, pp. 363–379.

  • Gengenbach, V., Nagel, H.-H., Heimes, F., Struck, G., and Kollnig, H. 1995. Model-based recognition of intersections and lane structures. '95 Symposium, Sept. 25–26, Detroit/MI, pp. 512–517.

  • Gengenbach, V., Palmer, M., and Ringshauser, H. 1995.MiniVISTA--Ein echtzeitfähiges Bildauswertungssystem zum Einsatz in autonomen Fahrzeugen und an Robotern. Mitteilungen aus dem Fraunhofer-Institut für Informations-und Datenverarbeitung, IITB Karlsruhe, pp. 53–60.

  • Hahn, S. 1993. Switching between autonomous and conventional car driving--A simulator study. '93 Symposium, July 14–16, 1993, Tokyo, Japan, pp. 25–30.

  • Heimes, F. 2000. Sichtsystemgestützte Fahrerassistenz im innerst ädtischen Straßenverkehr. Dissertation, Fakultät für Informatik, Universität Karlsruhe (TH), Juli 2000. Erschienen in Dissertationen zur Künstlichen Intelligenz DISKI 243, Sankt Augustin, Infix 2000.

  • Heimes, F., Fleischer, K., and Nagel, H.-H. 2000. Automatic generation of intersection models from digital maps for vision-based driving on innercity intersections. IEEE Intelligent Vehicles Symposium, IV 2000, Oct. 3–5, 2000, Dearborn/MI, pp. 498–503.

  • Juberts, M., Raviv, D., and Bishop, Jr., J. 1993. Autonomous road following: A vision-based approach for AVCS. IAS-3, Int. Conference on Intelligent Autonomous Systems, Feb. 15–18, 1993, Pittsburgh/PA, USA, F.C.A. Groen, S. Hirose, and C.E. Thorpe (Eds.), IOS Press: Washington, pp. 135–144.

    Google Scholar 

  • Kovács, G., Bokor, J., Palkovics, L., Gianone, L., Semsey, Á., and Széll, P. 1998. Lane-departure detection and control system for commercial vehicles. IEEE International Conference on Intelligent Vehicles, Oct. 28–30, Stuttgart, Germany, pp. 46–50.

  • Kreucher, C., Lakshmanan, S., and Kluge, K. 1998. A driver warning system based on the LOIS lane detection algorithm. IEEE International Conference on Intelligent Vehicles, Oct. 28–30, Stuttgart, Germany, pp. 17–22.

  • Krüger, W. 1999. Robust real-time ground plane motion compensation from amoving vehicle. Machine Vision and Applications, MV & A, 11:203–212.

    Google Scholar 

  • LeBlanc, D.J., Johnson, G.E., Venhovens, P.J., Gerber, G., Sonia, R.D., Ervin, R.D., Lin, C.-F., Ulsoy, A.G., and Pilutti, T.E. 1996. CAPC: A road departure prevention system. IEEE Control Systems Magazine, 16:61–71.

    Google Scholar 

  • Luong, Q.-T., Weber, J., Koller, D., and Malik, J. 1995. An integrated stereo-based approach to automatic vehicle guidance. '95, June 20–23, 1995, Cambridge/MA, IEEE Computer Society Press: Los Alamitos/CA, pp. 52–57.

    Google Scholar 

  • Nagel, H.-H. and Enkelmann, W. 1991. Generic road traffic situations and driver support systems. In Proc. 5th PROMETHEUS Workshop, Munich/Germany, Oct. 15–16, pp. 76–85.

  • Nagel, H.-H., Enkelmann, W., and Struck, G. 1995. FhG-Co-driver: From map-guided automatic driving by machine vision to a cooperative driver support. Special Issue on Network, Control, Communication and Computing Technologies for Intelligent Transportation Systems, S.M. Amin, A. Garcia-Ortiz, and J.R. Wootton (Eds.). Mathematical and Computer Modelling, 22(4–7):185–212.

  • Onken, R. 1994. DAISY, an adaptive, knowledge-based driver monitoring and warning system. '94 Symposium, Oct. 24–26, 1994, Paris, France, pp. 544–549.

  • Paul, D., Hättich, W., Nill, W., Tatari, S., and Winkler, G. 1988.VISTA: Visual interpretation system for technical applications-Architecture and use. IEEE Transactions on Pattern Analysis and Machine Intelligence, PAMI-10:399–407.

    Google Scholar 

  • Renner, G. and Mehring, S. 1997. Lane departure and drowsiness-- Two major accident causes--One safety system. 4th World Congress on Intelligent Transport Systems, CD-ROM.

  • Richardson, J., Fairclough, S.H., and Fletcher, S. 1997. Driver fatigue: An experimental investigation. In Ergonomics and Safety of Intelligent Driver Interfaces, Y.I. Noy (Ed.). Lawrence Erlbaum Associates, pp. 329–343.

  • Risack, R., Klausmann, P., Krüger, W., and Enkelmann, W. 1998.Robust lane recognition embedded in a real-time driver assistance system. IEEE International Conference on Intelligent Vehicles, Oct. 28–30, Stuttgart, Germany, Vol. 1, pp. 35–40.

    Google Scholar 

  • Risack, R., Möhler, N., and Enkelmann, W. 2000. A video-based lane keeping assistant. IEEE Intelligent Vehicles Symposium, IV 2000, Oct. 3–5, 2000, Dearborn/MI, pp. 356–361.

  • Schneiderman, H. and Nashman, M. 1994. A discriminating feature tracker for vision-based autonomous driving. IEEE Transaction on Robotics and Automation, 10:769–775.

    Google Scholar 

  • Siegmund, G.P., King, D.J., and Mumford, D.K. 1996. Correlation of steering behaviour with heavy-truck driver fatigue. Sensors, Safety Systems and Human Factors, pp. 17–38.

  • Taylor, C.G., Koscecka, J., Blasi, R., and Malik, J. 1999. A comparative study of vision-based lateral control strategies for autonomous highway driving. International Journal of Robotics Research, 18:442–453.

    Google Scholar 

  • Tölle, W. 1996. Ein Fahrmanöverkonzept für einen maschinellen Kopiloten. Fortschritt-Berichte VDI, Reihe 12: Verkehrstechnik/ Fahrzeugtechnik, Nr. 299. VDI-Verlag, Düsseldorf, 1996.

  • Ulmer, B. 1994. VITA II--Active collision avoidance in real traf-fic. '94 Symposium, Oct. 24–26, 1994, Paris, France, pp. 1–6.

  • Willersinn, D. and Enkelmann, W. 1997. Robust obstacle detection and tracking by motion analysis. IEEE Conference on Intelligent Transportation Systems ITSC'97, Boston/MA, November 9–12, 1997, pp. 719–722.

  • Zhang, J. and Nagel, H.-H. 1994. Texture-based segmentation of road images. '94 Symposium, Oct. 24–26, 1994, Paris, France, pp. 260–265.

Download references

Author information

Authors and Affiliations

  1. Fraunhofer-Institut für Informations- und Datenverarbeitung (IITB), Fraunhoferstr. 1, D-76131, Karlsruhe, Germany

    Wilfried Enkelmann

Authors
  1. Wilfried Enkelmann
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Enkelmann, W. Video-Based Driver Assistance--From Basic Functions to Applications. International Journal of Computer Vision 45, 201–221 (2001). https://doi.org/10.1023/A:1013658100226

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1013658100226

Search

Navigation