Skip to main content
SpringerLink
Log in

Towards Active Machine-Vision-Based Driver Assistance for Urban Areas

  • Published:
International Journal of Computer Vision Aims and scope Submit manuscript

Abstract

Currently available driver assistance systems (i) warn the driver based on vehicle state sensors (e.g., door open, outside temperature near or below the freezing point), (ii) offer route guidance information (navigation systems based on GPS and digital road maps), or—in some critical situations—(iii) even actively influence vehicle handling under carefully delimited conditions (anti-blocking-system, electronic-stability-program).

This contribution reports about investigations to combine passive GPS- and map-based route guidance with model-based machine vision in order to automatically assess or even execute driving maneuvers in inner-city traffic situations. Information provided by todays route guidance systems is treated as a generic description of lane structure. The schematic description of lane structures extractable from commercially available standard digital maps is automatically instantiated by a machine vision approach which interprets video image sequences recorded by cameras from within a driving vehicle. The resulting model of the lane structure in front of the vehicle is subsequently exploited in order to control vehicle maneuvers in real-time as a proof of principal system competences. The machine-vision-based execution of driving maneuvers can at any time be overridden by the driver.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Bar-Shalom, Y. and Fortmann, T.E. 1988. Tracking and Data Association. Academic Press, Orlando/FL.

    Google Scholar 

  • Batavia, P.H. 2000. Carnegie Mellon AHS group. The Robotics Institute, Carnegie Mellon University, 5000 Forbes Avenue, Pittsburgh/PA, 15213-3890. Available http://www.cs.cmu.edu/Groups/ahs/index.html.

    Google Scholar 

  • Batavia, P.H., Pomerleau, D.A., and Thorpe, C.E. 1998. Predicting Lane Position for Roadway Departure Prevention. In IVS 1998, pp. 5–10.

  • Behringer, R. and Müller, N. 1998. Autonomous road vehicle guidance from autobahnen to narrow curves. IEEE Transactions on Robotics and Automation, RA-14(5):810–814.

    Google Scholar 

  • Bertozzi, M., Broggi, A., Conte, G., and Fascioli, A. 1997. Obstacle and lane detection on ARGO. In ITSC 1997, pp. 1010–1015.

  • Bertozzi, M., Broggi, A., and Fascioli, A. 1998a. An extension to the inverse perspective mapping to handle non-flat roads. In IVS 1998, pp. 305–310.

  • Bertozzi, M., Broggi, A., and Fascioli, A. 1998b. Stereo inverse perspective mapping: Theory and applications. Image and Vision Computing, IVC-16(8):585–590.

    Google Scholar 

  • Bertozzi, M., Broggi, A., Fascioli, A., and Nichele, S. 2000. Stereo vision-based vehicle detection. In IVS 2000, pp. 39–44.

  • Bertozzi, M., Broggi, A., Fascioli, A., and Tommesani, S. 1998c. Experiments using MMX-based processors for real-time image processing on the ARGO vehicle. In IVS 1998, pp. 505–510.

  • Dellaert, F., Pomerleau, D.A., and Thorpe, C.E. 1998. Model-based car tracking integrated with a road-follower. In Proc. of the 1998 IEEE Int. Conf. on Robotics and Automation, Leuven/Belgium, 16–20 May 1998, IEEE Computer Society Press Los Alamitos, CA, pp. 1889–1894.

    Google Scholar 

  • Dickmanns, E.D. 1998. Vehicles capable of dynamic vision: A new breed of technical beings ? Artificial Intelligence, AI-103(1/2):49–76.

    Google Scholar 

  • Enkelmann, W. 1997. Entwicklung von Systemen zur Interpretation von Straßenverkehrsszenen durch Bildfolgenauswertung. in-fix Verlag Sankt Augustin, ISBN 3-89601-006-9 (in German).

    Google Scholar 

  • Franke, U. and Joos, A. 2000. Real-time stereo vision for urban traffic scene understanding. In IVS 2000, pp. 273–278.

  • Gavrila, D.M. and Philomin, V. 1999. Real-time object detection for “Smart” vehicles. In Proc. of the 7th Int. Conf. on Computer Vision, Corfu/Greece, 20–27 Sept. 1999, IEEE Computer Society Press Los Alamitos, CA, pp. 87–93.

    Google Scholar 

  • Gengenbach, V., Nagel, H.-H., Heimes, F., Struck, G., and Kollnig, H. 1995. Model-based recognition of intersections and lane structures. In Proc. of the Intelligent Vehicles '95 Symposium, Detroit/MI, 25, 26 Sept. 1995, IEEE Computer Society Press, Los Alamitos, CA, pp. 512–517.

    Google Scholar 

  • Geomatics, 1999. Maps 101—Topographic Maps, The Basics—The Universal Transverse Mercator Grid. Centre for Topographic Information (Ottawa), 615 Booth Street, Room 705, Ottawa/Ontario, Canada, K1A 0E9. Available at http://maps.NRCan.gc.ca/maps101/utm.html.

    Google Scholar 

  • Gilles, L., Fehre, J., and Langheim, J. 1999. Entlastung für den Fahrer. System Partners—Automobiltechnische Zeitschrift, ATZ-101 (Special issue):52–58 (in German).

    Google Scholar 

  • Goldbeck, J., Huertgen, B., Ernst, S., and Kelch, L. 2000. Lane following combining vision and DGPS. Image and Vision Computing, 18(5):425–433.

    Google Scholar 

  • Görzig, S. and Franke, U. 1998. ANTS—Intelligent vision in urban traffic. In IVS 1998, pp. 545–549.

  • Gregor, R. and Dickmanns, E.D. 2000. EMS-vision: Mission performance on road networks. In IVS 2000, pp. 140–145.

  • Gregor, R., Lützeler, M., Pellkofer, M., Siedersberger, K.H., and Dickmanns, E.D. 2000. EMS-Vision: A perceptual system for autonomous vehicles. In IVS 2000, pp. 52–57.

  • Grewal, M.S. and Andrews, A.P. 1993. Kalman Filtering. Prentice-Hall: Upper Saddle River, New Jersey.

    Google Scholar 

  • Haag, M. and Nagel, H.-H. 1999. Combination of edge element and optical flow estimates for 3D-Model-based vehicle tracking in traffic image sequences. International Journal of Computer Vision, 35(3):295–319.

    Google Scholar 

  • Haag, M. and Nagel, H.-H. 2000. Incremental recognition of traffic situations from video image sequences. Image and Vision Computing, IVC-18(2):137–153.

    Google Scholar 

  • Heimes, F. 2000. Sichtsystemgestützte Fahrerassistenz im innerstädtischen Strassenverkehr. Dissertation, Fakultät für Informatik der Universität Karlsruhe (TH), Juli 2000. Published in the series Dissertationen zur Künstlichen Intelligenz, Band DISKI 243, Infix-Verlag: St. Augustin, Germany, 2000 (in German).

    Google Scholar 

  • Heimes, F., Fleischer, K., and Nagel, H.-H. 2000. Automatic generation of intersection models from digital maps for vision-based driving on innercity intersections. In IVS 2000, pp. 498–503.

  • Heimes, F. and Nagel, H.-H. 1998. Real-time tracking of intersections in image sequences of a moving camera. Int. Journal of Engineering Applications of Artificial Intelligence, EAAI-11:215–227. Special Issue on Machine Vision for Intelligent Vehicles and Autonomous Robots.

    Google Scholar 

  • Heimes, F., Nagel, H.-H., and Frank, T. 1998. Model-based tracking of complex inner-city road intersections. Mathematical and Computer Modelling, MCM-27(9–11):189–203. Special issue on Intelligent Transportation Systems—Traffic Sensing and Management.

    Google Scholar 

  • ITSC 1997. In IEEE Conference on Intelligent Transportation Systems, Boston, MA,9–12 Nov. 1997. IEEE Computer Society Press: Los Alamitos, CA.

    Google Scholar 

  • ITSC 2000. In Proceedings of the IEEE Intelligent Transportation Systems Conference 2000, Dearborn, MI, 1–3 Oct. 2000. IEEE Computer Society Press: Los Alamitos, CA.

    Google Scholar 

  • IVS 1993. In Proceedings of the 1993 IEEE International Conference on Intelligent Vehicles, Tokyo, Japan, 14–16 July 1993. IEEE Computer Society Press: Los Alamitos, CA.

    Google Scholar 

  • IVS 1998. In Proceedings of the 1998 IEEE International Conference on Intelligent Vehicles, Stuttgart, 28–30 Oct. 1998. IEEE Computer Society Press: Los Alamitos, CA.

    Google Scholar 

  • IVS 2000. In Proceedings of the IEEE Intelligent Vehicles Symposium 2000, Dearborn, MI, 3–5 Oct. 2000. IEEE Computer Society Press: Los Alamitos, CA.

    Google Scholar 

  • Kluge, K.C. 1997. Performance evaluation of vision-based lane sensing: Some preliminary tools, metrics, and results. In ITSC 1997, pp. 723–728.

  • Korn, A.F. 1988. Toward a symbolic representation of intensity changes in images. IEEE Trans. on Pattern Analysis and Machine Intelligence, PAMI-10(5):610–625.

    Google Scholar 

  • Kreucher, C. and Lakshmanan, S. 1999. LANA: A lane extraction algorithm that uses frequency domain features. IEEE Trans. on Robotics and Automation, RA-15(3):572–577.

    Google Scholar 

  • Kreucher, C., Lakshmanan, S., and Kluge, K.C. 1998. A driver warning system based on the LOIS lane detection algorithm. In IVS 1998, pp. 17–22.

  • Krüger, W. 1999. Robust real-time ground plane motion compensation from a moving vehicle. Machine Vision and Applications, MVA-11:203–212.

    Google Scholar 

  • Lützeler, M. and Dickmanns, E.D. 1998. Road recognition with marveye. In IVS 1998, pp. 341–346.

  • Lützeler, M. and Dickmanns, E.D. 2000. EMS-Vision: Recognition of intersections on unmarked road networks. In IVS 2000, pp. 302–307.

  • Masaki, I. (Ed.). 1992. Vision-Based Vehicle Guidance. Springer-Verlag: Berlin/Heidelberg/New York.

    Google Scholar 

  • Maurer, M. and Dickmanns, E.D. 1997. A system architecture for autonomous visual road vehicle guidance. In ITSC 1997, pp. 578–583.

  • Mück, K., Nagel, H.-H., and Middendorf, M. 2000. Data-driven extraction of curved intersection lanemarks from road traffic image sequences. In Proc. 6th European Conference on Computer Vision, ECCV 2000, Dublin, Ireland, June 26–July 1, 2000, D. Vernon (Ed.) Springer-Verlag: Berlin/Heidelberg/New York, Lecture Notes in Computer Science, Vol. 1843, pp. 411–427.

    Google Scholar 

  • Nagel, H.-H. 1994. A vision of ‘Vision and Language’ comprises action: An example from road traffic. Artificial Intelligence Review, 8:97–122. Special issue on Integrated Natural Language and Vision Processing.

    Google Scholar 

  • Nagel, H.-H. and Enkelmann, W. 1991. Generic road traffic situations and driver support systems. In Proc. 5th PROMETHEUS Workshop, Munich/Germany, 15–16 Oct. 1991, pp. 76–85.

  • Nagel, H.-H., Enkelmann, W., and Struck, G. 1995. FhG-Co-driver: From map-guided automatic driving by machine vision to a cooperative driver support. Mathematical and Computer Modelling—Network, Control, Communication and Computing Technologies for Intelligent Transportation Systems, MCM-22(4–7):185–212.

    Google Scholar 

  • Nagel, H.-H., Heimes, F., Fleischer, K., Haag, M., Leuck, H., and Noltemeier, S. 2000. Quantitative comparison between trajectory estimates obtained from a binocular camera setup within a moving road vehicle and from the outside by a stationary monocular camera. Special issue: Applications of Computer Vision to Intelligent Vehicles, Image and Vision Computing, IVC-18(5):435–444.

    Google Scholar 

  • Nigro, J.M., Loriete-Rougegrez, S., Rombaut, M., and Jarkass, I. 2000. Driving situation recognition in the CASSICE project to-wards an uncertainty management. In ITSC 2000, pp. 71–76.

  • Özgüner, Ü, Baertlein, B., Cavello, C., Farkas, D., Hatipoğlu, C., Lytle, S., Martin, J., Paynter, F., Redmill, K., Schneider, S., Walton, E., and Young, J. 1997. The OSU Demo '97 Vehicle. In ITSC 1997, pp. 502–507.

  • Paetzold, F. and Franke, U. 1998. Road recognition in urban environment. In IVS 1998, pp. 87–91.

  • Paetzold, F. and Franke, U. 2000. Road recognition in urban environment. Special issue: Applications of Computer Vision to Intelligent Vehicles, Image and Vision Computing, IVC-18(5):377–387.

    Google Scholar 

  • Pellkofer, M. and Dickmanns, E.D. 2000. EMS-Vision: Gaze control in autonomous vehicles. In IVS 2000, pp. 296–301.

  • Pomerleau, D.A. 1997. Visibility estimation from a moving vehicle using the RALPH vision system. In ITSC 1997, pp. 906–911.

  • Risack, R., Klausmann, P., Krüger, W., and Enkelmann, W. 1998. Robust lane recognition embedded in a real-time driver assistance system. In IVS 1998, pp. 35–40.

  • Risack, R., Möhler, N., and Enkelmann, W. 2000. A video-based lane keeping assistant. In IVS 2000, pp. 356–361.

  • Rombaut, M. and Saad, F. 2000. CASSICE: Symbolic characterization of driving situation. In ITSC 2000, pp. 77–82.

  • Siedersberger, K.H. and Dickmanns, E.D. 2000. EMS-vision: En-hanced abilities for locomotion. In IVS 2000, pp. 146–151.

  • Struck, G., Geisler, J., Laubenstein, F., Nagel, H.-H., and Siegle, G. 1993. Interaction between digital road map systems and trinocular autonomous driving. In IVS 1993, pp. 461–466.

  • Thorpe, C.E. (Ed.). 1990. Vision and Navigation. Kluwer Academic Publishers: Boston/Dordrecht/London.

    Google Scholar 

  • Thorpe, C.E., Jochem, T.M., and Pomerleau, D.A. 1997. The 1997 automated highway free agent demonstration. In ITSC 1997, pp. 496–501.

  • Winterhagen, J. 1999. Fahrerassistenzsysteme für Nutzfahrzeuge. Automobiltechnische Zeitschrift, ATZ-101(10):820–821 (in German).

    Google Scholar 

  • Zomotor, A. 1987. Fahrwerktechnik: Fahrverhalten. Vogel Buchverlag: Würzburg (in German).

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Fraunhofer-Institut für Informations- und Datenverarbeitung (IITB), Fraunhoferstr. 1, 76131, Karlsruhe, Germany

    F. Heimes

  2. Institut für Algorithmen und Kognitive Systeme, Fakultät für Informatik der Universität Karlsruhe (TH), Postfach 6980, 76128, Karlsruhe, Germany

    H.-H. Nagel

Authors
  1. F. Heimes
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. H.-H. Nagel
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Heimes, F., Nagel, HH. Towards Active Machine-Vision-Based Driver Assistance for Urban Areas. International Journal of Computer Vision 50, 5–34 (2002). https://doi.org/10.1023/A:1020272819017

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1020272819017

Search

Navigation