Skip to main content
Log in

Applications of dynamic monocular machine vision

  • Published:
Machine Vision and Applications Aims and scope Submit manuscript

Abstract

The 4-D approach to real-time machine vision presented in the companion paper (Dickmanns and Graefe 1988, this volume) is applied here to two problem areas of widespread interest in robotics. Following a discussion of the vision hardware sed, first, the precise position control for planar docking between 3-D vehicles is discussed; second, the application to high speed road vehicle guidance is demonstrated. With the 5 ton test vehicle VaMoRs, speeds up to 96 km/h (limited by the speed capability of the basic vehicle) have been reached. The test run available, of more than 20 km length, has been driven autonomously several times under various weather conditions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Bierman GJ (1975) Measurement updating using theU-D factorization. Proc. IEEE Control and Decision Conf., Houston, Texas, pp 337–346

    Google Scholar 

  • Bierman GJ (1977) Factorization methods for discrete sequential estimation. Academic Press, New York

    Google Scholar 

  • Bizzi E (1974) The coordination of eye-head movement. Scientific American 231, pp 100–106

    Google Scholar 

  • Broida TJ, Chellappa R (1986) Estimation of object motion parameters from noisy images. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. PAMI-8, No. 1, pp 90–99

    Google Scholar 

  • Dichgans J, Bizzi E, Morasso P, Tagliasco V (1973) Mechanisms underlying recovery of eye head coordination following bilateral labyrinthectomy in monkeys. Exp. Brain Res., 18, pp 548–569

    Google Scholar 

  • Dickmanns ED (1985a) 2D-object recognition and representation using normalized curvature functions. In: Hamza MH (ed) Proc. IASTED Int. Symp. on Robotics and Automation '85. Acta Press, pp 9–13

  • Dickmanns ED (1985b) Vermessung und Erkennung von Figuren mit linearen Krümmungsmodellen. UniBwM/ LRT/WE 13/FB/85-2

  • Dickmanns ED (1986) Computer vision in road vehicles-chances and problems. Preprint, ICTS Symposium on Human Factors Technology for Next-Generation Transportation Vehicles, Amalfi, Italy

  • Dickmanns ED (1988a) Object recognition and real-time relative state estimation under egomotion. In: Jain AK, (ed) Real-Time Object Measurement and Classification. Springer-Verlag, Berlin, pp 41–56

    Google Scholar 

  • Dickmanns ED (1988b) Computer vision for flight vehicles. Zeitschrift für Flugwissenschaft und Weltraumforschung (ZFW) 12, pp 71–79

    Google Scholar 

  • Dickmanns ED, Eberl G (1987) Automatischer Landeanflug durch maschinelles Sehen. (DGLR-Jahrbuch 1987) Jahrestagung der DGLR, Berlin, pp 294–300

    Google Scholar 

  • Dickmanns ED, Wünsche HJ (1986a) Regelung mittels Rechnersehen. Automatisierungstechnik (at) 34, l/ 1986, pp 16–22

    Google Scholar 

  • Dickmanns ED, Wünsche HJ (1986b) Satellite rendezvous maneuvers by means of computer vision. Jahrestagung DGLR München. Jahrbuch 1986 Bd1, DGLR, Bonn, pp 251–259

    Google Scholar 

  • Dickmanns ED, Zapp A, Otto KD (1984) Ein Simulationskreis zur Entwicklung einer automatischen Fahrzeugführung mit bildhaften und inertialen Signalen. Proc. 2. Symp. Simulationstechnik, Wien, Informatik-Fachberichte 39. Springer-Verlag, Berlin

    Google Scholar 

  • Dickmanns ED, Zapp A (1985) Guiding land vehicles along roadways by computer vision. Proc. Congres Automatique 1985, AFCET, Toulouse, pp 233–244

    Google Scholar 

  • Dickmanns ED, Zapp A (1986) A Curvature-based scheme for improving road vehicle guidance by computer vision. In: Mobile Robots, SPIE-Proc. Vol. 727, Cambridge, MA, pp 161–168

  • Dickmanns ED, Zapp A (1987) Autonomous high speed road vehicle guidance by computer vision. Preprint, 10th IFAC-Congress, München, Vol. 4, pp 232–237

    Google Scholar 

  • Duff MJB (1986) Intermediate-level image processing. Academic Press, London

    Google Scholar 

  • Eberl G (1987) Automatischer Landeanflug durch Rechnersehen. Dissertation, Fakultät für Luft- und Raumfahrttechnik der Universität der Bundeswehr München

    Google Scholar 

  • Fichte JG (1792) Versuch einer Kritik aller Offenbarung. Hartung, Königsberg (appeared anonymous at first)

  • Gennery DB (1981) A feature-based scene matcher. Proceedings 7th International Joint Conference on Artificial Intelligence, pp 667–673

  • Gennery DB (1982) Tracking known three-dimensional objects. Proceedings American Association for Artificial Intelligence, Pittsburgh, pp 13–17

  • Graefe V (1983a) A Pre-processor for the real-time interpretation of dynamic scenes. In: Huang TS (ed) Image sequence processing and dynamic scene analysis. Springer-Verlag, Berlin, pp 519–531

    Google Scholar 

  • Graefe V (1983b) Ein Bildvorverarbeitungsrechner für die Bewegungssteuerung durch Rechnersehen. In: Kazmierczak H (ed) Mustererkennung 1983, NTG Fachberichte. VDE-Verlag, pp 203–208

  • Graefe V (1983c) On the representation of moving objects in real-time computer vision systems. In: Tescher AG (ed) Applications of digital image processing VI. Proceedings of the SPIE, Vol. 432, pp 129–132

  • Graefe V (1984) Two multi-processor systems for lowlevel real-time vision. In: Brady JM, Gerhardt LA and Davidson HR (eds) Robotics and artificial intelligence. Springer-Verlag, Berlin, pp 301–308

    Google Scholar 

  • Graefe V, Kuhnert KD (1987) Low-level vision for advanced mobile robots. In: Martin T (ed) International advanced robotics programme-proceedings of the first workshop on manipulators, sensors and steps towards mobility. Kernforschungszentrum Karlsruhe, KfK 4316, pp 239–246

  • Haas G (1982) Meßwertgewinnung durch Echtzeitauswertung von Bildfolgen. Dissertation, Fakultät für Luft- und Raumfahrttechnik der Universität der Bundeswehr München

    Google Scholar 

  • Haas G, Graefe V (1983) Locating fast-moving objects in TV-images in the presence of motion blur. In: Oosterlinck A and Tescher AG (eds) Applications of digital image processing V. Proceedings of the SPIE, Vol. 397, pp 440–446

  • Hegel GWF (1806) Phänomenologie des Geistes. In: Glockner H (ed) Hegel, Sämtliche Werke. Stuttgart, 1927

    Google Scholar 

  • Kalman RE (1960) A new approach to linear filtering and prediction problems. Trans. ASME, Series D, Journal of Basic Engineering, pp 35–45

  • Kuhnert KD (1984) Towards the objective evaluation of low level vision operators. In: O'Shea T (ed) ECAI 84, Proceedings of the Sixth European Conference on Artificial Intelligence, Pisa, p 657

  • Kuhnert KD (1986a) A modeldriven image analysis system for vehicle guidance in real time. In: Wolfe WJ (ed) Proceedings of the Second International Electronic Image Week, CESTA, Nizza, pp 216–221

    Google Scholar 

  • Kuhnert KD (1986b) A vision system for real-time road and object recognition for vehicle guidance. In: Marquino N (ed) Advances in intelligent robotics systems. Proceedings of the SPIE, Vol. 727, Cambridge, MA, pp 267–272

  • Kuhnert KD (1986c) Comparison of intelligent real-time algorithms for guiding an autonomous vehicle. In: Hertzberger LO (ed) Proceedings of the Conference on Intelligent Autonomous Systems, Amsterdam

  • Kuhnert KD (1988) Zur Echtzeit-Bildfolgenanalyse mit Vorwissen. Dissertation, Fakultät für Luft- und Raumfahrttechnik der Universität der Bundeswehr München

    Google Scholar 

  • Kuhnert KD, Zapp A (1985) Wissensgesteuerte Bilfolgenauswertung zur automatischen Führung von Straßenfahrzeugen in Echtzeit. In: Niemann H (ed) Mustererkennung 1985. Springer-Verlag, Berlin, pp 102–106

    Google Scholar 

  • Maybeck PS (1979) Stochastic models, estimation and control, Vol. 1, Academic Press

  • Meissner HG (1982) Steuerung dynamischer Systeme aufgrund bildhafter Informationen. Dissertation, Fakultät für Luft- und Raumfahrttechnik der Universität der Bundeswehr München

    Google Scholar 

  • Meissner HG, Dickmanns ED (1983) Control of an unstable plant by computer vision. In: Huang TS (ed) Image sequence processing and dynamic scene analysis. Springer-Verlag, Berlin, pp 532–548

    Google Scholar 

  • Mysliwetz B, Dickmanns ED (1986) A vision system with active gaze control for real-time interpretation of well structured dynamic scenes. In: Hertzberger LO (ed) Proceedings of the Conference on Intelligent Autonomous Systems, Amsterdam

  • Mysliwetz B, Dickmanns ED (1987) Distributed scene analysis for autonomous road vehicle guidance. Proc. SPIE Conf. on Mobile Robots, Vol. 852, Cambridge, MA, pp 72–79

    Google Scholar 

  • Mysliwetz B, Dickmanns ED (1988) Ein verteiltes System zur Echtzeitinterpretation von Straßenszenen für die autonome Fahrzeugführung. In: Lauber R (ed) Prozeßrechnersysteme '88. Informatik-Fachberichte 167, Springer-Verlag, Berlin, pp 664–673

    Google Scholar 

  • Nagel HH (1983) Overview on image sequence analysis. In: Huang TS (ed) Image sequence processing and dynamic scene analysis. Springer-Verlag, Berlin, pp 2–39

    Google Scholar 

  • Popper KR, Eccles JC (1977) The self and its brain-an argument for interactionism. Springer International, Berlin

    Google Scholar 

  • Reddy R (1978) Pragmatic aspects of machine vision. In: Hanson A and Riseman E (eds) Computer vision systems. Academic Press, New York, pp 89–98

    Google Scholar 

  • Rives, P, Breuil E, Espian B (1986) Recursive estimation of 3D features using optical flow and camera motion. In: Hertzberger LO (ed) Proceedings of the Conference on Intelligent Autonomous Systems, Amsterdam, pp 522–532

  • Schopenhauer A (1819) Die Welt als Wille und Vorstellung. In: Löhneysen W (ed) Arthur Schopenhauer, Sämtliche Werke. Suhrkamp, Frankfurt a.M., (Nachdruck 1986)

  • Strackerjan B (1975) Theoretische Untersuchungen des dynamischen Lenkverhaltens von Personenkraftwagen. Automobil-Industrie 3/75, pp 49–56

    Google Scholar 

  • Thornton CL, Bierman GJ (1980)UDU T Covariance factorization for Kalman filtering. In: Leondes CT (ed) Control and dynamic systems, advances in theory and application, Vol. 16, Academic Press, New York, pp 177–248

    Google Scholar 

  • Vollmer G (1986) Was können wir wissen? Bd 1: Die Natur der Erkenntnis, Bd 2: Die Erkenntnis der Natur. S. Hirzel Verlag, Stuttgart

    Google Scholar 

  • Wünsche HJ (1983) Verbesserte Regelung eines dynamischen Systems durch Auswertung redundanter Sichtinformation unter Berücksichtigung der Einflüsse verschiedener Zustandsschätzer und Abtastzeiten. Report HSBwM/LRT/WE13a/IB/83-2.

  • Wünsche HJ (1986) Detection and control of mobile robot motion by real-time computer vision. In: Marquino N (ed) Advances in intelligent robotics systems. Proceedings of the SPIE, Vol. 727, Cambridge, MA, pp 100–109

  • Wünsche HJ (1987) Erfassung und Steuerung von Bewegungen durch Rechnersehen. Dissertation, Fakultät für Luft- und Raumfahrttechnik der Universität der Bundeswehr München

    Google Scholar 

  • Zapp A (1985) Automatische Fahrzeugführung mit Sichtrückkopplung; Erste Fahrversuche mit einer Fernsehkamera als Echtbauteil im Simulationskreis. Universität der Bundeswehr München, LRT/WE 13/FB/85-1

    Google Scholar 

  • Zapp A (1988) Automatische Straßenfahrzeugführung durch Rechnersehen. Dissertation, Fakultät für Luft- und Raumfahrttechnik der Universität der Bundeswehr München

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Additional information

This research has been partially supported by the German Federal Ministry of Research and Technology (BMFT), the Deutsche Forschungsgemeinschaft (DFG), the Daimler-Benz AG, and by Messerschmitt-Bölkow-Blohm GmbH (MBB).

Rights and permissions

Reprints and permissions

About this article

Cite this article

Dickmanns, E.D., Graefe, V. Applications of dynamic monocular machine vision. Machine Vis. Apps. 1, 241–261 (1988). https://doi.org/10.1007/BF01212362

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF01212362

Key words

Navigation