Skip to main content
SpringerLink
Log in

Obstacle Detection and Terrain Classification for Autonomous Off-Road Navigation

  • Published:
Autonomous Robots Aims and scope Submit manuscript

Abstract

Autonomous navigation in cross-country environments presents many new challenges with respect to more traditional, urban environments. The lack of highly structured components in the scene complicates the design of even basic functionalities such as obstacle detection. In addition to the geometric description of the scene, terrain typing is also an important component of the perceptual system. Recognizing the different classes of terrain and obstacles enables the path planner to choose the most efficient route toward the desired goal.

This paper presents new sensor processing algorithms that are suitable for cross-country autonomous navigation. We consider two sensor systems that complement each other in an ideal sensor suite: a color stereo camera, and a single axis ladar. We propose an obstacle detection technique, based on stereo range measurements, that does not rely on typical structural assumption on the scene (such as the presence of a visible ground plane); a color-based classification system to label the detected obstacles according to a set of terrain classes; and an algorithm for the analysis of ladar data that allows one to discriminate between grass and obstacles (such as tree trunks or rocks), even when such obstacles are partially hidden in the grass. These algorithms have been developed and implemented by the Jet Propulsion Laboratory (JPL) as part of its involvement in a number of projects sponsored by the US Department of Defense, and have enabled safe autonomous navigation in high-vegetated, off-road terrain.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Abedin, M.N. et al. 2003. Multicolor focal plan array detector technology: A review. In SPIE Int. Symp. on Optical Science and Technology, San Diego.

  • Adams, M. 2000. Lidar design, use, and calibration concepts for correct environmental detection. IEEE Trans. Robotics Automat., 16:753–761.

    Google Scholar 

  • Badal, S., Ravela, S., Draper, B., and Hanson, A. 1994. A practical obstacle detection and avoidance system. In 2nd IEEE Workshop on Application of Computer Vision.

  • Batavia, P. and Singh, S. 2002. Obstacle detection in smooth high curvature terrain. In Proceedings of the IEEE Conference on Robotics and Automation (ICRA '02).

  • Baten, S., Mandelbaum, R., Luetzeler, M., Burt, P., and Dickmanns, E. 1998. Techniques for autonomous, off-road navigation. IEEE Intelligent Systems Magazine, 57–65.

  • Bellutta, P., Manduchi, R., Matthies, L., Owens, K., and Rankin, A. 2000. Terrain perception for Demo III". Intelligent Vehicles Conference.

  • Bergh, C., Kennedy, B., Matthies, L., and Johnson, A. 2000. A compact and lowpower two-axis scanning laser rangefinder for mobile robots. In Seventh Mechatronics Forum International Conference, Atlanta, Georgia.

  • Bishop, C.M. 1995. Neural Networks for Pattern Recognition. Oxford University Press.

  • Broggi, A., Bertozzi, M., Fascioli, A., Guarino Lo Bianco, C., and Piazzi, A. 2000. Visual perception of obstacles and vehicles for platooning. IEEE Trans. Intell. Transport. Sys., 1(3).

  • Buluswar, S.D. and Draper, B.A. 2002. Color models for out-door machine vision. Computer Vision and Image Understanding, 85(2):71–99.

    Google Scholar 

  • Castano, A., and Matthies, L. 2003. Foliage discrimination using a rotating Ladar. In Proc. IEEE Intl. Conf. Robotics and Automation, Taipei, Taiwan.

  • Castano, R., Manduchi, R., and Fox, J. 2001.Classification experiments on real-world textures. Workshop on Empirical Evaluation in Computer Vision, Kauai, HI.

  • Elachi, C. 1987. Introduction to the Physics and Techniques of Remote Sensing. John Wiley and Sons

  • Healey, G. 1992. Segmenting images using normalized color. IEEE Transactions on Systems, Man, and Cybernetics, 22(1):64–73.

    Google Scholar 

  • Hebert, M., Vandapel, N., Keller, S., and Donamukkala, R.R. 2002. Evaluation and comparison of terrain classification techniques from LADAR data for autonomous navigation. Army Science Conference, Orlando.

  • Hong, T., Abrams, M., Chang, T., and Shneier, M.O. 2000. An intelligent world model for autonomous off-road driving. Computer Vision and Image Understanding

  • Hook, S. ASTER Spectral Library. http://speclib.jpl.nasa.gov.

  • Horn, B.K.P. 1986. Robot Vision.MIT Press: Cambridge, Massachusetts.

    Google Scholar 

  • Huang, J., Lee, A.B., and Mumford, D. 2000. Statistics of range images. In IEEE Conf. Computer Vision and Pattern Recognition, Hilton Head.

  • Lacaze, A., Moscovitz, Y., DeClaris, N., and Murphy, K. 1998. Path planning for autonomous vehicles driving over rough terrain. In IEEE ISIC/CIRA/ISAS Joint Conference.

  • Lacaze, A., Murphy, K., and DelGiorno, M. 2002. Autonomous mobility for the DEMO III Experimental Unmanned Vehicle. Association for Unmanned Vehicle Systems-Unmanned Vehicle.

  • Leung T. and Malik, J. 1997. On perpendicular texture or: Why do we see more flowers in the distance? In IEEE Conf. Computer Vision and Pattern Recognition, San Juan, Puerto Rico.

  • Macedo, J., Manduchi, R., and Matthies, L. 2000. Ladar-based discrimination of grass from obstacles for autonomous navigation. In Proc. Intl. Symposium on Experimental Robotics, pp.111–120

  • Maloney, L.T. and Wandell, B.A. 1986. Color constancy: A method for recovering surface spectral reflectance. J. Opt. Soc. Amer. A, 3:29–33.

    Google Scholar 

  • Manduchi, R. 2004. Outdoor color classification using only one training image. In European Conference on Computer Vision 2004, Prague.

  • Matthies, L., Xiong, Y., Hogg, R., Zhu, D., Rankin, A., and Kennedy, B. 2000. A portable, autonomous, urban reconnaissance robot. In International Conference on Intelligent Autonomous Systems, Venice, Italy.

  • Matthies, L. and Grandjean, P. 1994. Stochastic performance modeling and evaluation of obstacle detectability with imaging range sensors. IEEE Transactions on Robotics and Automation, Special Issue on Perception-based Real World Navigation, 10(6).

  • Matthies, L., Kelly, A., Litwin, T., and Tharp, G. 1996. Obstacle detection for unmanned ground vehicles: a progress report. Robotics Research 7, Springer-Verlag.

  • Matthies, L., Litwin, T., Owens, K., Rankin, A., Murphy, K., Coombs, D., Gilsinn, J., Hong, T., Legowik, S., Nashman, M., and Yoshimi, B. 1998. Performance evaluation of UGV obstacle detection with CCD/FLIR stereo vision and LADAR. In IEEE ISIC/CIRA/ISAS Joint Conference.

  • McCartney, E.J. 1976. Optics of the Atmosphere: Scattering by Molecules and Particles. John Wiley and Sons: New York.

    Google Scholar 

  • McLachlan, G. and Peel, D. 2000. Finite Mixture Models. John Wiley and Sons.

  • Mehlhorn, K. 1984. Data Structures and Efficient Algorithms. Springer Verlag.

  • Nayar, S.K., and Narasimhan, S.G. 2000. Vision in bad weather. In IEEE Conf. Computer Vision and Pattern Recognition.

  • Rankin, A., Owens, K., Matthies, L., and Litwin, T. 1998. Terrain-adaptive gaze and velocity control for ugv obstacle detection. In Association for Unmanned Vehicle Systems International Annual Symposium.

  • Ripley, B. 1996. Pattern Recognition and Neural Networks. Cambridge University Press.

  • Roberts, D., Smith, M., and Adams, J. 1993. Green vegetation, non-photosynthetic vegetation, and soils in AVIRIS data. Remote Sens. Environ., 44:255–269.

    Google Scholar 

  • Shoemaker, C.M. and Bornstein, J.A. 1998. The Demo III UGV program: A testbed for autonomous navigation Research. In IEEE International Symposium on Intelligent Control, Gaithersburg, MD.

  • Shi, X. and Manduchi, R. 2003. A study on Bayes feature fusion for image classification. In IEEE Workshop on Statistical Analysis in Computer Vision,Madison, WI.

  • Singh, S., and Keller, P. 1991. Obstacle detection for high speed autonomous navigation. In IEEE Int. Conference on Robotics and Automation, Sacramento, CA, pp. 2798–2805.

  • Talukder, A., Manduchi, R., Castano, R., Owens, K., Matthies, L., Castano, A., and Hogg, R. 2002. Autonomous terrain characterization and modeling for dynamic control of unmanned vehicles. In IEEE/RSJ International Conference on Intelligent Robots and Systems, Lausanne, Switzerland.

  • Talukder, A., Manduchi, R., Rankin, A., and Matthies, L. 2002. Fast and reliable obstacle detection and segmentation for cross-country navigation. In IEEE Intelligent Vehicles Symposium,Versailles, France.

  • Williamson, T. and Thorpe, C. 1998. A specialized multibaseline stereo technique for obstacle detection. In IEEE Conf. Computer Vision and Pattern Recognition, pp. 238–244.

  • Wolff, L. 1996. Polarization phased-based method for material classification and object recognition in computer vision. In IEEE Conf. Computer Vision and Pattern Recognition.

  • Zhang, Z., Weiss, R., and Hanson, A.R. 1994. Qualitative obstacle detection. In IEEE Conf. Computer Vision and Pattern Recognition, pp. 554–559.

Download references

Author information

Authors and Affiliations

  1. University of California at Santa Cruz, Santa Cruz, CA, 95064, USA

    R. Manduchi

  2. Jet Propulsion Laboratory, California Institute of Technology, Pasadena, CA, 91109, USA

    A. Castano, A. Talukder & L. Matthies

Authors
  1. R. Manduchi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. A. Castano
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. A. Talukder
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. L. Matthies
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Manduchi, R., Castano, A., Talukder, A. et al. Obstacle Detection and Terrain Classification for Autonomous Off-Road Navigation. Autonomous Robots 18, 81–102 (2005). https://doi.org/10.1023/B:AURO.0000047286.62481.1d

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/B:AURO.0000047286.62481.1d

Search

Navigation