Abstract
Vision-based road detection is an important research topic in different areas of computer vision such as the autonomous navigation of mobile robots. In outdoor unstructured environments such as villages and deserts, the roads are usually not well-paved and have variant colors or texture distributions. Traditional region- or edge-based approaches, however, are effective only in specific environments, and most of them have weak adaptability to varying road types and appearances. In this paper we describe a novel top-down based hybrid algorithm which properly combines both region and edge cues from the images. The main difference between our proposed algorithm and previous ones is that, before road detection, an off-line scene classifier is efficiently learned by both low- and high-level image cues to predict the unstructured road model. This scene classification can be considered a decision process which guides the selection of the optimal solution from region- or edge-based approaches to detect the road. Moreover, a temporal smoothing mechanism is incorporated, which further makes both model prediction and region classification more stable. Experimental results demonstrate that compared with traditional region- and edge-based algorithms, our algorithm is more robust in detecting the road areas with diverse road types and varying appearances in unstructured conditions.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Alon, Y., Ferencz, A., Shashua, A., 2006. Off-Road Path Following Using Region Classification and Geometric Projection Constraints. IEEE Conf. on Computer Vision and Pattern Recognition, p.689–696.
Alvarez, J.M., Lopez, A.M., Baldrich, R., 2008. Illuminant Invariant Model-Based Road Segmentation. Proc. IEEE Intelligent Vehicles Symp., p.1175–1180.
Alvarez, J.M., Gevers, T., Lopez, A.M., 2009. Vision-Based Road Detection Using Road Model. 16th IEEE Int. Conf. on Image Processing, p.2073–2076.
Alvarez, J.M., Gevers, T., Lopez, A.M., 2010a. 3D Scene Priors for Road Detection. IEEE Conf. on Computer Vision and Patten Recognition, p.57–64.
Alvarez, J.M., Lumbreras, F., Gevers, T., Lopez, A.M., 2010b. Geographic Information for Vision-Based Road Detection. IEEE Intelligent Vehicles Symp., p.621–626.
Alvarez, J.M., Gevers, T., LeCun, Y., Lopez, A.M., 2012. Road Scene Segmentation from a Single Image. European Conf. on Computer Vision, p.376–389.
Alvarez, J.M., Gevers, T., Diego, F., Lopez, A.M., 2013. Road geometry classification by adaptive shape models. IEEE Trans. Intell. Transp. Syst., 14(1):459–468. [doi:10.1109/TITS.2012.2221088]
Bellutta, P., Manduchi, R., Matthies, L., Owens, K., Rankin, A., 2000. Terrain Perception for DEMO III. Proc. IEEE Intelligent Vehicles Symp., p.326–331.
Bertozzi, M., Broggi, A., 1998. GOLD: a parallel real-time stereo vision system for generic obstacle and lane detection. IEEE Trans. Image Process., 7(1):62–81. [doi:10.1109/83.650851]
Boykov, Y., Veksler, O., Zabih, R., 2001. Fast approximate energy minimization via graph cuts. IEEE Trans. Pattern Anal. Mach. Intell., 23(11):1222–1239. [doi:10.1109/34.969114]
Dalal, N., Triggs, B., 2005. Histogram of Oriented Gradient for Human Detection. IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, p.886–893.
Duan, K.B., Keerthi, S.S., Chu, W., Shevade, A.K., Poo, A.N., 2003. Multi-category Classification by Soft-Max Combination of Binary Classifiers. 4th Int. Workshop on Multiple Classifier Systems, p.125–134. [doi:10.1007/3-540-44938-8_13]
Felzenszwalb, P., Huttenlocher, D., 2004. Efficient graph-based image segmentation. Int. J. Comput. Vis., 59(2): 167–181. [doi:10.1023/B:VISI.0000022288.19776.77]
Guo, C.Z., Mita, S., McAllester, D., 2010. MRF-Based Road Detection with Unsupervised Learning for Autonomous Driving in Changing Environments. IEEE Intelligent Vehicles Symp., p.361–368.
He, Y.H., Wang, H., Zhang, B., 2004. Color based road detection in urban traffic scenes. IEEE Trans. Intell. Transp. Syst., 5(4):309–318. [doi:10.1109/TITS.2004.838221]
Hoiem, D., Efros, A.A., Hebert, M., 2007. Recovering surface layout from an image. Int. J. Comput. Vis., 75(1):151–172. [doi:10.1007/s11263-006-0031-y]
Kelly, A., Stentz, A., Amidi, O., Bode, M., Bradley, D., Diaz-Calderon, A., Happold, M., Herman, H., Mandelbaum, R., Pilarski, T., et al., 2006. Toward reliable off road autonomous vehicles operating in challenging environments. Int. J. Robot. Res., 25(5–6):449–483. [doi:10.1177/0278364906065543]
Kong, H., Audibert, J.Y., Ponce, J., 2009. Vanishing Point Detection for Road Detection. IEEE Conf. on Computer Vision and Pattern Recognition, p.96–103.
Lazebnik, S., Schmid, C., Ponce, J., 2006. Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories. IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, p.2169–2178.
Lombardi, P., Zanin, M., Messelodi, S., 2005. Switching Models for Vision-Based On-Board Road Detection. IEEE Intelligent Vehicles Symp., p.67–72.
Lookingbill, A., Rogers, J., Lieb, D., Curry, J., Thrun, S., 2007. Reverse optical flow for self-supervised adaptive autonomous robot navigation. Int. J. Comput. Vis., 74(3):287–302. [doi:10.1007/s11263-006-0024-x]
Lutzeler, M., Dick, E.D., 1998. Road Recognition with Marveye. Proc. IEEE Intelligent-Vehicles Symp., p.341–346.
Moghadam, P., Starzyk, J.A., Wijesoma, W.S., 2012. Fast vanishing point detection in unstructured environments. IEEE Trans. Image Process., 21(1):425–430. [doi:10.1109/TIP.2011.2162422]
Thorpe, C., Carlson, J., Duggins, D., 2003. Safe Robot Driving in Cluttered Environments. 11th Int. Symp. of Robotics Research, p.271–280.
Thrun, S., Montemerlo, M., Dahlkamp, H., Stavens, D., Aron, A., Diebel, J., Fong, P., Gale, J., Halpenny, M., Hoffmann, G., et al., 2006. Stanley: the robot that won the DARPA grand challenge. J. Field Robot., 23(9):661–692. [doi:10.1002/rob.20147]
van de Sande, K.E.A., Gevers, T., Snoek, C.G.M., 2010. Evaluating color descriptors for object and scene recognition. IEEE Trans. Pattern Anal. Mach. Intell., 32(9): 1582–1596. [doi:10.1109/TPAMI.2009.154]
Wang, Y., Teoh, E.K., Shen, D.G., 2004. Lane detection and tracking using B-snake. Image Vis. Comput., 22(4):269–280. [doi:10.1016/j.imavis.2003.10.003]
Wang, Y., Bai, L., Fairhurst, M., 2008. Robust road modeling and tracking using condensation. IEEE Trans. Intell. Transp. Syst., 9(4):570–579. [doi:10.1109/TITS.2008.2006733]
Zhang, G., Zheng, N., Cui, C., Yan, Y.Z., Yuan, Z.J., 2009. An Efficient Road Detection Method in Noisy Urban Environment. IEEE Intelligent Vehicles Symp., p.556–561.
Zhou, S.Y., Iagnemma, K., 2010. Self-Supervised Learning Method for Unstructured Road Detection Using Fuzzy Support Vector Machines. IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, p.1183–1189.
Zhou, S.Y., Gong, J.W., Xiong, G.G., Chen, H.Y., Iagnemma, K., 2010. Road Detection Using Support Vector Machine Based on Online Learning and Evaluation. IEEE Intelligent Vehicles Symp., p.256–261.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Zuo, Wh., Yao, Tz. Road model prediction based unstructured road detection. J. Zhejiang Univ. - Sci. C 14, 822–834 (2013). https://doi.org/10.1631/jzus.C1300090
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1631/jzus.C1300090