Ground plane detection plays an important role in stereo vision based obstacle detection methods. Recently, V-disparity image has been widely used for ground plane detection. The existing approach based on V-disparity image can detect flat ground successfully but have difficulty in detecting non-flat ground. In this paper, we discuss the representation of non-flat ground in V-disparity image, based on which we propose a method to detect non-flat ground using V-disparity image.