Radar and vision data fusion for hybrid adaptive cruise control on highways

Abstract. A system for hybrid adaptive cruise control (HACC) on high-speed roads designed as a combination of a radar-based ACC and visual perception is presented. The system is conceived to run on different performance levels depending on the actual perception capabilities. The advantages of a combination of the two different types of sensors are discussed in comparison to the shortcomings of each single sensor. A description of the visual lane detection and tracking procedure is given, followed by an overview of the vehicle detection, hypothesis generation, and tracking procedure. Enhanced robustness is achieved by cooperative estimation of egomotion and the dynamics of other vehicles using the lane-coordinate system as a common reference. Afterwards, the assignment of vehicles to lanes and the determination of the relevant vehicle for the longitudinal controller is described.