Tracking and following pedestrian trajectories, an approach for autonomous surveillance of critical infrastructures

This paper aims to present a system that is fully capable of addressing the issue of detection, tracking and following pedestrians, which is a very challenging task, especially when it is considered for using in large outdoors infrastructures. Three modules, detection, tracking and following, are integrated and tested over long distances in semi-structured scenarios, where static or dynamic obstacles, including other pedestrians, can be found.

The detection is based on the probabilistic fusion of a laser scanner and a camera. The tracking module pairs observations with previously detected targets by using Kalman Filters and a Mahalanobis-distance. The following module allows to safely pursue the target by using a well-defined navigation scheme.

The system can track pedestrians from static position to 3.46 m/s (running). It handles occlusions, crossings or miss-detections, keeping track of the position even if the pedestrian is only detected in 55/per cent of the observations. Moreover, it autonomously selects and follows a target at a maximum speed of 1.46 m/s.

The main novelty of this study is the integration of the three algorithms in a fully operational system, tested in real outdoor scenarios. Furthermore, the addition of labelling to the detection algorithm allows using the full range of a single sensor while preserving the high performance of a combined detection. False-positives’ rate is reduced by handling the uncertainty level when pairing observations. The inclusion of pedestrian speed in the model speeds up and simplifies tracking process. Finally, the most suitable target is automatically selected by a scoring system.