ABSTRACT
The Army Research Laboratory (ARL) Robotics Collaborative Technology Alliance (CTA) conducted an assessment and evaluation of multiple algorithms for real-time detection of pedestrians in Laser Detection and Ranging (LADAR) and video sensor data taken from a moving platform. The algorithms were developed by Robotics CTA members and then assessed in field experiments jointly conducted by the National Institute of Standards and Technology (NIST) and ARL. A robust, accurate and independent pedestrian tracking system was developed to provide ground truth. The ground truth was used to evaluate the CTA member algorithms for uncertainty and error in their results. A real-time display system was used to provide early detection of errors in data collection.
- Robert Fontana, Recent System Applications of Short-Pulse Ultra-Wideband (UWB) Technology (Invited Paper), IEEE Microwave Theory & Tech., Vol. 52, No. 9, Sept. 2004.Google Scholar
- Abraham Savitzky and Marcel Golay, "Smoothing and Differentiation of Data by Simplified Least Squares Procedures". Analytical Chemistry 36 (8): 1627--1639, 1964.Google ScholarCross Ref
- Barry Bodt and Rickard Camden, "Detecting and Tracking Moving Humans form a Moving Vehicle,", SPIE, Orlando, Florida, 2008.Google Scholar
- Keni Bernardin, A. Elbs, Rainer Stiefelhagen, "Multiple Object Tracking Performance Metrics and Evaluation in a Smart Room Environment". The Sixth IEEE International Workshop on Visual Surveillance, VS 2006, Graz, Austria, 2006.Google Scholar
- Kevin Smith, Sileye Ba, Jean-Marc Odobez and Daniel Gatica-Perez, "Evaluating Multi-Object Tracking", Workshop on Empirical Evaluation Methods in Computer Vision (EEMCVF) San Diego, CA, 2005. Google ScholarDigital Library
- Sarma Pingali and Jakub Segen, "Performance Evaluation of People Tracking Systems," wacv, pp. 33, Third IEEE Workshop on Applications of Computer Vision (WACV '96), 1996 Google ScholarDigital Library
- Faisal Bashir and Fatih Porikli., "Performance Evaluation of Object Detection and Tracking Systems", IEEE International Workshop on Performance Evaluation of Tracking and Surveillance (PETS), June 2006.Google Scholar
- Keni Bernardin, "CLEAR 2007 Evaluation Plan 3D Person Tracking Task,", Classification of Event, Activities and Relationships Evaluation and Workshop (CLEAR) 2007.Google Scholar
- Richard Camden and Barry Bodt, "Safe Operations Experiment Report," ARL-TR-3773, U.S. Army Research Laboratory: Aberdeen Proving Ground, MD, April 2006.Google Scholar
- Elias Rigas, Barry Bodt and Richard Camden, "Detection, tracking, and avoidance of moving objects from a moving autonomous vehicle," Proc. SPIE 6561 (2007).Google Scholar
Index Terms
- Performance measurements for evaluating static and dynamic multiple human detection and tracking systems in unstructured environments
Recommendations
Online Empirical Evaluation of Tracking Algorithms
Evaluation of tracking algorithms in the absence of ground truth is a challenging problem. There exist a variety of approaches for this problem, ranging from formal model validation techniques to heuristics that look for mismatches between track ...
Methodology for evaluating static six-degree-of-freedom (6DoF) perception systems
PerMIS '10: Proceedings of the 10th Performance Metrics for Intelligent Systems WorkshopIn this paper, we apply two fundamental approaches toward evaluating a static, vision based, six-degree-of-freedom (6DoF) pose determination system that measures the position and orientation of a part. The first approach uses groundtruth carefully ...
Multi-robot multiple hypothesis tracking for pedestrian tracking
In this paper the problem of tracking walking people with multiple moving robots is tackled. For this purpose we present an adaptation to the Multiple Hypothesis Tracking method, which unlike classic MHT, allows for one-to-many associations between ...
Comments