skip to main content
10.1145/1865909.1865944acmotherconferencesArticle/Chapter ViewAbstractPublication PagespermisConference Proceedingsconference-collections
research-article

Performance measurements for evaluating static and dynamic multiple human detection and tracking systems in unstructured environments

Published:21 September 2009Publication History

ABSTRACT

The Army Research Laboratory (ARL) Robotics Collaborative Technology Alliance (CTA) conducted an assessment and evaluation of multiple algorithms for real-time detection of pedestrians in Laser Detection and Ranging (LADAR) and video sensor data taken from a moving platform. The algorithms were developed by Robotics CTA members and then assessed in field experiments jointly conducted by the National Institute of Standards and Technology (NIST) and ARL. A robust, accurate and independent pedestrian tracking system was developed to provide ground truth. The ground truth was used to evaluate the CTA member algorithms for uncertainty and error in their results. A real-time display system was used to provide early detection of errors in data collection.

References

  1. Robert Fontana, Recent System Applications of Short-Pulse Ultra-Wideband (UWB) Technology (Invited Paper), IEEE Microwave Theory & Tech., Vol. 52, No. 9, Sept. 2004.Google ScholarGoogle Scholar
  2. Abraham Savitzky and Marcel Golay, "Smoothing and Differentiation of Data by Simplified Least Squares Procedures". Analytical Chemistry 36 (8): 1627--1639, 1964.Google ScholarGoogle ScholarCross RefCross Ref
  3. Barry Bodt and Rickard Camden, "Detecting and Tracking Moving Humans form a Moving Vehicle,", SPIE, Orlando, Florida, 2008.Google ScholarGoogle Scholar
  4. Keni Bernardin, A. Elbs, Rainer Stiefelhagen, "Multiple Object Tracking Performance Metrics and Evaluation in a Smart Room Environment". The Sixth IEEE International Workshop on Visual Surveillance, VS 2006, Graz, Austria, 2006.Google ScholarGoogle Scholar
  5. Kevin Smith, Sileye Ba, Jean-Marc Odobez and Daniel Gatica-Perez, "Evaluating Multi-Object Tracking", Workshop on Empirical Evaluation Methods in Computer Vision (EEMCVF) San Diego, CA, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Sarma Pingali and Jakub Segen, "Performance Evaluation of People Tracking Systems," wacv, pp. 33, Third IEEE Workshop on Applications of Computer Vision (WACV '96), 1996 Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Faisal Bashir and Fatih Porikli., "Performance Evaluation of Object Detection and Tracking Systems", IEEE International Workshop on Performance Evaluation of Tracking and Surveillance (PETS), June 2006.Google ScholarGoogle Scholar
  8. Keni Bernardin, "CLEAR 2007 Evaluation Plan 3D Person Tracking Task,", Classification of Event, Activities and Relationships Evaluation and Workshop (CLEAR) 2007.Google ScholarGoogle Scholar
  9. Richard Camden and Barry Bodt, "Safe Operations Experiment Report," ARL-TR-3773, U.S. Army Research Laboratory: Aberdeen Proving Ground, MD, April 2006.Google ScholarGoogle Scholar
  10. Elias Rigas, Barry Bodt and Richard Camden, "Detection, tracking, and avoidance of moving objects from a moving autonomous vehicle," Proc. SPIE 6561 (2007).Google ScholarGoogle Scholar

Index Terms

  1. Performance measurements for evaluating static and dynamic multiple human detection and tracking systems in unstructured environments

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader