Abstract
This paper addresses the problem of tracking a large number of targets moving in 3D space using multiple calibrated video cameras. Most visual details of the targets are lost in the captured images because of limited image resolution, and the remainder can be easily corrupted due to frequent occlusion, which makes it difficult to determine both across-view and temporal correspondences. We propose a fully automatic tracking system that is capable of detecting and tracking a large number of flying targets in a 3D volume. The system includes a 3D tracking method in the framework of particle filter. Different from previous 2D tracking methods, the proposed method models the 3D attributes of targets and furthest collects weak visual information from multiple views, which makes the tracker robust against occlusion and distraction. The ambiguities in stereo matching when initializing trackers are handled by an effective multiple hypothesis generation and verification mechanism. The whole system is fully automatic in dealing with variable number of targets and robust against detection and matching errors. Our system has successfully been used by biologists to recover the 3D trajectories of hundreds of fruit flies flying freely in a 3D volume.
Chapter PDF
Similar content being viewed by others
Keywords
- Stereo Match
- Automatic Tracking
- Epipolar Constraint
- Multiple Hypothesis Tracking
- Joint Probabilistic Data Association
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Salzmann, M., Urtasun, R.: Physically-based motion models for 3d tracking: A convex formulation. In: IEEE 13th International Conference on Computer Vision. IEEE (2011)
Scharstein, D., Szeliski, R.: A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. International Journal of Computer Vision 47(1), 7–42 (2002)
Du, H., Zou, D., Chen, Y.: Relative epipolar motion of tracked features for correspondence in binocular stereo. In: IEEE 11th International Conference on Computer Vision, pp. 1–8. IEEE (2007)
Isard, M., Blake, A.: Condensation conditional density propagation for visual tracking. International Journal of Computer Vision 29(1), 5–28 (1998)
Pérez, P., Hue, C., Vermaak, J., Gangnet, M.: Color-Based Probabilistic Tracking. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002, Part I. LNCS, vol. 2350, pp. 661–675. Springer, Heidelberg (2002)
Okuma, K., Taleghani, A., de Freitas, N., Little, J.J., Lowe, D.G.: A Boosted Particle Filter: Multitarget Detection and Tracking. In: Pajdla, T., Matas, J. (eds.) ECCV 2004. LNCS, vol. 3021, pp. 28–39. Springer, Heidelberg (2004)
Hue, C., Le Cadre, J., Perez, P.: Sequential monte carlo methods for multiple target tracking and data fusion. IEEE Transactions on Signal Processing 50(2), 309–325 (2002)
Khan, Z., Balch, T., Dellaert, F.: Mcmc-based particle filtering for tracking a variable number of interacting targets. IEEE Transactions on Pattern Analysis and Machine Intelligence 27(11), 1805–1819 (2005)
Reid, D.: An algorithm for tracking multiple targets. IEEE Transactions on Automatic Control 24(6), 843–854 (1979)
Fortmann, T., Bar-Shalom, Y., Scheffe, M.: Sonar tracking of multiple targets using joint probabilistic data association. IEEE Journal of Oceanic Engineering 8(3), 173–184 (1983)
Veenman, C., Reinders, M., Backer, E.: Resolving motion correspondence for densely moving points. IEEE Transactions on Pattern Analysis and Machine Intelligence 23(1), 54–72 (2001)
Fleuret, F., Berclaz, J., Lengagne, R., Fua, P.: Multi-camera people tracking with a probabilistic occupancy map. IEEE Transactions on Pattern Analysis and Machine Intelligence 30(2), 267–282 (2008)
Mittal, A., Davis, L.: M 2 tracker: a multi-view approach to segmenting and tracking people in a cluttered scene. International Journal of Computer Vision 51(3), 189–203 (2003)
Khan, S.M., Shah, M.: A Multiview Approach to Tracking People in Crowded Scenes Using a Planar Homography Constraint. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3954, pp. 133–146. Springer, Heidelberg (2006)
Zou, D., Zhao, Q., Wu, H., Chen, Y.: Reconstructing 3d motion trajectories of particle swarms by global correspondence selection. In: IEEE 12th International Conference on Computer Vision, pp. 1578–1585. IEEE (2009)
Wu, H., Zhao, Q., Zou, D., Chen, Y.: Automated 3d trajectory measuring of large numbers of moving particles. Optics Express 19(8), 7646–7663 (2011)
Wu, Z., Hristov, N., Hedrick, T., Kunz, T., Betke, M.: Tracking a large number of objects from multiple views. In: IEEE 12th International Conference on Computer Vision, pp. 1546–1553. IEEE (2009)
Ristic, B., Arulampalam, S., Gordon, N.: Beyond the Kalman filter: Particle filters for tracking applications. Artech House Publishers (2004)
Lewis, J.: Fast normalized cross-correlation. In: Vision Interface, vol. 10, pp. 120–123 (1995)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Liu, Y., Li, H., Chen, Y.Q. (2012). Automatic Tracking of a Large Number of Moving Targets in 3D. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds) Computer Vision – ECCV 2012. ECCV 2012. Lecture Notes in Computer Science, vol 7575. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33765-9_52
Download citation
DOI: https://doi.org/10.1007/978-3-642-33765-9_52
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33764-2
Online ISBN: 978-3-642-33765-9
eBook Packages: Computer ScienceComputer Science (R0)