Abstract
Nowadays, dual-camera systems, which consist of a static camera and a pan-tilt-zoom (PTZ) camera, have become popular in video surveillance, since they can offer wide area coverage and highly detailed images of the interesting starget simultaneously. Different from most previous multi-target tracking methods without information fusion, we propose a multi-target tracking framework based on information fusion of the heterogeneous cameras. Specifically, a conservative online multi-target tracking method is introduced to generate reliable tracklets in both cameras in real time. A max-entropy target selection strategy is proposed to determine which target should be observed by the PTZ camera at a higher resolution to reduce the ambiguity of multi-target tracking. Finally, the information from the static camera and the PTZ camera is fused into a tracking-by-detection framework for more robust multi-target tracking. The proposed method is tested in an outdoor scene, and the experimental results show that our method significantly improves the multi-target tracking performance.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Horaud, R., Knossow, D., Michaelis, M.: Camera cooperation for achieving visual attention. Mach. Vis. Appl. 16(6), 1–2 (2006)
Cui, Z., Li, A., Feng, G., Jiang, K.: Cooperative object tracking using dual-pan-tilt-zoom cameras based on planar ground assumption. In: IET Computer Vision (2014)
Chen, C.H., Yao, Y., Page, D., Abidi, B., Koschan, A., Abidi, M.: Heterogeneous fusion of omnidirectional and PTZ cameras for multiple object tracking. IEEE Trans. Circuits Sys. Video Technol. (TCSVT) 18(8), 1052–1063 (2008)
Senior, A.W., Hampapur, A., Lu, M.: Acquiring multi-scale images by pan-tilt-zoom control and automatic multi-camera calibration. In: IEEE Workshops on Application of Computer Vision (WACV), pp. 433–438 (2005)
Zhou, X., Collins, R.T., Kanade, T., Metes, P.: A master-slave system to acquire biometric imagery of humans at distance. In: ACM SIGMM International Workshop on Video Surveillance, pp. 113–120 (2003)
Alberto, D.B., Dini, F., Grifoni, A., Pernici, F.: Uncalibrated framework for on-line camera cooperation to acquire human head imagery in wide areas. In: IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp. 252–258 (2008)
Bernardin, K., Van, F., Stiefelhagen, R.: Automatic person detection and tracking using fuzzy controlled active cameras. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1–8 (2007)
Cui, Y., Samarasckera, S., Huang, Q., Greiffenhagen, M.: Indoor monitoring via the collaboration between a peripheral sensor and a foveal sensor. In: IEEE Workshop on Visual Surveillance, pp. 2–9 (1998)
Yao, Y., Abidi, B., Abidi, M.: Fusion of omnidirectional and PTZ cameras for accurate cooperative tracking. In: IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp. 46–46 (2006)
Wang, X.: Intelligent multi-camera video surveillance: a review. Pattern Recogn. Lett. 34(1), 3–19 (2013)
Kuo, C.H., Huang, C., Nevatia, R.: Multi-target tracking by on-line learned discriminative appearance models. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 685–692 (2010)
Kuo, C.H., Nevatia, R.: How does person identity recognition help multi-person tracking? In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), PP. 1217–1224 (2011)
Bae, S.H., Yoon, K.J.: Robust online multi-object tracking based on tracklet confidence and online discriminative appearance learning. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1218–1225 (2014)
Schindler, K.: Continuous energy minimization for multi-target tracking. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 36(1), 51–65 (2014)
Wu, Z., Radke, J.: Keeping a pan-tilt-zoom camera calibrated. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 35(8), 1994–2007 (2013)
Huang, C., Wu, B., Nevatia, R.: Robust object tracking by hierarchical association of detection responses. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part II. LNCS, vol. 5303, pp. 788–801. Springer, Heidelberg (2008)
Munkres, J.: Algorithms for the assignment and transportation problems. J. Soc. Ind. Appl. Math. 5(1), 32–38 (1957)
Schapire, R.E., Singer, Y.: Improved boosting algorithms using confidence-rated predictions. Mach. Learn. 37(3), 297–336 (1999)
Dollár, P., Appel, R., Belongie, S., Perona, P.: Fast feature pyramids for object detection. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 36(8), 1532–1545 (2014)
Acknowledgement
This work is supported by National Natural Science Foundation of China (No. 61371192).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Wang, J., Yu, N. (2015). Multi-target Tracking via Max-Entropy Target Selection and Heterogeneous Camera Fusion. In: Ho, YS., Sang, J., Ro, Y., Kim, J., Wu, F. (eds) Advances in Multimedia Information Processing -- PCM 2015. PCM 2015. Lecture Notes in Computer Science(), vol 9314. Springer, Cham. https://doi.org/10.1007/978-3-319-24075-6_15
Download citation
DOI: https://doi.org/10.1007/978-3-319-24075-6_15
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-24074-9
Online ISBN: 978-3-319-24075-6
eBook Packages: Computer ScienceComputer Science (R0)