Abstract
Despite tracking-by-detection having shown dramatically ra-pid improvement, most existing approaches are still scrabbling in dense pedestrian tracking. To address this problem, this work presents a new multiple object tracking approach, named VacoTrack. This method combines variable GIoU-Embedding matrix (VGE) and Kalman Filter compensation, which introduces motion compensation operation over trajectory parameters to construct virtual uniform linear trajectories for objects. This method combines GIoU distance and Embedding cosine distance of objects variably as a new association matrix VGE to adjustably calculate similarity matrix in facing different occlusion problem. After association, this method sends all tracked trajectories back to Kalman Filter, including constructed virtual trajectories for re-matched objects, and then operates Kalman Filter compensation to fine tune trajectory parameters. Thus, this approach regards the motion patterns of objects as uniform linear motion patterns to identify them across dense pedestrian, and improve robustness. Our proposed approach achieves 64.43 and 63.14 HOTA on MOT17 and MOT20 benchmarks respectively and outperforms state-of-the-art in most evaluation metrics.
Supported by the National Natural Science Foundation of China (Grant no. 61703005) and the Key Research and Development Projects in Anhui Province (Grant no. 202004-b11020029).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Zhu, T., Hiller, M., Ehsanpour, M., et al.: Looking beyond two frames: end-to-end multi-object tracking using spatial and temporal transformers. IEEE TPAMI, 1–14 (2022)
Zhu, X., Su, W., Lu, L., et al.: Deformable DETR: deformable transformers for end-to-end object detection. arXiv preprint arXiv:2010.04159 (2020)
Zhang, Y., Sun, P., Jiang, Y., et al.: ByteTrack: multi-object tracking by associating every detection box. In: Avidan, S., Brostow, G., Cissé, M., Farinella, G.M., Hassner, T. (eds.) ECCV. LNCS, vol. 13682, pp. 23–27. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-20047-2_1
Cao, J., Weng, X., Khirodkar, R., et al.: Observation-centric sort: Rethinking sort for robust multi-object tracking. arXiv preprint arXiv:2203.14360 (2022)
Guo, S., Wang, J., Wang, X., et al.: Online multiple object tracking with cross-task synergy. In: CVPR, pp. 8136–8145 (2021)
Sun, P., Cao, J., Jiang, Y., et al.: TransTrack: multiple object tracking with transformer. arXiv preprint arXiv:2012.15460 (2020)
Zhou, X., Koltun, V., Krähenbühl, P.: Tracking objects as points. In: Vedaldi, A., Bischof, H., Brox, T., Frahm, J.-M. (eds.) ECCV 2020. LNCS, vol. 12349, pp. 474–490. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-58548-8_28
Wu, J., Cao, J., Song, L., et al.: Track to detect and segment: an online multi-object tracker. In: CVPR, pp. 12352–12361 (2021)
Lu, Z., Rathod, V., Votel, R., et al.: RetinaTrack: online single stage joint detection and tracking. In: CVPR, pp. 14668–14678 (2020)
Pang, J., Qiu, L., Li, X., et al.: Quasi-dense similarity learning for multiple object tracking. In: CVPR, pp. 164–173 (2021)
Hornakova, A., Henschel, R., Rosenhahn, B., et al.: Lifted disjoint paths with application in multiple object tracking. In: ICML, pp. 4364–4375 (2020)
Han, S., Huang, P., Wang, H., et al.: MAT: motion-aware multi-object tracking. Neurocomputing 476, 75–86 (2022)
Zhang, Y., Sheng, H., Wu, Y., et al.: Long-term tracking with deep tracklet association. IEEE Trans. Image Process. 29, 6694–6706 (2020)
Kalman, R.E.: A new approach to linear filtering and prediction problems, pp. 35–45 (1960)
Xu, Y., Ban, Y., Delorme, G., et al.: TransCenter: transformers with dense queries for multiple-object tracking. arXiv e-prints, arXiv: 2103.15145 (2021)
Liu, Q., Ren, J., Wang, Y., et al.: EACOFT: an energy-aware correlation filter for visual tracking. Pattern Recogn. 112, 107766 (2021)
Huang, B., Xu, T., Jiang, S., et al.: Robust visual tracking via constrained multi-kernel correlation filters. IEEE Trans. Multimedia 22(11), 2820–2832 (2020)
Bai, S., He, Z., Dong, Y., et al.: Multi-hierarchical independent correlation filters for visual tracking. In: ICME, pp. 1–6 (2020)
Du, Y., Zhao, Z., Song, Y., et al.: StrongSORT: make DeepSORT great again. IEEE Trans. Multimedia, 1–14 (2023)
Du, Y., Wan, J., Zhao, Y., et al.: GIAOTracker: a comprehensive framework for MCMOT with global information and optimizing strategies in VisDrone 2021. In: ICCV, pp. 2809–2819 (2021)
Rezatofighi, H., Tsoi N., Gwak, J Y., et al.: Generalized intersection over union: a metric and a loss for bounding box regression. In: CVPR, pp. 658–666 (2019)
Bradski, G.: The openCV library. Dr. Dobb’s J. Softw. Tools Prof. Program. 25(11), 120–123 (2000)
Milan, A., Leal-Taixé, L., Reid, I., et al.: MOT16: a benchmark for multi-object tracking. arXiv preprint arXiv:1603.00831 (2016)
Dendorfer, P., Rezatofighi, H., Milan, A., et al.: MOT20: a benchmark for multi object tracking in crowded scenes. arXiv preprint arXiv:2003.09003 (2020)
Luiten, J., Osep, A., Dendorfer, P., et al.: HOTA: a higher order metric for evaluating multi-object tracking. Int. J. Comput. Vis. 129, 548–578 (2021)
Kesa, O., Styles, O., Sanchez, V.: Multiple object tracking and forecasting: jointly predicting current and future object locations. In: IEEE Winter Conference on Applications of Computer Vision, pp. 560–569 (2022)
Dai, P., Weng, R., Choi, W., et al.: Learning a proposal classifier for multiple object tracking. In: CVPR, pp. 2443–2452 (2021)
Zeng, F., Dong, B., Zhang, Y., et al.: MOTR: end-to-end multiple-object tracking with transformer. In: Avidan, S., Brostow, G., Cissé, M., Farinella, G.M., Hassner, T. (eds.) ECCV 2022. LNCS, vol. 13687, pp. 23–27. Springer, Cham (2022)
Zhou, X., Yin, T., Koltun, V., et al.: Global tracking transformers. In: CVPR, pp. 8771–8780 (2022)
Aharon, N., Orfaig, R., Bobrovsky, B Z.: BoT-SORT: robust associations multi-pedestrian tracking. arXiv preprint arXiv:2206.14651 (2022)
Kuhn, H.W.: The Hungarian method for the assignment problem. Nav. Res. Logist. Q. 2, 83–97 (1955)
Acknowledgments
This work was supported in part by the National Natural Science Foundation of China (Grant no. 61703005) and in part by the Key Research and Development Projects in Anhui Province (Grant no. 202004-b11020029).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Sun, K. et al. (2023). Multiple Object Tracking Based on Variable GIoU-Embedding Matrix and Kalman Filter Compensation. In: Iliadis, L., Papaleonidas, A., Angelov, P., Jayne, C. (eds) Artificial Neural Networks and Machine Learning – ICANN 2023. ICANN 2023. Lecture Notes in Computer Science, vol 14262. Springer, Cham. https://doi.org/10.1007/978-3-031-44201-8_4
Download citation
DOI: https://doi.org/10.1007/978-3-031-44201-8_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-44200-1
Online ISBN: 978-3-031-44201-8
eBook Packages: Computer ScienceComputer Science (R0)