Abstract
In this paper, we propose a novel visual object tracking method using a part based appearance model. First, a local kernel feature is developed to encode edge information of patches. Next, bounding box of the target is divided into multiple parts. Then, each part uses correlation filter based tracking to predict position in the next frame. The matrix cosine similarity is utilized to measure reliabilities of the patches. Finally, optimal target location is predicted via maximizing the likelihood, which is obtained by adaptively fusing the reliable patches locations. Experimental results illustrate that our algorithm outperforms state-of-the-art tracking methods significantly in terms of accuracy and robustness.
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00530-020-00668-3/MediaObjects/530_2020_668_Fig1_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00530-020-00668-3/MediaObjects/530_2020_668_Fig2_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00530-020-00668-3/MediaObjects/530_2020_668_Fig3_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00530-020-00668-3/MediaObjects/530_2020_668_Fig4_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00530-020-00668-3/MediaObjects/530_2020_668_Fig5_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00530-020-00668-3/MediaObjects/530_2020_668_Fig6_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00530-020-00668-3/MediaObjects/530_2020_668_Fig7_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00530-020-00668-3/MediaObjects/530_2020_668_Fig8_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00530-020-00668-3/MediaObjects/530_2020_668_Fig9_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs00530-020-00668-3/MediaObjects/530_2020_668_Fig10_HTML.png)
Similar content being viewed by others
References
Bao, C., Wu, Y., Ling, H., Ji, H.: Real time robust L1 tracker using accelerated proximal gradient approach. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1830–1837 (2012)
Hare, S., Saffari, A., Torr, P.: Struck: structured output tracking with kernel. In: ICCV, pp. 263–270 (2011)
Cehovin, L., Kristan, M., Leonardis, A.: Robust visual tracking using an adaptive coupled-layer visual model. IEEE Trans. Pattern Anal. Mach. Intell. 35(4), 941–953 (2013)
Jia, X., Lu, H., Yang, M.-H.: Visual tracking via adaptive structural local sparse appearance model. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1822–1829 (2012)
Kwon, J., Lee, K.M.: Highly nonrigid object tracking via patch-based dynamic appearance modeling. IEEE Trans. Pattern Anal. Mach. Intell. 35(10), 2427–2441 (2013)
Adam, A., Rivlin, E., Shimshoni, I.: Robust fragments-based tracking using the integral histogram. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 798–805 (2006)
Yao, R., Shi, Q., Shen, C., Zhang, Y., van den Hengel, A.: Partbased visual tracking with online latent structural learning. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2013)
Cehovin, L., Kristan, M., Leonardis, A.: Robust visual tracking using an adaptive coupled-layer visual model. IEEE Trans. Pattern Anal. Mach. Intell. 35, 941–953 (2013)
Chang, W., Chen, C., Hung, Y.: Tracking by parts: a bayesian approach with component collaboration. IEEE Trans. Syst. Man Cybern. Part B 39, 375–388 (2009)
Liu, T., Wang, G., Yang, Q.: Real-time part-based visual tracking via adaptive correlation filters. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4902–4912 (2015)
Bolme, D.S., Beveridge, J.R., Draper, B.A., Lui, Y.M.: Visual object tracking using adaptive correlation filters. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, IEEE, pp. 2544–2550 (2010)
Henriques, J.F., Caseiro, R., Martins, P., Batista, J.: High-speed tracking with kernelized correlation filters. IEEE Trans. Pattern Anal. Mach. Intell. 37(3), 583–596 (2014)
Li, Y., Zhu, J.: A scale adaptive kernel correlation filter tracker with feature integration. In: ECCV, pp. 254–265 (2014)
Li, Y., Zhu, J., Hoi, S. C.: Reliable patch trackers: robust visual tracking by exploiting reliable patches, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 353–361 (2015)
Wu, Y., Lim, J., Yang, M.H.: Online object tracking: a benchmark, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2411–2418 (2013)
Smeulders, A.W.M., Chu, D.M., Cucchiara, R., Calderara, S., Dehghan, A., Shah, M.: Visual tracking: an experimental survey. IEEE Trans. Pattern Anal. Mach. Intell. 36(7), 1442–1468 (2014)
Collins, R.T., Liu, X., Lordeanu, M.: Online selection of discriminative tracking features. IEEE Trans. Pattern Anal. Mach. Intell. 27(10), 1631–1643 (2005)
Ross, D.A., Lim, J., Lin, R.-S., Yang, M.-H.: Incremental learning for robust visual tracking. IJCV 77(1–3), 125–141 (2008)
Zhang, K., Zhang, L., Yang, M.-H.: Real-time compressive tracking. In: ECCV, pp. 864–877 (2012)
Mei, X., Ling, H.: Robust visual tracking and vehicle classification via sparse representation. IEEE Trans. Pattern Anal. Mach. Intell. 33(11), 2259–2272 (2011)
Hoey, J.: Tracking using flocks of features, with application to assisted handwashing. BMVC 1, 367–376 (2006)
Artner, N.M., Ion, A., Kropatsch, W.G.: Multi-scale 2d tracking of articulated objects using hierarchical spring systems. Pattern Recognit. 44(4), 800–810 (2011)
Pernici, F., Del Bimbo, A.: Object tracking by oversampling local features. IEEE TAMI 36(12), 2538–2551 (2013)
Zhang, T., Changsheng, X., Yang, M.-H.: Robust structural sparse tracking. IEEE Trans. Pattern Anal. Mach. Intell. 41(2), 473–486 (2019)
Danelljan, M., Hager, G., Khan, F. S., Felsberg, M.: Accurate scale estimation for robust visual tracking. In: BMVC, pp. 1–11 (2014)
Zhang, K., Zhang, L., Liu, Q., Zhang, D., Yang, M.-H.: Fast visual tracking via dense spatio-temporal context learning. In: ECCV, pp. 127–141 (2014)
Hong, Z., Chen, Z., Wang, C., Mei, X., Prokhorov, D., Tao, D.: Multi-store tracker (muster): a cognitive psychology inspired approach to object tracking. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 749–758 (2015)
Zhang, T., Liu, S., Changsheng, X., Liu, B., Yang, M.-H.: Correlation particle filter for visual tracking. IEEE Trans. Image Process. (TIP) 27(6), 2676–2687 (2018)
Liu, T., Wang, G., Qingxiong, Y.: Real-time part-based visual tracking via adaptive correlation filters. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2015)
Zhang, T., Changsheng, X., Yang, M.-H.: Learning multi-task correlation particle filters for visual tracking. IEEE Trans. Pattern Anal. Mach. Intell. 41(2), 365–378 (2019)
Gao, J., Zhang, T., Yang, X., Changsheng, X.: P2t: Part-to-target tracking via deep regression learning. IEEE Trans. Image Process. 27(6), 3074–3086 (2018)
Valmadre, J., Bertinetto, L., Henriques, J., Vedaldi, A., Torr, P.H.S.: End-to-end representation learning for correlation filter based tracking. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 2805–2813 (2017)
Bertinetto, L., Valmadre, J., Henriques, J.F., Vedaldi, A., Torr, P.H.S.: Fully-convolutional siamese networks for object tracking. In: European conference on computer vision, pp. 850–865, Springer, Cham (2016)
Wang, N., Shi, J., Yeung, D.-Y., Jia, J.: Understanding and diagnosing visual tracking systems. In: ICCV (2015)
Avidan, S.: Ensemble tracking. IEEE Trans. Pattern Anal. Mach. Intell. 29(2), 261–271 (2007)
Grabner, H., Grabner, M., Bischof, H.: Real-time tracking via on-line boosting. In: BMVC (2006)
Grabner, H., Leistner, C., Bischof, H.: Semi-supervised on-line boosting for robust tracking. In: ECCV, pp. 234–247 (2008)
Bai, Q., Wu, Z., Sclaro, S., Betke, M., Monnier, C.: Randomized ensemble tracking. In ICCV, pp. 2040–2047 (2013)
Kwon, J., Lee, K.M.: Tracking by sampling and integrating multiple trackers. IEEE Trans. Pattern Anal. Mach. Intell. 36(7), 1428–1441 (2014)
Zhang, J., Ma, S., Sclaroff, S.: MEEM: robust tracking via multiple experts using entropy minimization. In: ECCV, pp. 188–203, Cham (2014)
Wang, N., Yeung, D.-Y.: Ensemble-based tracking: aggregating crowdsourced structured time series data. In: ICML, pp. 1107–1115 (2014)
Seo, H., Milanfar, P.: Training-free, generic object detection using locally adaptive regression kernels. IEEE Trans. Pattern Anal. Mach. Intell. 32(9), 1688–1704 (2010)
Seo, H.J., Milanfar, P.: Face verification using the lark representation. IEEE Trans. Inf. Forensics Secur. 6(4), 1275–1286 (2011)
Seo, H.J., Milanfar, P.: Action recognition from one example. IEEE Trans. Pattern Anal. Mach. Intell. 33(5), 867–882 (2011)
Takeda, H., Milanfar, P., Protter, M., Elad, M.: Super-resolution without explicit subpixel motion estimation. IEEE Trans. Image Process. 18(9), 1958–1975 (2009)
Danelljan, M., Khan, F.S., Felsberg, M., Weijer, J.V.D.: Adaptive color attributes for real-time visual tracking. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1090–1097 (2014)
Fu, Y., Yan, S., Huang, T.S.: Correlation metric for generalized feature extraction. IEEE Trans. Pattern Anal. Mach. Intell. 30(12), 2229–2235 (2008)
Fu, Y., Huang, T.S.: Image classification using correlation tensor analysis. IEEE Trans. Image Process. 17(2), 226–234 (2008)
Chaudhuri, K., Freund, Y., Hsu, D.: A parameter-free hedging algorithm. In: NIPS (2009)
Qi, Y., Zhang, S., Qin, L., Yao, H., Huang, Q., Lim, J., Ming-Hsuan Y.: Hedged deep tracking. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4303–4311 (2016)
Wu, Y., Lim, J., Yang, M.: Object tracking benchmark. IEEE Trans. Pattern Anal. Mach. Intell. (2015)
Zhong, W., Lu, H., Yang, M.-H.: Robust object tracking via sparsity-based collaborative model. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2012)
Kalal, Z., Matas, J., Mikolajczyk, K.: P-N Learning: bootstrapping binary classifiers by structural constraints. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2010)
Kwon, J., Lee, K. M.: Visual tracking decomposition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2010)
Kwon, J., Lee, K. M.: Tracking by sampling trackers. In: ICCV (2011)
Dinh, T.B., Vo, N., Medioni, G.: Context tracker: exploring supporters and distracters in unconstrained environments. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2011)
Henriques, F., Caseiro, R., Martins, P., Batista, J.: Exploiting the circulant structure of tracking-by-detection with kernels. In: ECCV (2012)
Jia, X., Lu, H., Yang, M.-H.: Visual tracking via adaptive structural local sparse appearance model. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2012)
Sevilla-Lara, L., Learned-Miller, E.: Distribution fields for tracking. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2012)
Liu, B., Huang, J., Yang, L., Kulikowsk, C.: Robust tracking using local sparse appearance model and K-selection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2011)
Perez, P., Hue, C., Vermaak, J., Gangnet, M.: Color-based probabilistic tracking. In: ECCV (2002)
Oron, S., Bar-Hillel, A., Levi, D., Avidan, S.: Locally orderless tracking. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2012)
Comaniciu, D., Ramesh, V., Meer, P.: Kernel-based object tracking. IEEE Trans. Pattern Anal. Mach. Intell. 25(5), 564–577 (2003)
Zhang, T., Ghanem, B., Liu, S., Ahuja, N.: Robust visual tracking via multi-task sparse learning. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2012)
Babenko, B., Yang, M.-H., Belongie, S.: Robust object tracking with online multiple instance learning. IEEE Trans. Pattern Anal. Mach. Intell. 33(8), 1619–1632 (2011)
Wu, Y., Shen, B., Ling, H.: Online robust image alignment via iterative convex optimization. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2012)
Stalder, S., Grabner, H., van Gool, L.: Beyond semi-supervised tracking: tracking should be as simple as detection, but not simpler than recognition. In: ICCV Workshop (2009)
Collins, R.: Mean-shift blob tracking through scale space. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2003)
Acknowledgements
This paper is supported by the National Natural Science Foundation of China No. 61873246.
Author information
Authors and Affiliations
Corresponding author
Additional information
Communicated by Q. Tian.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Wang, Y., Luo, X., Ding, L. et al. Robust visual tracking via part-based model. Multimedia Systems 26, 607–620 (2020). https://doi.org/10.1007/s00530-020-00668-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00530-020-00668-3