Skip to main content
SpringerLink
Log in

Robust Visual Tracking with SIFT Features and Fragments Based on Particle Swarm Optimization

  • Published:
Circuits, Systems, and Signal Processing Aims and scope Submit manuscript

Abstract

We propose a novel approach for visual tracking based on a particle swarm optimization (PSO) framework using SIFT feature points correspondence and multiple fragments in a candidate target region to cope with the problems of partial occlusions, illumination changes, and large motion changes of the tracked target. Firstly, optimal search in the successive frame tracking process is performed by the PSO algorithm, which guides all particles towards the global optima state based on a fitness function. Then, the SIFT feature information is integrated into the iterative results of PSO to acquire a more accurate tracking state. Secondly, we present an effective appearance model updating criterion, which evaluates which fragments in appearance model need updating at each frame. However, the fragments with occluded parts or low quality measure values are not updated. The method for updating appearance model is introduced to improve the tracking performance. Compared with state-of-the-art algorithms, the proposed method can still stably track the target during the course of long-term partial occlusions using superior fragments of tracked target. The experiment results demonstrate the effectiveness of our algorithm in complex environments where the target object undergoes partial occlusions and large changes in pose and illumination.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Notes

  1. http://www.vision.ee.ethz.ch/boostingTrackers/download.htm.

  2. http://www.cs.utoronto.ca/~dross/ivt/.

  3. http://www.cs.technion.ac.il/~amita/.

References

  1. A. Adam, E. Rivlin, I. Shimshoni, Robust fragments-based tracking using the integral histogram, in Proc. Int. Conf. Comp. Vis. Pattern Recognition (2006), pp. 798–805

    Google Scholar 

  2. M.S. Arulampalam, S. Maskell, N. Gordon, T. Clapp, A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking. IEEE Trans. Signal Process. 50(2), 174–188 (2002)

    Article  Google Scholar 

  3. S. Avidan, Ensemble tracking. IEEE Trans. Pattern Anal. Mach. Intell. 29(2), 261–271 (2007)

    Article  Google Scholar 

  4. B. Babenko, M. Yang, S. Belongie, Visual tracking with online multiple instance learning. IEEE Trans. Pattern Anal. Mach. Intell. 33(8), 1619–1632 (2010)

    Article  Google Scholar 

  5. S.T. Birchfield, S. Rangarajan, Spatiograms versus histograms for region-based tracking, in Proc. Int. Conf. Comp. Vis. Pattern Recognition (2005), pp. 1158–1163

    Google Scholar 

  6. CAVIAR datasets, http://groups.inf.ed.ac.uk/vision/caviar/caviardata1/

  7. R. Collins, Y. Liu, M. Leordeanu, On-line selection of discriminative tracking features. IEEE Trans. Pattern Anal. Mach. Intell. 27(10), 1631–1643 (2005)

    Article  Google Scholar 

  8. D. Comaniciu, P. Meer, Mean shift: a robust approach toward feature space analysis. IEEE Trans. Pattern Anal. Mach. Intell. 24(5), 603–619 (2002)

    Article  Google Scholar 

  9. D. Comaniciu, V. Ramesh, P. Meer, Kernel-based object tracking. IEEE Trans. Pattern Anal. Mach. Intell. 25(5), 564–577 (2003)

    Article  Google Scholar 

  10. E. Erdem, S. Dubuisson, I. Bloch, Fragments based tracking with adaptive cue integration. Comput. Vis. Image Underst. 116(7), 827–841 (2012)

    Article  Google Scholar 

  11. B. Erkmen, R. Vural, N. Kahraman et al., A mixed mode neural network circuitry for object recognition application. Circuits Syst. Signal Process. 32(1), 29–46 (2013)

    Article  MathSciNet  Google Scholar 

  12. M.A. Fischer, R.C. Bolles, Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)

    Article  Google Scholar 

  13. K. Fukunaga, L. Hostetler, The estimation of the gradient of a density function, with applications in pattern recognition. IEEE Trans. Inf. Theory 21(1), 32–40 (1975)

    Article  MATH  MathSciNet  Google Scholar 

  14. H. Grabner, M. Grabner, H. Bischof, Real-time tracking via on-line boosting, in Proc. British Machine Vis. Conf. (2006), pp. 47–56

    Google Scholar 

  15. W. Heng, K. Ngan, Long transition analysis for digital video sequences. Circuits Syst. Signal Process. 20(2), 113–141 (2001)

    Article  MATH  Google Scholar 

  16. M. Isard, A. Blake, Condensation-conditional density propagation for visual tracking. Int. J. Comput. Vis. 29(1), 5–28 (1998)

    Article  Google Scholar 

  17. K. James, R. Eberhart, Particle swarm optimization, in Proceedings of IEEE International Conference on Neural Networks (1995), pp. 1942–1948

    Google Scholar 

  18. J. Kwon, K.M. Lee, Visual tracking decomposition, in Proc. Int. Conf. Comp. Vis. Pattern Recognition (2010), pp. 1269–1276

    Google Scholar 

  19. D. Lowe, Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)

    Article  Google Scholar 

  20. X. Mei, H. Ling, Robust visual tracking using L1 minimization, in Proc. IEEE Int. Conf. Comp. Vis. (2009), pp. 1436–1443

    Google Scholar 

  21. K. Nummiaro, E. Koller-Meier, L.V. Gool, An adaptive color-based particle filter. Image Vis. Comput. 21(1), 99–110 (2003)

    Article  Google Scholar 

  22. K. Okuma, A. Taleghani, O. Freitas, A boosted particle filter: multitarget detection and tracking, in The European Conference Computer Vision (2004), pp. 28–39

    Google Scholar 

  23. D. Ross, J. Lim, R.S. Lin, M.H. Yang, Incremental learning for robust visual tracking. Int. J. Comput. Vis. 77(1), 125–141 (2008)

    Article  Google Scholar 

  24. Y. Rubner, C. Tomasi, L.J. Guibas, The earth mover’s distance as a metric for image retrieval. Int. J. Comput. Vis. 40(2), 99–121 (2000)

    Article  MATH  Google Scholar 

  25. M. Thida, P. Remagnino, H. Eng, A particle swarm optimization approach for multi-objects tracking in crowded scene, in IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops (2009), pp. 1209–1215

    Chapter  Google Scholar 

  26. M. Thida, H. Eng, D.N. Monekosso, P. Remagnino, A particle swarm optimization algorithm with interactive swarms for tracking. Appl. Soft Comput. 13(6), 3106–3117 (2013)

    Article  Google Scholar 

  27. ViSOR datasets. http://www.openvisor.org

  28. H. Wang, D. Suter, K. Schindler, C. Shen, Adaptive object tracking based on an effective appearance filter. IEEE Trans. Pattern Anal. Mach. Intell. 29(9), 1661–1667 (2007)

    Article  Google Scholar 

  29. X. Zhang, W. Hu, S. Maybank, X. Li, M. Zhu, Sequential particle swarm optimization for visual tracking, in Proc. Int. Conf. Comp. Vis. Pattern Recognition (2008), pp. 1–8

    Google Scholar 

  30. X. Zhang, W. Hu, W. Qu, S. Maybank, Multi-object tracking via species-based particle swarm optimization. IEEE Trans. Circuits Syst. Video Technol. 20(11), 1590–1602 (2010)

    Article  Google Scholar 

  31. Y. Zhang, T. Hesketh, H. Wang et al., Actuator fault compensation for nonlinear systems using adaptive tracking control. Circuits Syst. Signal Process. 29(3), 419–430 (2010)

    Article  MATH  MathSciNet  Google Scholar 

  32. H. Zulfiqar, Y.H. Gu, Joint feature correspondences and appearance similarity for robust visual object tracking. IEEE Trans. Inf. Forensics Secur. 5(3), 591–606 (2010)

    Article  Google Scholar 

Download references

Acknowledgements

The authors would like to thank the anonymous reviewers for useful and constructive comments that help improve the quality of this paper. This work is supported by National Nature Science Foundation of China (NSFC) under Grant (No. 60971098, 61302152, 61201345) and the Beijing Key Laboratory of Advanced Information Science and Network Technology (No. XDXX1308).

Author information

Authors and Affiliations

  1. School of Information Science and Engineering, Southeast University, Nanjing, 210096, China

    Xu Cheng, Nijun Li, Suofei Zhang & Zhenyang Wu

Authors
  1. Xu Cheng
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nijun Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Suofei Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zhenyang Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xu Cheng.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Cheng, X., Li, N., Zhang, S. et al. Robust Visual Tracking with SIFT Features and Fragments Based on Particle Swarm Optimization. Circuits Syst Signal Process 33, 1507–1526 (2014). https://doi.org/10.1007/s00034-013-9713-1

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00034-013-9713-1

Keywords

Search

Navigation