Skip to main content
Springer Nature Link
Log in

Multiple human detection and tracking based on head detection for real-time video surveillance

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Multiple human detection and tracking is a very important and active research topic in computer vision. At present, the recognition performance is not satisfactory, which is mainly due to the fact that the full-body of human cannot be captured efficiently by cameras. In this paper, an improved method is developed to detect and track multiple heads by considering them as rigid body parts. The appearance model of human heads is updated according to fusion of color histogram and oriented gradients. An associative mechanism of detection and tracking has been developed to recover transient missed detections and suppress transient false detections. The object identity can be kept invariant during tracking even if unavoidable occlusion occurs. Besides, the proposed method is fast to detect and track multiple human in a dynamic scene without any hypothesis for the scenario contents in advance. Comparisons with state-of-the-arts have indicated the superiority and good performance of the proposed method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

Notes

  1. As an improvement over [1], our system is able to detect human heads with the minimum size 12x12, which is used for the special application of long-distance video surveillance.

References

  1. Ali I, Dailey MN (2012) Multiple human tracking in high-density crowds. Image Vis Comput 30(12):966–977

    Article  Google Scholar 

  2. Benfold B, Reid I (2011) Stable multi-target tracking in real-time surveillance video. IEEE Comput Soc Conf Vis Pattern Recognit 1:3457–3464

    Google Scholar 

  3. Berclaz J, Fleuret F, Fua P (2006) Robust people tracking with global trajectory optimization. Proc IEEE Comput Soc Conf Comput Vis Pattern Recognit 1:744–750

    Google Scholar 

  4. Breitenstein MD, Reichlin F, Leibe B, Koller-Meier E, Van Gool L (2009) Robust tracking-by-detection using a detector confidence particle filter. Proceedings of IEEE International Conference on Computer Vision, 1515–1522

  5. Czyz J, Ristic B, Macq B (2007) A particle filter for joint detection tracking of color objects. Image Vis Comput 25(8):1271–1281

    Article  Google Scholar 

  6. Doucet A, Vo BN, Andrieu C, Davy M (2002) Particle filtering for multi-target tracking and sensor management. Proc IEEE Int Conf Inform Fusion 1:474–481

    Google Scholar 

  7. Guan YP (2010) Spatio-temporal motion-based foreground segmentation and shadow suppression. IET Comput Vis 4(1):50–60

    Article  Google Scholar 

  8. Huang Y, Long Y (2006) Super-resolution using neural networks based on the optimal recovery theory. Proceedings of IEEE Signal Processing Society Workshop on Machine Learning for Signal Processing, 465–470

  9. Long Y, Huang Y (2006) Image based source camera identification using demosaicking. Proceedings of IEEE Workshop on Multimedia Signal Processing, 419–424

  10. Nummiaro K, Koller-Meier E, Van Gool L (2003) An adaptive color-based particle filter. Image Vis Comput 21(1):99–110

    Article  Google Scholar 

  11. Ryoo MS, Aggarwal JK (2010) UT-Interaction Dataset, ICPR contest on Semantic Description of Human Activities (SDHA). http://cvrc.ece.utexas.edu/SDHA2010/Human_Interaction.html

  12. The EC Funded CAVIAR project/IST 2001 37540. http://homepages.inf.ed.ac.uk/rbf/CAVIAR/

  13. Viola P, Jones M (2001) Rapid object detection using a boosted cascade of simple features. Proc IEEE Comput Soc Conf Vis Pattern Recognit 1:511–518

    Google Scholar 

  14. Wang C, Tian M (2010) Passenger flow direction detection for public transportation based on video. Proceedings of IEEE International Conference on Multimedia Communications, 198–201

  15. Wu B, Nevatia R (2007) Detection and tracking of multiple, partially occluded humans by Bayesian combination of edgelet based part detectors. Int J Comput Vis 75(2):247–266

    Article  Google Scholar 

  16. Xie D, Dang L, Tong R (2012) Video based head detection and tracking surveillance system. Proceedings of IEEE International Conference on Fuzzy System and Knowledge Discovery, 2832–2836

  17. Yang M, Lv F, Xu W, Gong YH (2009) Detection driven adaptive multi-cue integration for multiple human tracking. Proceedings of IEEE International Conference on Computer Vision, 1554–1561

  18. Yang T, Pan Q, Li J, Cheng Y, Zhao C (2004) Real-time head tracking system with an active camera. Proc IEEE World Congr Intell Control and Autom 3:1910–1914

    Article  Google Scholar 

  19. Yuk JSC, Wong KK, Chung RH, Chin FY, Chow KP (2006) Real-time multiple head shape detection and tracking system with decentralized trackers. Proc IEEE Int Conf on Intell Syst Des Appl 2:384–389

    Google Scholar 

  20. Zhao M, Sun DH, Tang Y, He HP (2012) Head detection based on 21HT and circle existence model. Proceeding of the 10th World Congress on Intelligent Control and Automation, 4875–4880

Download references

Acknowledgments

This work is supported in part by the Natural Science Foundation of China (Grant No.11176016, 60872117), and Specialized Research Fund for the Doctoral Program of Higher Education (Grant No. 20123108110014).

Author information

Authors and Affiliations

  1. School of Communication and Information Engineering, Shanghai University, Shanghai, China

    Ruiyue Xu, Yepeng Guan & Yizhen Huang

  2. Key Laboratory of Advanced Displays and System Application, Ministry of Education, Shanghai, China

    Yepeng Guan

Authors
  1. Ruiyue Xu
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Yepeng Guan
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Yizhen Huang
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Yepeng Guan.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xu, R., Guan, Y. & Huang, Y. Multiple human detection and tracking based on head detection for real-time video surveillance. Multimed Tools Appl 74, 729–742 (2015). https://doi.org/10.1007/s11042-014-2177-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-014-2177-x

Keywords