Skip to main content
Log in

Fast medium-scale multiperson identification in aerial videos

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Vision systems for unmanned aerial vehicles (UAVs) have been gaining increasing attention for surveillance and civil applications. However, aerial platforms create new challenges for several vision tasks (e.g., human tracking and identification) because UAV-mounted cameras undergo large vibration movements and capture unstable videos. Furthermore, most existing machine vision approaches use the fine details of a human figure, which are unavailable in low-quality aerial images. We propose a new blob-matching approach for human identification in aerial videos in which the identity of a human blob is estimated using an adaptive reference set of previously identified people. A target can be quickly located by matching only the target and a carefully selected candidate set. The experimental results obtained using several challenging aerial videos validated the effectiveness and computational efficiency of the proposed method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Bak S, Zaidenberg S, Boulay B, Bremond F (2014) Improving person re-identification by viewpoint cues. IEEE Int Conf Adv Video Sig Based Surveill:175–180

  2. Brin S, Page L (1998) The anatomy of a large-scale hypertextual web search engine. Comput Netw ISDN Syst 30:107–117

    Article  Google Scholar 

  3. Bristeaui P -J, Callou F, Vissière D, Petit N (2011) The navigation and control technology inside the AR.Drone micro UAV. IFAC World Congr Milano: 1477–1484

  4. Cohen I, Médioni G (1998) Detection and tracking of objects in airborne video imagery. Tech Rep Univ South Calif

  5. Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. IEEE Int Conf Comput Vis Pattern Recognit:886–893

  6. Daugman J (2002) How iris recognition works. IEEE Int Conf Image Process 9:33–36

    Article  Google Scholar 

  7. Daugman J (2004) How iris recognition works, IEEE Trans Circuits Syst Video Technol 14(1):21–30

  8. Elhamod M, Levine MD (2013) Automated real-time detection of potentially suspicious behavior in public transport areas. IEEE Trans Intell Transp Syst 14(2):688–699

    Article  Google Scholar 

  9. Farenzena M, Bazzani L, Perina A, Murino V, Cristani M (2010) Person re-identification by symmetry-driven accumulation of local features. IEEE Int Conf Comput Vis Pattern Recog:2360–2367

  10. HuangY, Luo X (2009) Simultaneous detection and tracking in airborne video. Int Conf Comput Technol Develop:320–324

  11. Kamvar SD, Haveliwala TH, Manning CD, Golub GH (2003) Extrapolation methods for accelerating PageRank computations. Int Conf World Wide Web:261–270

  12. Kuo C -H, Nevatia R (2011) How does person identity recognition help multi-person tracking? IEEE Int Conf Comput Vision Pattern Recog:1217–1224

  13. Levin A, Lischinski D, Weiss Y (2008) A closed-form solution to natural image matting. IEEE Trans Pattern Anal Mach Intell 30(2):228–242

    Article  Google Scholar 

  14. Oreifej O, Mehran R, Shah M (2010) Human identity recognition in aerial image. IEEE Int Conf Comput Vis Pattern Recognit: 709–716

  15. Park U, Jain A, Kitahara I, Kogure K, Hagita N (2006) Vise: visual search engine using multiple networked cameras. IEEE Int Conf Pattern Recogn 3:1204–1207

    Google Scholar 

  16. Rubner Y, Tomasi C, Guibas LJ (1998) A metric for distributions with applications to image databases. IEEE Int Conf Comput Vis:59–66

  17. Seo HJ, Milanfar P (2010) Training-free, generic object detection using locally adaptive regression kernels. IEEE Trans Pattern Anal Mach Intell 32(9):1688–1704

    Article  Google Scholar 

  18. Sharp CS, Shakernia O, Sastry SS (2001) A vision system for landing an unmanned aerial vehicle. Proc IEEE Int Conf Robot 2:1720–1727

    Google Scholar 

  19. Shim S, Choi T (2003) Image indexing by modified color co-occurrence matrix. IEEE Int Conf Image Process

  20. UCF Aerial Action Data Set. http://crcv.ucf.edu/data/UCF_Aerial_Action.php. 27 May 2015

  21. Yue Z, Guarino D, Chellappa R (2009) Moving object verification in airborne video sequences. IEEE Trans Circuits Syst Video Technol 19(1):77–89

    Article  Google Scholar 

  22. Zheng W-S, Gong S, Xiang T (2011) Person re-identification by probabilistic relative distance comparison. IEEE Int Conf Comput Vis Pattern Recogn:649–656

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mei-Chen Yeh.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yeh, MC., Chiu, HK. & Wang, JS. Fast medium-scale multiperson identification in aerial videos. Multimed Tools Appl 75, 16117–16133 (2016). https://doi.org/10.1007/s11042-015-2921-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-015-2921-x

Keywords

Navigation