Skip to main content
SpringerLink
Log in

Vehicle detection and tracking in airborne videos by multi-motion layer analysis

  • Original Paper
  • Published:
Machine Vision and Applications Aims and scope Submit manuscript

Abstract

Airborne vehicle detection and tracking systems equipped on unmanned aerial vehicles (UAVs) are receiving more and more attention due to their advantages of high mobility, fast deployment and large surveillance scope. However, such systems are difficult to develop because of factors like UAV motion, scene complexity, and especially the partial occlusion of targets. To address these problems, a new framework of multi-motion layer analysis is proposed to detect and track moving vehicles in airborne platform. After motion layers are constructed, they are maintained over time for tracking vehicles. Most importantly, since the vehicle motion layers can be maintained even when the vehicles are only partially observed, the proposed method is robust to partial occlusion. Our experimental results showed that (1) compared with other previous algorithms, our method can achieve better performance in terms of higher detection rate and lower false positive rate; (2) it is more efficient and more robust to partial occlusion; (3) it is able to meet the demand of real time application due to its computational simplicity.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Hu W., Tan T., Wang L., Maybank S.: A survey on visual surveillance of object motion and behaviors. IEEE Trans. Syst. Mans Cybern. Part C Appl. Rev. 34(3), 334–352 (2004)

    Article  Google Scholar 

  2. Yilmaz, A., Javed, O., Shah, M.: Object tracking: a survey. ACM Comput. Surv. 38(4), Article 13 (2006)

    Google Scholar 

  3. Veeraraghavan H., Masoud O., Papanikolopoulos N.: Computer vision algorithms for intersection monitoring. IEEE Trans. Intell. Transp. Syst. 4(2), 78–89 (2003)

    Article  Google Scholar 

  4. del-Blanco, C.R., Garcıa, N., Salgado, L., Jaureguizar, F.: Object tracking from unstabilized object tracking from unstabilized embedded camera ego motion. In: International Conference on advanced video and signal based surveillance, pp. 400–405. Genova, Italy (2009)

  5. Coifman B., Beymer D., McLauchlan P., Malik J.: A real-time computer vision system for vehicle tracking and traffic surveillance. Transp. Res. Part C 6(4), 271–288 (1998)

    Article  Google Scholar 

  6. Ferryman, J., Maybank, S., Worrall, A.: Visual surveillance for moving vehicles. In: Proceedings, IEEE Workshop on Visual surveillance, pp 73–80. Bombay, India (1998)

  7. Ali, S., Reilly, V., Shah, M.: Motion and appearance contexts for tracking and re-acquiring targets in aerial videos. In: IEEE conference on computer vision and pattern recognition, pp. 1–6. Minneapolis, MN (2007)

  8. Beymer, D., McLauchlan, P., Coifman, B., Malik, J.: A real time computer vision system for measuring traffic parameters. In: Proceedings of IEEE conference on computer vision and pattern recognition, pp. 495–501 (1997)

  9. Liu, M., Wu, C., Zhang, Y.: A review of traffic visual tracking technology. In: International conference on audio, language and image processing, pp. 1016–1020. Shanghai, China (2008)

  10. Barron J., Fleet D., Beauchemin S.: Performance of optical flow techniques. Int. J. Comput. Vis. 12(1), 42–77 (1994)

    Article  Google Scholar 

  11. Tian T., Shah M.: Motion estimation and segmentation. Mach. Vis. Appl. 9(1), 32–42 (1996)

    Article  Google Scholar 

  12. Stauffer, C., Grimson, W.: Adaptive background mixture models for real-time tracking. In: IEEE conference on computer vision and pattern recognition, pp. 246–252. Fort Collins, CO (1999)

  13. Wu, C., Cao, X., Lin, R., Wang, F.: Registration based moving vehicle detection for low-altitude urban traffic surveillance. In: Proceedings of the 8th World Congress on intelligent control and automation, pp. 373–378. Jinan, China (2010)

  14. Lipton, A., Fujiyoshi, H., Patil, R.: Moving target classification and tracking from real time video. In: Proceedings of IEEE workshop applications of computer vision, pp. 8–14 (1998)

  15. Lin, R., Cao, X., Xu, Y., Wu, C.H.Q.: Airborne moving vehicle detection for video surveillance of urban traffic. IEEE conference on intelligent vehicles symposium, pp. 203–208. Xi’an, China (2009)

  16. Yu, Q., Medioni, G.: Motion pattern interpretation and detection for tracking moving vehicles in airborne video. In: IEEE conference on computer vision and pattern recognition, pp. 2671–2678. Miami, FL (2009)

  17. Li, Q., Lei, B., Yu, Y., Hou, R.: Real-time highway traffic information extraction based on airborne video. In: Proceedings of 12th international IEEE conference on intelligent transportation systems, pp. 214–219. St. Louis, MO, USA (2009)

  18. Huang, Y., Luo, X.: Simultaneous detection and tracking in airborne video. In: International conference on computer technology and development, pp. 320–324. Kota, Kinabalu (2009)

  19. Kim, Z.W., Malik, J.: Fast vehicle detection with probabilistic feature grouping and its application to vehicle tracking. In: Proceedings of international conference on computer vision, pp. 521–528. Nice, France (2003)

  20. Arambel, P., Antone, M., Rago, C., Landau, H., Strat, T.: A multiple-hypothesis tracking of multiple ground targets from aerial video with dynamic sensor control. SPIE (2004)

  21. JPL, Traffic surveillance and detection technology development. Sensor Development Final Rep., Jet Propulsion Laboratory Publication no. 97–10 (1997)

  22. Malik, J., Russell, S., Weber, J., Huang, T., Koller, D.: A machine vision based surveillance system for California roads. University of California, PATH project MOU-83 Final Rep. (1994)

  23. Tao H., Sawhney H., Kumar R.: Object tracking with Bayesian estimation of dynamic layer representations. IEEE Trans. Pattern Anal. Mach. Intell. 24(1), 75–89 (2002)

    Article  Google Scholar 

  24. Ali, S., Shah, M.: A lagrangian particle dynamics approach for crowd flow segmentation and stability analysis. In: IEEE conference on computer vision and pattern recognition, pp. 1–8. Minneapolis, MN (2007)

  25. Hu, M., Ali, S., Shah, M.: Detecting global motion patterns in complex videos. In: International conference on pattern recognition, pp. 1–5. Tampa, FL (2008)

  26. Ali, S., Shah, M.: Floor fields for tracking in high density crowd scenes. In: European conference on computer vision (2008)

  27. Pundlik S., Birchfield S.: Real time motion segmentation of sparse feature points at any speed. IEEE Trans. Syst. Man Cybern. Part B 38(3), 731–742 (2008)

    Article  Google Scholar 

  28. Fu H., Cao Z., Cao X.: Embedded omni-vision navigator based on multi-object tracking. Mach. Vis. Appl. 22(2), 349–358 (2011)

    Article  Google Scholar 

  29. Harris, C., Stephens, M.: A combined corner and edge detector. In: Alvey vision conference, pp. 147–152 (1988)

  30. Lowe D.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)

    Article  Google Scholar 

  31. Shi, J., Tomasi, C.: Good features to track. In: IEEE conference on computer vision and pattern recognition, pp. 593–600. Seattle, WA (1994)

  32. Zitova B., Flusser J.: Image registration methods: a survey. Image Vis. Comput. 21, 977–1000 (2003)

    Article  Google Scholar 

  33. Xiao J., Shah M.: Layer-based video registration. Mach. Vis. Appl. 16(2), 75–84 (2005)

    Article  Google Scholar 

  34. Cao X., Wu L., Rasheed Z., Liu H., Choe T., Guo F., Haering N.: Automatic geo-registration for port surveillance. Int. J. Patt. Recognit. Artif. Intell. 24(4), 531–555 (2010)

    Article  Google Scholar 

  35. Boykov, Y., Jolly, M.: Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images. ICCV. pp. 105–112 (2001)

  36. Birchfield, S.: Blepo Computer Vision Library. Available at http://www.ces.clemson.edu/~stb/blepo/

  37. Lin, R., Cao, X., Xu, Y.: Airborne moving vehicle detection for urban traffic surveillance. In: Proceedings of the 11th IEEE conference on intelligent transportation systems, pp. 163–167, Oct. 2008. Beijing

  38. Brunelli, R.: Template Matching Techniques in Computer Vision: Theory and Practice, Wiley, London (2009) (ISBN 978-0-470-51706-2)

  39. Isard M., Blake A.: Condensation—Conditional density propagation for visual tracking. Int. J. Comput. Vis. 29(1), 5–28 (1998)

    Article  Google Scholar 

  40. Cheng Y.: Mean shift, mode seeking, and clustering. IEEE Trans. Patt. Anal. Mach. Intell. 17(8), 790–799 (1995)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of Science and Technology of China, Hefei, 230026, People’s Republic of China

    Xianbin Cao & Jinhe Lan

  2. BeiHang University, Beijing, 100083, People’s Republic of China

    Xianbin Cao

  3. Center for OPTical IMagery Analysis and Learning (OPTIMAL), State Key Laboratory of Transient Optics and Photonics, Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi’an, 710119, Shaanxi, People’s Republic of China

    Pingkun Yan & Xuelong Li

Authors
  1. Xianbin Cao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jinhe Lan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Pingkun Yan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Xuelong Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Pingkun Yan.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Cao, X., Lan, J., Yan, P. et al. Vehicle detection and tracking in airborne videos by multi-motion layer analysis. Machine Vision and Applications 23, 921–935 (2012). https://doi.org/10.1007/s00138-011-0336-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00138-011-0336-x

Keywords

Search

Navigation