Skip to main content
SpringerLink
Log in

Rotation invariant person tracker using top view

  • Original Research
  • Published:
Journal of Ambient Intelligence and Humanized Computing Aims and scope Submit manuscript

Abstract

Person tracking is considered an important application in the field of video surveillance. A top view camera provides a wide coverage of scene and better handling of occlusion as compared to frontal view. The proposed top view based person tracking method mainly contains four modules, namely BLOB detection, standardisation, size estimation and tracking. In blob detection, foreground is extracted using segmentation, statistical operation, connected component labelling and morphological operations. The top view is radial symmetric thus using this property, the extracted blob is transformed to upright position using geometric transformations. This effectively makes the blob/person rotation invariant in the scene. Basic shape based features including width, height and body ratio are measured for each blob. On the basis of these features, the algorithm effectively distinguishes a person, no person as well as merged person blob. A simple tracker for each blob is formerly created to maintain different parameters for example, blob name, blob width & height, blob x & y coordinates, blob time, blob history, blob size and blob ratio. The proposed algorithm along with the seven attractive/popular tracking methods have been tested on different test sequences. The experimental results show that the proposed algorithm significantly improves results by achieving true detection rate of 95%.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22

Similar content being viewed by others

References

  • Ahmad M, Ahmed I, Ullah K, Khan I, Khattak A, Adnan A (2019a) Energy efficient camera solution for video surveillance. Int J Adv Comput Sci Appl 10:3

    Google Scholar 

  • Ahmad M, Ahmed I, Ullah K, Khan I, Khattak A, Adnan A (2019b) Person detection from overhead view: a survey. Int J Adv Comput Sci Appl 10:4

    Google Scholar 

  • Ahmed I, Adnan A (2017) A robust algorithm for detecting people in overhead views. Cluster Comput 2017:1–22

    Google Scholar 

  • Ahmed I, Ahmad A, Piccialli F, Sangaiah AK, Jeon G (2018) A robust features-based person tracker for overhead views in industrial environment. IEEE Internet Things J 5(3):1598–1605

    Article  Google Scholar 

  • Ahmed I, Ahmad M, Adnan A, Ahmad A, Khan M (2019a) Person detector for different overhead views using machine learning. Int J Mach Learn Cybernet 2019:1–12

    Google Scholar 

  • Ahmed I, Ahmad M, Nawaz M, Haseeb K, Khan S, Jeon G (2019b) Efficient topview person detector using point based transformation and lookup table. Comput Commun 147:188–197

    Article  Google Scholar 

  • Azad MA, Bag S, Hao F (2018) Privbox: verifiable decentralized reputation system for online marketplaces. Future Gener Comput Syst 89:44–57

    Article  Google Scholar 

  • Babenko B, Yang M.-H, Belongie S (2009) Visual tracking with online multiple instance learning. In: 2009 IEEE conference on computer vision and pattern recognition, pp 983–990, IEEE

  • Bolme DS, Beveridge JR, Draper BA, Lui YM (2010) Visual object tracking using adaptive correlation filters. In: 2010 IEEE computer society conference on computer vision and pattern recognition, IEEE, pp 2544–2550

  • Breitenstein MD, Reichlin F, Leibe B, Koller-Meier E, Van Gool L (2011) Online multiperson tracking-by-detection from a single, uncalibrated camera. IEEE Trans Pattern Anal Mach Intell 33(9):1820–1833

    Article  PubMed  Google Scholar 

  • Burkert F, Schmidt F, Butenuth M, Hinz S (2010) People tracking and trajectory interpretation in aerial image sequences. In: Int Arch Photogram Remote Sens Spat Inf Sci Commision III (Part A), pp 209–214

  • Choi J-W, Moon D, Yoo J-H (2015) Robust multi-person tracking for real-time intelligent video surveillance. ETRI J 37(3):551–561

    Article  Google Scholar 

  • Climent-Pérez P, Lazaridis G, Hummel G, Russ M, Monekosso DN, Remagnino P (2014) Telemetry-based search window correction for airborne tracking. In: International symposium on visual computing, pp 457–466. Springer

  • Dadi HS, Pillutla GKM, Makkena ML (2017) Face recognition and human tracking using GMM, HOG and SVM in surveillance videos. Ann Data Sci 2017:1–23

    Google Scholar 

  • De Smedt F, Hulens D, Goedemé T (2015) On-board real-time tracking of pedestrians on a uav. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 1–8

  • Duanmu F, Feng X, Zhu X, Tan W-t, Wang Y (2018) A multi-view pedestrian tracking framework based on graph matching. In 2018 IEEE conference on multimedia information processing and retrieval (MIPR), IEEE, pp 315–320

  • Fernando T, Denman S, Sridharan S, Fookes C (2018) Tracking by prediction: A deep generative model for mutli-person localisation and tracking. In: 2018 IEEE winter conference on applications of computer vision (WACV), IEEE, pp 1122–1132

  • García J, Gardel A, Bravo I, Lázaro JL, Martínez M (2013) Tracking people motion based on extended condensation algorithm. IEEE Trans Syst Man Cybern Syst 43(3):606–618

    Article  Google Scholar 

  • Grabner H, Grabner M, Bischof H (2006) Real-time tracking via on-line boosting. Proc Br Mach Vis Conf (BMVC) 1:47–56

    Google Scholar 

  • Häger G, Bhat G, Danelljan M, Khan FS, Felsberg M, Rudl P, Doherty P (2016) Combining visual tracking and person detection for long term tracking on a uav. InL International symposium on visual computing, Springer, pp 557–568

  • Hao T, Wang Q, Wu D, Sun J-S (2018) Multiple person tracking based on slow feature analysis. Multimedia Tools Appl 77(3):3623–3637

    Article  Google Scholar 

  • Henriques JF, Caseiro R, Martins P, Batista J (2012) Exploiting the circulant structure of tracking-by-detection with kernels. In: European conference on computer vision, Springer, pp 702–715

  • Iwashita Y Kurazume R (2015) Stable image registration for people tracking from the sky. In: 2015 sixth international conference on emerging security technologies (EST), IEEE, pp 69–73

  • Kalal Z, Mikolajczyk K, Matas J (2010) Forward-backward error: Automatic detection of tracking failures. In: Proceedings of the 2010 20th international conference on pattern recognition, ICPR ’10, pp 2756–2759. IEEE Computer Society

  • Kalal Z, Mikolajczyk K, Matas J (2012) Tracking-learning-detection. IEEE Trans Pattern Anal Mach Intell 34(7):1409–1422

    Article  PubMed  Google Scholar 

  • Lim H, Sinha SN (2015) Monocular localization of a moving person onboard a quadrotor mav. In: 2015 IEEE international conference on robotics and automation (ICRA), IEEE, pp 2182–2189

  • Liu A-S, Hsu T-W, Hsiao P-H, Liu Y.-C, Fu L.-C (2016) The manhunt network: People tracking in hybrid-overlapping under the vertical top-view depth camera networks. In 2016 International Conference on Advanced Robotics and Intelligent Systems (ARIS), IEEE, pp 1–6

  • Lukezic A, Vojir T, Cehovin Zajc L, Matas J, Kristan M (2017) Discriminative correlation filter with channel and spatial reliability. Proc IEEE Conf Comput Vis Pattern Recogn 2017:6309–6318

    Google Scholar 

  • Migniot C, Ababsa F (2013) 3d human tracking in a top view using depth information recorded by the xtion pro-live camera. In: International symposium on visual computing, Springer, pp 603–612

  • Migniot C, Ababsa F (2016) Hybrid 3d–2d human tracking in a top view. J Real Time Image Proc 11(4):769–784

    Article  Google Scholar 

  • Portmann J, Lynen S, Chli M, Siegwart R (2014) People detection and tracking from aerial thermal views. In: 2014 IEEE international conference on robotics and automation (ICRA), IEEE, pp 1794–1800

  • Prokaj J, Medioni G (2014) Persistent tracking for wide area aerial surveillance. Proce IEEE Conf Comput Vis Pattern Recogn 2014:1186–1193

    Google Scholar 

  • Rauter M (2013) Reliable human detection and tracking in top-view depth images. Proc IEEE Conf Comput Vis Pattern Recogn Workshops 2013:529–534

    Google Scholar 

  • Riaz F, Azad MA, Arshad J, Imran M, Hassan A, Rehman S (2019) Pervasive blood pressure monitoring using photoplethysmogram (ppg) sensor. Future Gener Comput Syst 98:120–130

    Article  Google Scholar 

  • Shu T, Xie D, Rothrock B, Todorovic S, Chun Zhu S (2015) Joint inference of groups, events and human roles in aerial videos. Proc IEEE Conf Comput Vis Pattern Recogn 2015:4576–4584

    Google Scholar 

  • Sigalas M, Pateraki M, Trahanias P (2016) Full-body pose tracking-the top view reprojection approach. IEEE Trans Pattern Anal Mach Intell 38(8):1569–1582

    Article  PubMed  Google Scholar 

  • Stahlschmidt C, Gavriilidis A, Velten J, Kummert A (2016) Applications for a people detection and tracking algorithm using a time-of-flight camera. Multimedia Tools Appl 75(17):10769–10786

    Article  Google Scholar 

  • Tseng T-E, Liu A-S, Hsiao P-H, Huang C-M, Fu L.-C (2014) Real-time people detection and tracking for indoor surveillance using multiple top-view depth cameras. In: 2014 IEEE/RSJ international conference on intelligent robots and systems, IEEE, pp 4077–4082

  • van Eekeren AW, Dijk J, Burghouts G (2014) Detection and tracking of humans from an airborne platform. In: Electro-optical and infrared systems: technology and applications XI, vol 9249, pp 92490S. International Society for Optics and Photonics

  • Vasuhi S, Vijayakumar M, Vaidehi V (2015) Real time multiple human tracking using kalman filter. In: 2015 3rd international conference on signal processing, communication and networking (ICSCN), IEEE, pp 1–6

  • Walha A, Wali A, Alimi AM (2015) Video stabilization with moving object detecting and tracking for aerial video surveillance. Multimedia Tools Appl 74(17):6745–6767

    Article  Google Scholar 

  • Wu C-J, Houben S, Marquardt N (2017) Eaglesense: Tracking people and devices in interactive spaces using real-time top-view depth-sensing. In: Proceedings of the 2017 CHI conference on human factors in computing systems, ACM, pp 3929–3942

  • Xiao J, Yang C, Han F, Cheng H (2008) Vehicle and person tracking in aerial videos. In: Multimodal technologies for perception of humans, Springer, pp 203–214

  • Yan W, Weber C, Wermter S (2011) A hybrid probabilistic neural model for person tracking based on a ceiling-mounted camera. J Ambient Intell Smart Env 3(3):237–252

    Google Scholar 

  • Zhang Z, Cohen F (2013) 3D- pedestrian tracking based on overhead cameras. In: 2013 Seventh international conference on distributed smart cameras (ICDSC), IEEE, pp 1–6

Download references

Acknowledgements

This research work is fully supported by NRPU project under project number 5840/KPK/NRPU/RND/HEC /2016. We are thankful to the Institute of Management Sciences and Higher Education Commission, Pakistan.

Author information

Authors and Affiliations

  1. Centre of Excellence in IT, Institute of Management Sciences, Peshawar, Pakistan

    Kaleem Ullah, Imran Ahmed, Misbah Ahmad, Muhammad Nawaz & Awais Adnan

  2. Department of Computer Science, Bahria University, Islamabad, Pakistan

    Arif Ur Rahman

Authors
  1. Kaleem Ullah
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Imran Ahmed
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Misbah Ahmad
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Arif Ur Rahman
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Muhammad Nawaz
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Awais Adnan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Arif Ur Rahman.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ullah, K., Ahmed, I., Ahmad, M. et al. Rotation invariant person tracker using top view. J Ambient Intell Human Comput 14, 15343–15359 (2023). https://doi.org/10.1007/s12652-019-01526-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12652-019-01526-5

Keywords

Search

Navigation