Skip to main content
SpringerLink
Log in

Player target tracking and detection in football game video using edge computing and deep learning

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

The purpose is to explore the player detection and motion tracking in football game video based on edge computing and deep learning (DL), thus improving the detection effect of player trajectory in different scenes. First, the basic technology of player target tracking and detection task is analyzed based on the Histograms of Oriented Gradients feature. Then, the neural network structure in DL is combined with the target tracking method to improve the miss detection problem of the Faster R-CNN (FRCN) algorithm in detecting small targets. Edge computing places massive computing nodes close to the terminal devices to meet the high computing and low latency requirements of DL on edge devices. After the occlusion problem in the football game is analyzed, the optimized algorithm is applied to the public dataset OTB2013 and the football game dataset containing 80 motion trajectories. After testing, the target tracking accuracy of the improved FRCN is 89.1%, the target tracking success rate is 64.5%, and the running frame rate is still about 25 fps. The high confidence of FRCN algorithm also avoids template pollution. In the ordinary scene, the FRCN algorithm basically does not lose the target. The area under curve value of the proposed FRCN algorithm decreases slightly in the scene where the target is occluded. The FRCN algorithm based on DL technology can achieve the target tracking of players in football game video and has strong robustness to the situation of players occlusion. The designed target detection algorithm is applied to the football game video, which can better analyze the technical characteristics of players, promote the development of football technology, bring different viewing experiences to the audience, drive the development of economic products derived from football games, and promote the dissemination and promotion of football.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. Wang B, Shen W, Chen FS et al (2019) Football match intelligent editing system based on deep learning. TIIS 13(10):5130–5143

    Google Scholar 

  2. Sharma RA, Gandhi V, Chari V et al (2017) Automatic analysis of broadcast football videos using contextual priors. SIViP 11(1):171–178

    Article  Google Scholar 

  3. Kamble PR, Keskar AG, Bhurchandi KM (2019) A deep learning ball tracking system in soccer videos. Opto-Electron Rev 27(1):58–69

    Article  Google Scholar 

  4. Cust EE, Sweeting AJ, Ball K et al (2019) Machine and deep learning for sport-specific movement recognition: a systematic review of model development and performance. J Sports Sci 37(5):568–600

    Article  Google Scholar 

  5. Engerman JA, Carr-Chellman AA, MacAllan M (2019) Understanding learning in video games: a phenomenological approach to unpacking boy cultures in virtual worlds. Educ Inf Technol 24(6):3311–3327

    Article  Google Scholar 

  6. Kong Y, Wei Z, Huang S (2018) Automatic analysis of complex athlete techniques in broadcast taekwondo video. Multimed Tools Appl 77(11):13643–13660

    Article  Google Scholar 

  7. Wan J, Zhang H (2010) Discussion on city slow-traveling traffic system based on low-carbon concept. Western China Commun Sci Technol 7:22–25

    Google Scholar 

  8. Jin Z, Hou Z, Yu W et al (2017) Game theory-based visual tracking approach focusing on color and texture features. Appl Opt 56(21):5982–5989

    Article  Google Scholar 

  9. Ge JY, Lee WH (2017) 2D flying shooting game: game art using circular collision detection and target tracking. TECHART J Arts Imaging Sci 4(4):13–17

    Article  Google Scholar 

  10. Chen Y, Sun X, Gong D et al (2019) DPM-IEDA: dual probabilistic model assisted interactive estimation of distribution algorithm for personalized search. IEEE Access 7:41006–41016

    Article  Google Scholar 

  11. Xiang Z, Tan H, Ye W (2018) The excellent properties of a dense grid-based HOG feature on face recognition compared to Gabor and LBP. IEEE Access 6:29306–29319

    Article  Google Scholar 

  12. Zidi S, Moulahi T, Alaya B (2017) Fault detection in wireless sensor networks through SVM classifier. IEEE Sens J 18(1):340–347

    Article  Google Scholar 

  13. Meng R, Rice SG, Wang J et al (2018) A fusion steganographic algorithm based on faster R-CNN. Comput Mater Continua 55(1):1–16

    Google Scholar 

  14. Wang X, Wang S, Cao J et al (2020) Data-driven based tiny-YOLOv3 method for front vehicle detection inducing SPP-net. IEEE Access 8:110227–110236

    Article  Google Scholar 

  15. Qi L, Li B, Chen L et al (2019) Ship target detection algorithm based on improved faster R-CNN. Electronics 8(9):959

    Article  Google Scholar 

  16. Gao M, Du Y, Yang Y et al (2019) Adaptive anchor box mechanism to improve the accuracy in the object detection system. Multimed Tools Appl 78(19):27383–27402

    Article  Google Scholar 

  17. Sarıgül M, Ozyildirim BM, Avci M (2019) Differential convolutional neural network. Neural Netw 116:279–287

    Article  Google Scholar 

  18. Bouteraa Y, Abdallah IB, Elmogy AM (2019) Training of hand rehabilitation using low cost exoskeleton and vision-based game interface. J Intell Rob Syst 96(1):31–47

    Article  Google Scholar 

  19. Ye Z, Ye H (2020) Particle filter algorithm based spatial motion tracking of football landing location. Multimed Tools Appl 79(7):5053–5063

    Article  Google Scholar 

  20. Asghari OM (2017) Adaptive Kalman filter applied to vision based head gesture tracking for playing video games. Robotics 6(4):33

    Article  Google Scholar 

  21. Ghazal M, Doustmohammadi A (2016) A novel target tracking algorithm for simultaneous measurements of radar and infrared sensors. Adv Electr Comput Eng 16(3):57–65

    Article  Google Scholar 

  22. Föcker J, Cole D, Beer AL et al (2018) Neural bases of enhanced attentional control: lessons from action video game players. Brain Behav 8(7):e01019

    Article  Google Scholar 

  23. Luo W, Sun P, Zhong F et al (2019) End-to-end active object tracking and its real-world deployment via reinforcement learning. IEEE Trans Pattern Anal Mach Intell 42(6):1317–1332

    Article  Google Scholar 

  24. Claypool M (2018) Game input with delay—moving target selection with a game controller thumbstick. ACM Trans Multimed Comput Commun Appl 14(3):1–22

    Article  Google Scholar 

  25. Choo Y, Jang J, Paik J (2019) Scene mapping-based video registration using frame similarity measurement and feature tracking. IEIE Trans Smart Process Comput 8(6):456–464

    Article  Google Scholar 

  26. Zhang H, Liu W, Xie J et al (2020) Joint subarray selection and power allocation for cognitive target tracking in large-scale MIMO radar networks. IEEE Syst J 14(2):2569–2580

    Article  Google Scholar 

  27. Feng J, Zhao H (2018) Energy-balanced multisensory scheduling for target tracking in wireless sensor networks. Sensors 18(10):3585

    Article  Google Scholar 

  28. Roettl J, Terlutter R (2018) The same video game in 2D, 3D or virtual reality–How does technology impact game evaluation and brand placements. PLoS ONE 13(7):e0200724

    Article  Google Scholar 

  29. Mercado J, Espinosa-Curiel I, Escobedo L et al (2019) Developing and evaluating a BCI video game for neurofeedback training: the case of autism. Multimed Tools Appl 78(10):13675–13712

    Article  Google Scholar 

  30. Howard CJ, Wilding R, Guest D (2017) Light video game play is associated with enhanced visual processing of rapid serial visual presentation targets. Perception 46(2):161–177

    Article  Google Scholar 

  31. Wan S, Qi L, Xu X et al (2020) Deep learning models for real-time human activity recognition with smartphones. Mob Netw Appl 25(2):743–755

    Article  Google Scholar 

  32. Xiao L, Wang H, Hu Z (2018) Visual tracking via adaptive random projection based on sub-regions. IEEE Access 6:41955–41965

    Article  Google Scholar 

  33. Qin P, Pun CM (2018) Object tracking using distribution fields with correlation coefficients. Multimed Tools Appl 77(7):8979–9002

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by National Natural Science Foundation of China under Grant 51674063 and Teacher Development Project of Northeast University (DDJFZ202005).

Author information

Authors and Affiliations

  1. Physical Education Department, Northeastern University, Shenyang, 110000, Liaoning, China

    Gang Jin

Authors
  1. Gang Jin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Gang Jin.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jin, G. Player target tracking and detection in football game video using edge computing and deep learning. J Supercomput 78, 9475–9491 (2022). https://doi.org/10.1007/s11227-021-04274-6

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-021-04274-6

Keywords

Search

Navigation