Skip to main content
Springer Nature Link
Log in

Classification of Punches in Olympic Boxing Using Static RGB Cameras

  • Conference paper
  • First Online:
Computational Collective Intelligence (ICCCI 2023)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 14162))

Included in the following conference series:

  • 917 Accesses

Abstract

Cameras in sports continuously track athletes, recognize their activities, and monitor performance. This capability is ensured by sophisticated computer vision systems with machine learning algorithms and massive computation power. Combat sports are rather challenging because punches happen rather quickly. This paper provides comprehensive research on approaches to measuring the performance of athletes in combat sports. We use RGB cameras to measure athletes’ activity from a distance without interfering with their equipment, in contrast to the approach which uses wearable sensors. The aim of this paper is to provide a solution to classify punches in Olympic boxing based on static RGB cameras opposite the boxing ring. The proposed solution classifies three types of punches and the best classifier obtained sequentially 94%, 84%, and 81% of the F1 score for them. Finally, we measured the impact of the data augmentation process on classification performance and provide future works.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    https://github.com/opencv/cvat.

References

  1. Albawi, S., Mohammed, T.A., Al-Zawi, S.: Understanding of a convolutional neural network. In: 2017 International Conference on Engineering and Technology (ICET). IEEE (2017). https://doi.org/10.1109/icengtechnol.2017.8308186

  2. Barnich, O., Droogenbroeck, M.V.: ViBe: a universal background subtraction algorithm for video sequences. IEEE Trans. Image Process. 20(6), 1709–1724 (2011). https://doi.org/10.1109/tip.2010.2101613

    Article  MathSciNet  MATH  Google Scholar 

  3. Baygin, M., Karakose, M., Sarimaden, A., Erhan, A.: Machine vision based defect detection approach using image processing. In: 2017 International Artificial Intelligence and Data Processing Symposium (IDAP). IEEE (2017). https://doi.org/10.1109/idap.2017.8090292

  4. Behendi, S.K., Morgan, S., Fookes, C.B.: Non-invasive performance measurement in combat sports. In: Chung, P., Soltoggio, A., Dawson, C.W., Meng, Q., Pain, M. (eds.) Proceedings of the 10th International Symposium on Computer Science in Sports (ISCSS). AISC, vol. 392, pp. 3–10. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-24560-7_1

    Chapter  Google Scholar 

  5. Buric, M., Pobar, M., Ivasic-Kos, M.: Object detection in sports videos. In: 2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO). IEEE (2018). https://doi.org/10.23919/mipro.2018.8400189

  6. Chen, C., Surette, R., Shah, M.: Automated monitoring for security camera networks: promise from computer vision labs. Secur. J. 34(3), 389–409 (2020). https://doi.org/10.1057/s41284-020-00230-w

    Article  Google Scholar 

  7. Comaniciu, D., Ramesh, V., Meer, P.: Kernel-based object tracking. IEEE Trans. Pattern Anal. Mach. Intell. 25(5), 564–577 (2003). https://doi.org/10.1109/tpami.2003.1195991

    Article  Google Scholar 

  8. D’Orazio, T., Leo, M.: A review of vision-based systems for soccer video analysis. Pattern Recogn. 43(8), 2911–2926 (2010). https://doi.org/10.1016/j.patcog.2010.03.009

    Article  Google Scholar 

  9. Garcia-Garcia, B., Bouwmans, T., Silva, A.J.R.: Background subtraction in real applications: challenges, current models and future directions. Comput. Sci. Rev. 35, 100204 (2020). https://doi.org/10.1016/j.cosrev.2019.100204

    Article  MathSciNet  Google Scholar 

  10. Grandini, M., Bagli, E., Visani, G.: Metrics for multi-class classification: an overview (2020). https://doi.org/10.48550/ARXIV.2008.05756

  11. Elbehiery, H., Hefnawy, A., Elewa, M.: Surface defects detection for ceramic tiles using image processing and morphological techniques (2007). https://doi.org/10.5281/ZENODO.1084534

  12. Hahn, A., et al.: Development of an automated scoring system for amateur boxing. Procedia Eng. 2(2), 3095–3101 (2010). https://doi.org/10.1016/j.proeng.2010.04.117

    Article  Google Scholar 

  13. Hinton, G.E., Srivastava, N., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.R.: Improving neural networks by preventing co-adaptation of feature detectors (2012). https://doi.org/10.48550/ARXIV.1207.0580

  14. Jeffries, C.T.: Sports analytics with computer vision (2018). https://openworks.wooster.edu/independentstudy/8103/

  15. Jia, W., et al.: Real-time automatic helmet detection of motorcyclists in urban traffic using improved YOLOv5 detector. IET Image Process. 15(14), 3623–3637 (2021). https://doi.org/10.1049/ipr2.12295

    Article  Google Scholar 

  16. Kasiri, S., Fookes, C., Sridharan, S., Morgan, S.: Fine-grained action recognition of boxing punches from depth imagery. Comput. Vis. Image Underst. 159, 143–153 (2017). https://doi.org/10.1016/j.cviu.2017.04.007

    Article  Google Scholar 

  17. Kasiri-Bidhendi, S., Fookes, C., Morgan, S., Martin, D.T., Sridharan, S.: Combat sports analytics: boxing punch classification using overhead depthimagery. In: 2015 IEEE International Conference on Image Processing (ICIP). IEEE (2015). https://doi.org/10.1109/icip.2015.7351667

  18. Kato, S., Yamagiwa, S.: Predicting successful throwing technique in judo from factors of kumite posture based on a machine-learning approach. Computation 10(10), 175 (2022). https://doi.org/10.3390/computation10100175

    Article  Google Scholar 

  19. Khasanshin, I.: Application of an artificial neural network to automate the measurement of kinematic characteristics of punches in boxing. Appl. Sci. 11(3), 1223 (2021). https://doi.org/10.3390/app11031223

    Article  Google Scholar 

  20. Li, H., Tang, J., Wu, S., Zhang, Y., Lin, S.: Automatic detection and analysis of player action in moving background sports video sequences. IEEE Trans. Circ. Syst. Video Technol. 20(3), 351–364 (2010). https://doi.org/10.1109/tcsvt.2009.2035833

    Article  Google Scholar 

  21. Li, J., et al.: Safety helmet wearing detection based on image processing and machine learning. In: 2017 Ninth International Conference on Advanced Computational Intelligence (ICACI). IEEE (2017). https://doi.org/10.1109/icaci.2017.7974509

  22. Ni, B., Nguyen, C.D., Moulin, P.: RGBD-camera based get-up event detection for hospital fall prevention. In: 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE (2012). https://doi.org/10.1109/icassp.2012.6287947

  23. Paneru, S., Jeelani, I.: Computer vision applications in construction: current state, opportunities & challenges. Autom. Constr. 132, 103940 (2021). https://doi.org/10.1016/j.autcon.2021.103940

    Article  Google Scholar 

  24. Quinn, E., Corcoran, N.: Automation of computer vision applications for real-time combat sports video analysis. In: European Conference on the Impact of Artificial Intelligence and Robotics, vol. 4, no. 1, pp. 162–171 (2022). https://doi.org/10.34190/eciair.4.1.930

  25. Seo, J., Han, S., Lee, S., Kim, H.: Computer vision techniques for construction safety and health monitoring. Adv. Eng. Inform. 29(2), 239–251 (2015). https://doi.org/10.1016/j.aei.2015.02.001

    Article  Google Scholar 

  26. Setterwall, D.: Computerised video analysis of football - technical and commercial possibilities for football coaching. Unpublished Masters Thesis, Stockholms Universitet (2003)

    Google Scholar 

  27. Sokolova, M., Lapalme, G.: A systematic analysis of performance measures for classification tasks. Inf. Process. Manag. 45(4), 427–437 (2009). https://doi.org/10.1016/j.ipm.2009.03.002

    Article  Google Scholar 

  28. Stefański, P., Kozak, J., Jach, T.: The problem of detecting boxers in the boxing ring. In: Szczerbicki, E., Wojtkiewicz, K., Nguyen, S.V., Pietranik, M., Krótkiewicz, M. (eds.) ACIIDS 2022. CCIS, vol. 1716, pp. 592–603. Springer, Cham (2022). https://doi.org/10.1007/978-981-19-8234-7_46

    Chapter  Google Scholar 

  29. Stefański, P.: Detecting clashes in boxing. In: Proceedings of the 3rd Polish Conference on Artificial Intelligence, Gdynia, Poland, 25–27 April 2022, pp. 29–32 (2022). https://wydawnictwo.umg.edu.pl/pp-rai2022/pdfs/06_pp-rai-2022-026.pdf

  30. Stein, M., et al.: Bring it to the pitch: combining video and movement data to enhance team sport analysis. IEEE Trans. Vis. Comput. Graph. 24(1), 13–22 (2018). https://doi.org/10.1109/tvcg.2017.2745181

    Article  Google Scholar 

  31. Sudhir, G., Lee, J., Jain, A.: Automatic classification of tennis video for high-level content-based retrieval. In: Proceedings 1998 IEEE International Workshop on Content-Based Access of Image and Video Database. IEEE Computer Society (1998). https://doi.org/10.1109/caivd.1998.646036

  32. Thomas, G.: Real-time camera tracking using sports pitch markings. J. Real-Time Image Process. 2(2–3), 117–132 (2007). https://doi.org/10.1007/s11554-007-0041-1

    Article  Google Scholar 

  33. Thomas, G., Gade, R., Moeslund, T.B., Carr, P., Hilton, A.: Computer vision for sports: current applications and research topics. Comput. Vis. Image Underst. 159, 3–18 (2017). https://doi.org/10.1016/j.cviu.2017.04.011

    Article  Google Scholar 

  34. Wattanamongkhol, N., Kumhom, P., Chamnongthai, K.: A method of glove tracking for amateur boxing refereeing. In: IEEE International Symposium on Communications and Information Technology 2005, ISCIT 2005. IEEE (2006). https://doi.org/10.1109/iscit.2005.1566786

  35. Worsey, M., Espinosa, H., Shepherd, J., Thiel, D.: Inertial sensors for performance analysis in combat sports: a systematic review. Sports 7(1), 28 (2019). https://doi.org/10.3390/sports7010028

    Article  Google Scholar 

  36. Worsey, M.T.O., Espinosa, H.G., Shepherd, J.B., Thiel, D.V.: An evaluation of wearable inertial sensor configuration and supervised machine learning models for automatic punch classification in boxing. IoT 1(2), 360–381 (2020). https://doi.org/10.3390/iot1020021

    Article  Google Scholar 

  37. Wu, Y.J., Tsai, C.M., Shih, F.: Improving leaf classification rate via background removal and ROI extraction. J. Image Graph. 4(2), 93–98 (2016). https://doi.org/10.18178/joig.4.2.93-98

    Article  Google Scholar 

  38. Wu, Y., Lim, J., Yang, M.H.: Object tracking benchmark. IEEE Trans. Pattern Anal. Mach. Intell. 37(9), 1834–1848 (2015). https://doi.org/10.1109/tpami.2014.2388226

    Article  Google Scholar 

  39. Ye, X., et al.: All-textile sensors for boxing punch force and velocity detection. Nano Energy 97, 107114 (2022). https://doi.org/10.1016/j.nanoen.2022.107114

    Article  Google Scholar 

  40. Yilmaz, A., Javed, O., Shah, M.: Object tracking. ACM Comput. Surv. 38(4), 13 (2006). https://doi.org/10.1145/1177352.1177355

    Article  Google Scholar 

  41. Zhong, Z., Zheng, L., Kang, G., Li, S., Yang, Y.: Random erasing data augmentation. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, no. 07, pp. 13001–13008 (2020). https://doi.org/10.1609/aaai.v34i07.7000

  42. Zhou, F., Zhao, H., Nie, Z.: Safety helmet detection based on YOLOv5. In: 2021 IEEE International Conference on Power Electronics, Computer Applications (ICPECA). IEEE (2021). https://doi.org/10.1109/icpeca51329.2021.9362711

  43. Zhu, G., et al.: Event tactic analysis based on broadcast sports video. IEEE Trans. Multimedia 11(1), 49–67 (2009). https://doi.org/10.1109/tmm.2008.2008918

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Machine Learning, University of Economics in Katowice, 1 Maja, 40-287, Katowice, Poland

    Piotr Stefański, Tomasz Jach & Jan Kozak

Authors
  1. Piotr Stefański
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Tomasz Jach
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jan Kozak
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Piotr Stefański .

Editor information

Editors and Affiliations

  1. Wrocław University of Science and Technology, Wrocław, Poland

    Ngoc Thanh Nguyen

  2. Eötvös Loránd University, Budapest, Hungary

    János Botzheim

  3. Eötvös Loránd University, Budapest, Hungary

    László Gulyás

  4. Universidad Complutense de Madrid, Madrid, Spain

    Manuel Núñez

  5. Vrije Universiteit Amsterdam, Amsterdam, The Netherlands

    Jan Treur

  6. Universität Münster, Münster, Germany

    Gottfried Vossen

  7. Wrocław University of Science and Technology, Wrocław, Poland

    Adrianna Kozierkiewicz

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Stefański, P., Jach, T., Kozak, J. (2023). Classification of Punches in Olympic Boxing Using Static RGB Cameras. In: Nguyen, N.T., et al. Computational Collective Intelligence. ICCCI 2023. Lecture Notes in Computer Science(), vol 14162. Springer, Cham. https://doi.org/10.1007/978-3-031-41456-5_41

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-41456-5_41

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-41455-8

  • Online ISBN: 978-3-031-41456-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics