Skip to main content
Log in

Features extraction for soccer video semantic analysis: current achievements and remaining issues

  • Published:
Artificial Intelligence Review Aims and scope Submit manuscript

Abstract

This paper presents a state of the art review of features extraction for soccer video summarization research. The all existing approaches with regard to event detection, video summarization based on video stream and application of text sources in event detection have been surveyed. As regard the current challenges for automatic and real time provision of summary videos, different computer vision approaches are discussed and compared. Audio, video feature extraction methods and their combination with textual methods have been investigated. Available commercial products are presented to better clarify the boundaries in this domain and future directions for improvement of existing systems have been suggested.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Ariki Y, Kubota S, Kumano M (2006) Automatic production system of soccer sports video by digital camera work based on situation recognition. In: Proceedings of 8th IEEE international symposium on multimedia, California, pp 851–860

  • Bekhti S, Rehman A, Al-Harbi M, Saba T (2011) AQuASys an Arabic question-answering system based on extensive question analysis and answer relevance scoring. Inf Comput Int J Acad Res 3(4): 45–54

    Google Scholar 

  • Dang Zh, Du J, Huang Q, Jiang Sh (2007) Replay detection based on semi-automatic logo template sequence extraction in sports video. In: Fourth international conference on image and graphics, pp 839–844

  • D’Orazio T, Leo M (2010). A review of vision-based systems for soccer video analysis. Pattern Recognit 2911–2926

  • D’Orazio T, Ancona N, Cicirelli G, Nitti M (2002) A ball detection algorithm for real soccer image sequences. In: International conference on pattern recognition, pp 210–213

  • D’Orazio T, Guaragnella C, Leo M, Distante A (2004) A new algorithm for ball recognition using circle Hough transform and neural classifier. Pattern Recognit 37: 393–408

    Article  Google Scholar 

  • D’Orazio T, Leo M, Spagnolo P, Mazzeo PL, Mosca N, Nitti M, Distante A (2009a) An investigation into the feasibility of real-time soccer offside detection from a multiple camera system. IEEE Trans Circuits Syst Video Technol 1804–1818

  • D’Orazio T, Leo M, Spagnolo P, Nitti M, Mosca N (2009b) A visual system for real time detection of goal events during soccer matches. Comput Vis Image Underst 113(5): 622–632

    Article  Google Scholar 

  • Duan L, Xu M, Tian Q, Xu C (2005) Mean shift based video segment representation and applications to replay detection. In: Proceedings of IEEE international conference on acoustics, speech, and signal processing, pp 709–712

  • Elarbi-Boudihir M, Rehman A, Saba T (2011) Video motion perception using operation gabor filter. Int J Phys Sci 6(12): 2799–2806

    Google Scholar 

  • Eldib MY, AbouZaid BS, Zawbaa HM, Zahar ME, Saban ME (2009) Soccer video summarization using enhanced logo detection. IEEE Int Conf Image Process 113(5): 4345–4348

    Google Scholar 

  • Gao Y, Wang WB, Yong JH, Gu HU (2008) Dynamic video summarization using two-level redundancy detection. Multimed Tools Appl 43(8): 233–250

    Google Scholar 

  • Haron H, Rahim MSM, Rehman A, Saba T (2010) Curve length estimation using vertix chain code. Int J Comput Sci Eng 2(6): 2110–2113

    Google Scholar 

  • Haron H, Rehman A, Wulandhari LA, Saba T (2011) Improved vertex chain code algorithm for curve length estimation. J Comput Sci 7(5): 736–743. doi:10.3844/jcssp.2011.736.743

    Article  Google Scholar 

  • Haron H, Rehman A, Adi DIS, Lim SP, Saba T (2012) Parameterization method on B-spline curve mathematical problems in engineering 2012. doi:10.1155/2012/640472

  • Huang Ch L, Shih Ch H, Chao Ch Y (2006) Semantic analysis of soccer video using dynamic Bayesian network. IEEE Trans Multimed 749–760

  • Kim HG, Roeber S, Samour A, Sikora T (2005) Detection of goal event in soccer videos. Storage Retr Methods Appl Multimed 8(4): 317–325

    Google Scholar 

  • Kolekar MH (2010) Bayesian belief network based broadcast sports video indexing. Multimed Tools Appl 24(6): 27–54

    Google Scholar 

  • Kolekar MH, Palaniappan K, Sengupta S, Seetharaman G (2009) Event detection and semantic identification using Bayesian belief network. Workshop of IEEE 12th international conference on computer vision, Japan, pp 554–561

  • Kurniawan F, Rahim MSM, Daman D, Rehman A, Mohamod D, Mariyam S (2011) Region-based touched character segmentation in handwritten words. Int J Innov Comput Inf Control 7(6): 3107–3120

    Google Scholar 

  • Meethongjan K, Mohamod D, Rehman A, Saba T (2010) Face recognition based on fusion of Voronoi diagram automatic facial and wavelet moment invariants. Int J Video Process Image Process Netw Secur 10(4): 1–8

    Google Scholar 

  • Miura J, Shimawaki T, Sakiyama T, Shirai Y (2009) Ball route estimation under heavy occlusion in broadcast soccer video. Comput Vis Image Underst 113(5): 653–662

    Article  Google Scholar 

  • Money AG, Agius H (2007).Video summarization: a conceptual framework and survey of the state of the art. J Vis Commun Image Represent 121–143

  • Nitta N, Takahashi Y, Babaguchi N (2009) Automatic personalized video abstraction for sports videos using metadata. Multimed Tool Appl 1–25

  • Pallavi V, Mukherjee J, Majumdar AK, Sural Sh (2008) Ball detection from broadcast soccer videos using static and dynamic features. J Vis Commun Image Represent 426–436

  • Pan H, Beek P Van, Sezan MI (2001) Detection of slow-motion replay segments in sports video for highlights generation. In: Proceedings of IEEE international conference on acousitcs, speech, signal processing, Salt Lake City, 1649–1652

  • Phetchanchai C, Selamat A, Rehman A, Saba T (2010) Index financial time series based on zigzag-perceptually important points. J Comput Sci 6(12): 1389–1395

    Article  Google Scholar 

  • Ping SH, Qing YX (2009) Goal event detection in soccer videos using multi-clues detection rules. Manag Ser Sci 10(3): 1–4

    Google Scholar 

  • Rahim MSM, Rehman A, Faizal-Ab-Jabal M, Saba T (2011) Close spanning tree approach for error detection and correction for 2D CAD drawing. Int J Acad Res 3(4): 525–535

    Google Scholar 

  • Rahim MSM, Rehman A, Sholihah N, Kurniawan F, Saba T, Mohamod D (2012) Region-based features extraction in ear biometrics. Int J Acad Res 4(1): 37–42

    Google Scholar 

  • Rehman A, Mohamod D (2008) A simple segmentation approach for unconstrained cursive handwritten words in conjunction of neural network. Int J Image Process 2(3): 29–35

    Google Scholar 

  • Rehman A, Saba T (2011a) Performance analysis of segmentation approach for cursive handwritten word recognition on benchmark database. Digit Signal Process 21: 486–490

    Article  Google Scholar 

  • Rehman A, Saba T (2011b) Document Skew estimation and correction: analysis of techniques, common problems and possible solutions. Appl Artif Intell 25(9): 769–787

    Article  Google Scholar 

  • Rehman A, Kurniawan F, Mohamod D (2009) Neuro-heuristic approach for segmenting cursive handwritten words. Int J Inf Process, Bangalore, India. ISSN 0973-8215 3(2):37–46

    Google Scholar 

  • Rehman A, Kurniawan F, Saba T (2010a) An automatic approach for line detection and removal without characters smash-up. Imag Sci J 59: 171–182

    Google Scholar 

  • Rehman A, Saba T, Sulong G (2010b) An intelligent approach to image denoising. J Theor Appl Inf Technol 17(1): 32–36

    Google Scholar 

  • Saba T, Rehman A, Sulong G (2010a) Improved statistical features for cursive character recognition. Int J Innov Comput Inf Control (IJICIC) 7(9): 5211–5224

    Google Scholar 

  • Saba T, Rehman A, Sulong G (2010b) Cursive script segmentation with neural confidence. Int J Innov Comput Inf Control (IJICIC) 7(7): 1–10

    Google Scholar 

  • Saba T, Rehman A, Sulong G (2010c) Non-linear segmentation of touched roman characters based on genetic algorithm. Int J Comput Sci Eng 2(6): 2167–2172

    Google Scholar 

  • Saba T, Sulong G, Rehman A (2011) Document image analysis: issues, comparison of methods and remaining problems. Artif Intell Rev 35(2): 101–118. doi:10.1007/s10462-010-9186-6

    Article  Google Scholar 

  • Saba T, Rehman A (2012) Effects of artificially intelligent tools on pattern recognition. Int J Mach Learn Cybern. doi:10.1007/s13042-012-0082-z

  • Shyu ML, Xie Z, Chen M, Chen Sh Ch (2008) Video semantic event/concept detection using a subspace-based multimedia data mining framework. IEEE Trans Multimed 10(2): 252–259

    Article  Google Scholar 

  • Tjondronegoro DW, Phoebe Chen YP (2009) Knowledge-discounted event detection in sports video. IEEE Trans Syst Man Cybern

  • Tjondronegoro D, Chen YPP, Pham B (2004a) Integrating highlights to play–break sequences for more complete sport video summarization. IEEE Multimed 11: 22–37

    Article  Google Scholar 

  • Tjondronegoro D, Chen YPP, Pham B (2004b) The power of play–break for automatic detection and browsing of self-consumable sport video highlights. In: Proceedings of 6th ACM workshop on multimedia information retrieval, 267–274

  • Wang J, Xu Ch, Chng E, Tian Q (2004) Sports highlight detection from keyword sequences using HMM. In: Proceedings of IEEE ICME, Taiwan, pp 27–30

  • Wang J, Chng E, Xu C (2005) Soccer replay detection using scene transition structure analysis. In: Proceedings of IEEE international conference on acoustics, speech, signal processing, pp 433–436

  • Xie L, Chang SF, Divakaran A, Sun H (2003) Unsupervised discovery of multilevel statistical video structures using hierarchical hidden Markov models. In: IEEE international conference on multimedia and expo, Baltimore, pp 29–32

  • Xie Z, Shyu ML, Chen Sh Ch (2007) Video event detection with combined distance-based and rule based data mining techniques. In: IEEE international conference on multimedia and expo, pp 2026–2029

  • Xu Ch, Wang J, Wan K, Li Y, Duan L (2006) Live sports event detection based on broadcast video and web-casting text. In: Proceedings of the 14th annual ACM international conference on multimedia, pp 221–230

  • Xu Ch, Zhang YF, Zhu G, Rui Y, Lu H, Huang Q (2008a) Using webcast text for semantic event detection in broadcast sports video. IEEE Trans Multimed 8(6): 1342–1355

    Google Scholar 

  • Xu Ch, Wang J, Lu H, Zhang Y (2008b) A novel framework for semantic annotation and personalized retrieval of sports video. IEEE Trans Multimed, 421–436

  • Yoon HS, Bae YLJ, Yang YK (2002) A soccer image sequence mosaicing and analysis method using line and advertisement board detection. ETRI J 443–454

  • Yu X, Leong H W, Xu C, Tian Q (2006) Trajectory-based ball detection and tracking in broadcast soccer video. IEEE Trans Multimed 1164–1178

  • Yu X, Li L, Leong H W (2009) Interactive broadcast services for live soccer video based on instant semantics acquisition. J Vis Commun Image Rep 20: 117–130

    Article  Google Scholar 

  • Zhu G, Xu Ch, Huang Q, Rui Y, Jiang Sh, Wen Gao, Yao H (2009) Event tactic analysis based on broadcast sports video. IEEE Trans Multimed 49–67

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Tanzila Saba.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Rehman, A., Saba, T. Features extraction for soccer video semantic analysis: current achievements and remaining issues. Artif Intell Rev 41, 451–461 (2014). https://doi.org/10.1007/s10462-012-9319-1

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10462-012-9319-1

Keywords

Navigation