Skip to main content
Log in

Active Foreground Region Extraction and Tracking for Sports Video Annotation

  • Published:
Neural Processing Letters Aims and scope Submit manuscript

Abstract

Automatic video segmentation plays a vital role in sports videos annotation. This paper presents a fully automatic and computationally efficient algorithm for analysis of sports videos. Various methods of automatic shot boundary detection have been proposed to perform automatic video segmentation. These investigations mainly concentrate on detecting fades and dissolves for fast processing of the entire video scene without providing any additional feedback on object relativity within the shots. The goal of the proposed method is to identify regions that perform certain activities in a scene. The model uses some low-level feature video processing algorithms to extract the shot boundaries from a video scene and to identify dominant colours within these boundaries. An object classification method is used for clustering the seed distributions of the dominant colours to homogeneous regions. Using a simple tracking method a classification of these regions to active or static is performed. The efficiency of the proposed framework is demonstrated over a standard video benchmark with numerous types of sport events and the experimental results show that our algorithm can be used with high accuracy for automatic annotation of active regions for sport videos.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Notes

  1. http://www.cvg.cs.rdg.ac.uk/VS/.

References

  1. Assfalg J, Bertini M, Colombo C, Del Bimbo A, Nunziat W (2005) Semantic annotation of soccer videos: automatic highlights identification. Comput Vis Image Underst 2:619–628

    Google Scholar 

  2. Belongie S, Carson C, Greenspan H, Malik J (1998) Color- and texture-based segmentation using EM and its application to content-based image retrieval, IEEE international conference computer vision, pp 675–682

  3. Bouwmans T, El Baf F (2009) Modeling of dynamic backgrounds by type-2 fuzzy Gaussians mixture models, MASAUM. J Basic Appl Sci 1(2):265–277

    Google Scholar 

  4. Bouwmans T, El Baf F, Vachon B (2008) Background modeling using mixture of Gaussians for foreground detection: a survey. Recent Pat Comput Sci 1(3):219–237

    Article  Google Scholar 

  5. Duan L, Xu M, Chua T, Tian Q, Xu C (2003) A mid-level representation framework for semantic sports video analysis. In Proceedings of ACM MM 2003 pp 33–44

  6. El Baf F, Bouwmans T, Vachon B (2008) Type-2 fuzzy mixture of Gaussians model: application to background modeling, intelligent symposium visual, computing

  7. Ekin A, Murat Tekalp A (2003) Robust dominant color region detection and color-based applications for sports video, IEEE international conference on image processing (ICIP), pp I21–I24

  8. Ekin A, Murat Tekalp A, Mehrota R (2003) Automatic soccer video analysis and summarization. IEEE Trans Image Process 12:796–807

    Article  Google Scholar 

  9. Fan J, Gao Y, Luo H (2004) Multi-level annotation of natural scenes using dominant image components and semantic concepts, ACM Multimedia (ACM MM 2004) pp 540–547

  10. Herrero-Jaraba E, Orrite-Uru\(\tilde{n}\)uela C, Senar J (2003) Detected motion classification with a double-background and a neighbourhood-based difference, pattern recognition letters 24:2079–2092

  11. Jiang S, Ye Q, Gao W, Huang T (2004) A new method to segment playfield and its applications in match analysis in sports videos, ACM MM, 292–295

  12. Jodoin P, Konrad J, Saligrama V, Veilleux-Gaboury V (2008) Motion detection with an unstable camera. In: Proceedings of IEEE Signal International Conference on Image Processing, pp 229–232

  13. Langmann B, Ghobadi SE, Hartmann K, Loffeld O (2010) Multi-modal background subtraction using gaussian mixture models, in ISPRS technical commission III symposium on photogrammetry computer vision and image analysis (PCV 2010), pp 61–66

  14. Lanza A, Tombari F, Di Stefano L (2010) Robust and efficient background subtraction by quadratic polynomial fitting, IEEE international conference on image processing (ICIP), pp 1537–1540

  15. Liu C, Yuen PC, Qiu G (2008) Generating novel information salient maps for foreground object detection in video, in congress on image and signal processing (IEEE), pp 196–200

  16. M. Mentzelopoulos, A Psarrou (2004) Key-frame extraction algorithm using entropy difference. In: Proceedings of the 6th ACM international workshop on multimedia information retrieval (MIR 04), 39–45 2004

  17. Okuma K, Little J, Lowe D (2003) Automatic acquisition of motion trajectories: tracking hockey players. SPIE Proc 5304:202–213

    Article  Google Scholar 

  18. Piccardi M (2004) Background subtraction techniques: a review. In: Proceedings of the IEEE international 286 conference on systems, man and cybernetics 4, pp 3099–3104

  19. Pers J, Kristan M, Perse M and Kovacic S (2008) Analysis of player motion in sport matches, computer science in sport: mission and methods

  20. Rissanen J (1999) Hypothesis selection and testing by the mdl principle. Comput J 42(4):260–269

    Article  MathSciNet  MATH  Google Scholar 

  21. Smith J (1999) Image classification and querying using composite region templates. Comput Vis Image Underst 75:165–174

    Article  Google Scholar 

  22. Tong X, Liu Q, Duan L, Lu H, Xu C, Tian Q (2005) A unified framework for semantic shot representation of sports video, ACM multimedia information retrieval MIR, pp 127–134

  23. Yan F, Christmas W, Kittle J (2005) A tennis ball tracking algorithm for automatic annotation of tennis match, BMVC 2, pp. 619–628

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Markos Mentzelopoulos.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Mentzelopoulos, M., Psarrou, A., Angelopoulou, A. et al. Active Foreground Region Extraction and Tracking for Sports Video Annotation. Neural Process Lett 37, 33–46 (2013). https://doi.org/10.1007/s11063-012-9267-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11063-012-9267-4

Keywords

Navigation