Abstract
In this paper we present a new event analysis framework based on mixture hidden Markov model (HMM) for ice hockey videos. Hockey is a competitive sport and hockey videos are hard to analyze because of the homogeneity of its frame features. However, the temporal dynamics of hockey videos is highly structured. Using the mixture representation of local observations and Markov chain property of hockey event structure, we successfully model the hockey event as a mixture HMM. Based on the mixture HMM, the hockey event could be classified with high accuracy. Two types of mixture HMMs, Gaussian mixture and independent component analysis (ICA) mixture, are compared for the hockey video event classification. The results confirm our analysis that the mixture HMM is a suitable model to deal with videos with intensive activities. The new mixture HMM hockey event model could be a very useful tool for hockey game analysis.





Similar content being viewed by others
Explore related subjects
Discover the latest articles and news from researchers in related subjects, suggested using machine learning.References
Baillie M, Jose J, van Rijsbergen C (2004) HMM model selection issues for soccer video. In: Proc. int. conf. content-based image and video retrieval, pp 70–78
Chang P, Han M, Gong Y (2002) Extract highlights from baseball game video with hidden Markov models. In: Proc. int. conf. image processing, vol 1, pp 609–612
Drew M, Wei J, Li Z (1998) Illumination-invariant color object recognition via compressed chromaticity histograms of color-channel-normalize images. In: Proc. int’l. conf. computer vision, pp 533–540
Ekin A, Tekalp AM, Mehrotra R (2003) Automatic soccer video analysis and summarization. IEEE Trans Image Process 12(7):796–807
Gibert X, Li H, Doermann D (2003) Sports video classification using HMM. In: Proc. int. conf. on multimedia and expo, vol 2, pp 345–348
Gong Y, Han M, Hua W, Xu W (2004) Maximum entropy model-based baseball highlight detection and classification. Comput Vis Image Underst 96(2):181–199
Gong Y, Xu W (2007) Machine learning for multimedia content analysis. Springer, Berlin
Hanjalic A (2002) Shot-boundary detection: unraveled and resolved. IEEE Trans Circuit Syst Video Technol 12(2):90–104
Hanjalic A (2004) Content-based analysis of digital video. Kluwer, Norwell
Huang J, Liu Z, Wang Y (2000) Joint video scene segmentation and classification based on hidden Markov model. In: Proc. int. conf. on multimedia and expo. New York, pp 1551–1554
Jin G, Tao L, Xu G (2004) Hidden Markov model based events detection in soccer video. In: Proc. int. conf. on image analysis and recognition, pp I:605–I:612
Kijak E, Oisel L, Gros P (2003) Hierarchical structure analysis of sport videos using HMMs. In: Proc. int. conf. image processing, pp II:1025–II:1028
Kim H-G, Roeber S, Samour A, Sikora T (2004) Detection of goal events in soccer videos. In: Society of Photo-Optical Instrumentation Engineers (SPIE) conference series, vol 5682, pp 317–325
Lavee G, Rivlin E, Rudzsky M (2009) Understanding video events: A survey of methods for automatic interpretation of semantic occurrences in video. IEEE Trans Syst Man Cybern C Appl Rev 39(5):489–504
Lee T, Lewicki MS, Sejnowski TJ (2000) ICA mixture models for unsupervised classification and automatic context switching. IEEE Trans Pattern Anal Mach Intell 22(10):1078–1089
Li F, Woodham R (2009) Video analysis of hockey play in selected game situations. J Image Vis Comput 27(1–2):45–58
Liu S, Xu M, Yi H, Chia L, Rajan D (2006) Multimodal semantic analysis and annotation for basketball video. EURASIP J Appl Signal Process 2006:182–182
Liu Z, Huang J, Wang Y (1998) Classification of tv programs based on audio information using hidden Markov model. In: IEEE signal processing society workshop on multimedia signal processing, pp 27–32
Naphade M, Huang T (2002) Extracting semantics from audiovisual content: the final frontier in multimedia retrieval. IEEE Trans Neural Netw 13(4):793–810
Rabiner LR (1989) A tutorial on hidden Markov models and selected applications in speech recognition. Proc IEEE 77(2):257–286
Sadlier D, O’Connor N (2005) Event detection in field sports video using audio-visual features and a support vector machine. IEEE Trans Circuit Syst Video Technol 15(10):1225–1233
Wang J, Xu C, Chng E (2006) Automatic sports video genre classification using pseudo-2d-hmm. In: The 18th international conference on pattern recognition
Wang J, Xu C, Chng E, Tian Q (2004) Sports highlight detection from keyword sequences using hmm. In: IEEE international conference on multimedia and expo
Wang Y, Liu Z, Huang J (2000) Multimedia content analysis using both audio and visual cues. IEEE Signal Process Mag 17(6):12–36
Xie L, Chang S (2004) Structure analysis of soccer video with hidden Markov models. Pattern Recogn Lett 25(7):767–775
Xie L, Sundaram H, Campbell M (2008) Event mining in multimedia streams. Proc IEEE 96(4):623–647
Xiong Z, Radhakrishnan R, Divakaran A, Huang TS (2003) Audio events detection based highlights extraction from baseball, golf and soccer games in a unified framework. In: Proc. int. conf. acoust., speech, signal processing, pp 401–404
Xu G, Ma Y, Zhang H, Yang S (2005) An HMM-based framework for video semantic analysis. IEEE Trans Circuit Syst Video Technol 15(11):1422–1433
Yang Y, Lin S, Zhang Y, Tang S (2007) Statistical framework for shot segmentation and classification in sports video. In: Proc. Asian conference on computer vision, pp II:106–II:115
Zhang H, Kankanhalli A, Somaliar S (1993) Automatic partition of full-motion video. Multimedia Syst 1(1):11–28
Zhou J, Zhang X (2005) Video shot boundary detection using independent component analysis. In: Proceedings. (ICASSP ’05). IEEE international conference on acoustics, speech, and signal processing, vol 2, pp 541–544
Zhou J, Zhang X (2008) An ICA mixture hidden Markov model for video content analysis. IEEE Trans Circuit Syst Video Technol 18(11):1576–1586
Author information
Authors and Affiliations
Corresponding author
Additional information
Parts of this article also appeared in the Proc. of the 1st ACM International Workshop on Events in Multimedia (EiMM09) in conjunction with ACM Multimedia 2009, October 19–24, 2009, Beijing, China.
Rights and permissions
About this article
Cite this article
Wang, X., Zhang, XP. Ice hockey shooting event modeling with mixture hidden Markov model. Multimed Tools Appl 57, 131–144 (2012). https://doi.org/10.1007/s11042-010-0722-9
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-010-0722-9