Abstract
In this paper, we propose a method for classification of sport videos using edge-based features, namely edge direction histogram and edge intensity histogram. We demonstrate that these features provide discriminative information useful for classification of sport videos, by considering five sports categories, namely, cricket, football, tennis, basketball and volleyball. The ability of autoassociative neural network (AANN) models to capture the distribution of feature vectors is exploited, to develop class-specific models using edge-based features. We show that combining evidence from complementary edge features results in improved classification performance. Also, combination of evidence from different classifiers like AANN, hidden Markov model (HMM) and support vector machine (SVM) helps improve the classification performance. Finally, the performance of the classification system is examined for test videos which do not belong to any of the above five categories. A low rate of misclassification error for these test videos validates the effectiveness of edge-based features and AANN models for video classification.
Similar content being viewed by others
References
Jain A., Duin R., Mao J.: Statistical pattern recognition: a review. IEEE Trans. Pattern Anal. Mach. Intell. 22, 4–37 (2000)
Wang Y., Liu Z., Huang J.C.: Multimedia content analysis using both audio and visual clues. IEEE Signal Process. Mag. 17, 12–36 (2000)
Assflag J., Bertini M., Colombo C., Bimbo A.D.: Semantic annotation of sports videos. IEEE Multimedia 9, 52–60 (2002)
Kokaram A., Rea N., Dahyot R., Tekalp A.M.: Browsing sports video. IEEE Signal Process. Mag. 5021, 47–58 (2006)
Lee, M.H., Nepal, S., Srinivasan, U.: Edge-based semantic classification of sports video sequences. In: International Conference on Multimedia and Expo, Baltimore, MD, USA (2003)
Yuan, Y., Wan, C.: The application of edge features in automatic sports genre classification. In: Proceedings of IEEE Conference on Cybernetics and Intelligent Systems, Singapore (2004)
Ma, Y.F., Zhang, H.J.: Motion pattern based video classification using support vector machines. In: Proceedings of the IEEE International Symposium on Circuit and Systems, Arizona, USA (2002)
Fablet, R., Bouthemy, P.: Statistical modeling for motion-based video classification and retrieval. In: Proceedings of the Workshop on Multimedia Content Based Indexing and Retrieval, France (2001)
Takagi, S., Hattori, S., Yokoyama, K., Kodate, A., Taminaga, H.: Sports video categorizing method using camera motion parameters. In: International Conference on Multimedia and Expo, Baltimore, MD, USA (2003)
Roach, M.J., Mason, J.S.D., Pawlewski, M.: Video genre classification using dynamics. In: Proceedings of the International Conference on Acoustics, Speech and Signal Processing, Utah, USA (2001)
Girgensohn, A., Foote, J.: Video classification using transform coefficients. In: Proceedings of the Internatioanl Conference on Acoustics, Speech and Signal Processing, Arizona, USA (1999)
Xu, L.Q., Li, Y.: Video classification using spatial–temporal features and PCA. In: International Conference on Multimedia and Expo, pp. 345–348 (2003)
Sahouria E., Zakhor A.: Content analysis of video using principal components. IEEE Trans. Circuits Syst. Video Technol. 9, 1290–1298 (1999)
Gibert, X., Li, H., Doermann, D.: Sports video classification using HMMs. In: International Conference on Multimedia and Expo, Baltimore, MD, USA (2003)
Yuan, Y., Song, Q.B., Shen, J.Y.: Automatic video classification using decision tree method. In: Proceedings of the IEEE International Conference on Machine Learning and Cybernetics, Beijing (2002)
(UPM-GTI, ES), J.M.M.: MPEG-7 Overview (version 8). ISO/IEC JTC1/SC29/WG11 N4980, Klangenfurt (July, 2002)
Canny J.: A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 8, 679–698 (1986)
Yegnanarayana B., Kishore S.: AANN: an alternative to GMM for pattern recognition. Neural Netw. 15, 459–469 (2002)
Rabiner L., Juang B.: An introduction to hidden Markov models. IEEE Acoust. Speech Signal Process. Mag. 3, 4–16 (1986)
Collobert R., Bengio S.: SVMTorch: support vector machines for large-scale regression problems. J. Mach. Learn. Res. 1, 143–160 (2001)
Yegnanarayana B.: Artificial Neural Networks. Prentice-Hall India, New Delhi (1999)
Haykin S.: Neural Networks: A Comprehensive Foundation. Prentice-Hall International, New Jersey (1999)
Baum L.E., Petrie T., Soules G., Weiss N.: A maximization technique occurring in the statistical analysis of probabilistic functions of Markov chains. Ann. Math. Stat. 41, 164–171 (1970)
HMM Tool Kit. Available at: http://htk.eng.cam.ac.uk/
Burges C.: A tutorial on support vector machines for pattern recognition. Data Mining Knowl. Discov. 2, 121–167 (1998)
SVM Tool Kit. Available at: http://www.idiap.ch/~bengio/projects/SVMTorch.html
Kittler J., Hatef M., Duin R.P.W., Matas J.: On combining classifiers. IEEE Trans. Pattern Anal. Mach. Intell. 20, 226–239 (1998)
Rohlfing T., Russakoff D.B., Maurer C.R.: Performance-based classifier combination in atlas-based image segmentation using expectation-maximization parameter estimation. IEEE Trans. Med. Imaging 23, 983–994 (2004)
Lam L., Suen C.Y.: Optimal combinations of pattern classifiers. Pattern Recognit. Lett. 16, 945–954 (1995)
Xu L., Krzyzak A., Suen C.Y.: Methods of combining multiple classifiers and their applications to handwriting recognition. IEEE Trans. Syst. Man, Cybern. 2, 418–435 (1992)
Truong, B.T., Venkatesh, S., Dorai, C.: Automatic genre identification for content-based video categorization. In: Proceedings of the International Conference on Pattern Recognition, Barcelona, Spain (2000)
Yegnanarayana, B., Gangashetty, S.V., Palanivel, S.: Autoassociative neural network models for pattern recognition tasks in speech and image. In: Soft Computing Approach to Pattern Recognition and Image Processing, World Scientific Publishing Co. Pte. Ltd, Singapore (2002) 283–305
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Krishna Mohan, C., Yegnanarayana, B. Classification of sport videos using edge-based features and autoassociative neural network models. SIViP 4, 61–73 (2010). https://doi.org/10.1007/s11760-008-0097-9
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-008-0097-9