Skip to main content
Log in

Shot classification and replay detection for sports video summarization

体育视频摘要中的镜头分类和回放检测

  • Research Article
  • Published:
Frontiers of Information Technology & Electronic Engineering Aims and scope Submit manuscript

Abstract

Automated analysis of sports video summarization is challenging due to variations in cameras, replay speed, illumination conditions, editing effects, game structure, genre, etc. To address these challenges, we propose an effective video summarization framework based on shot classification and replay detection for field sports videos. Accurate shot classification is mandatory to better structure the input video for further processing, i.e., key events or replay detection. Therefore, we present a lightweight convolutional neural network based method for shot classification. Then we analyze each shot for replay detection and specifically detect the successive batch of logo transition frames that identify the replay segments from the sports videos. For this purpose, we propose local octa-pattern features to represent video frames and train the extreme learning machine for classification as replay or non-replay frames. The proposed framework is robust to variations in cameras, replay speed, shot speed, illumination conditions, game structure, sports genre, broadcasters, logo designs and placement, frame transitions, and editing effects. The performance of our framework is evaluated on a dataset containing diverse YouTube sports videos of soccer, baseball, and cricket. Experimental results demonstrate that the proposed framework can reliably be used for shot classification and replay detection to summarize field sports videos.

摘要

由于摄像机、回放速度、光照条件、剪辑效果、比赛结构和类型等方面的差异, 体育视频摘要的自动分析具有挑战性。为了解决这些问题, 针对户外运动视频, 本文提出一种基于镜头分类和回放检测的有效视频摘要框架。准确的镜头分类对于更好地安排输入视频从而进行进一步处理 (关键事件或回放检测) 是必要的。因此, 提出一种基于轻量级卷积神经网络的镜头分类方法。该方法对每一个镜头进行回放检测; 特别地, 检测出从体育视频中识别出回放片段的连续标识转换帧。为此, 提出局部八元模式特征来表示视频帧, 并训练极限学习机分为回放或非回放两类。所提框架对于摄像机、回放速度、镜头速度、光照条件、比赛结构、运动类型、广播公司、标识设计和位置、帧转换和剪辑效果具有鲁棒性。基于YouTube体育视频集中的足球、棒球和板球运动对所提框架进行性能评估。实验结果证明所提框架能够可靠地用于户外运动视频摘要的镜头分类和回放检测。

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

Download references

Author information

Authors and Affiliations

Authors

Contributions

Ali JAVED developed the proposed method and designed the research. Amen ALI KHAN collected and processed the dataset. Ali JAVED and Amen ALI KHAN wrote the code, performed the experimentation, and drafted the paper. Ali JAVED revised and finalized the paper.

Corresponding author

Correspondence to Ali Javed.

Additional information

Compliance with ethics guidelines

Ali JAVED and Amen ALI KHAN declare that they have no conflict of interest.

Project supported by the Directorate of Advanced Studies, Research & Technological Development, University of Engineering and Technology Taxila (No. UET/ASRTD/RG-1002-3)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Javed, A., Ali Khan, A. Shot classification and replay detection for sports video summarization. Front Inform Technol Electron Eng 23, 790–800 (2022). https://doi.org/10.1631/FITEE.2000414

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1631/FITEE.2000414

Key words

关键词

CLC number

Navigation