Skip to main content

Advertisement

SpringerLink
Log in

On broadcasted game video analysis: event detection, highlight detection, and highlight forecast

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Efficient access to broadcasted computer game videos is urgently demanded due to the emergence of live streaming platforms. The popularity of game video streaming builds a big market showing commercial potentials and arising many technical challenges. In this work we facilitate efficient access from two aspects: event detection and highlight detection. By recognizing designated text displayed on screen when important events occur, we associate game events with time stamps, and accordingly develop an interface to facilitate direct access. For highlight detection, we jointly consider visual features, event features, and viewer’s behavior to construct two highlight models based on the psychophysiological approach and the data-driven approach, respectively. The concatenated highlights then enable compact game video presentation. To facilitate adaptive live streaming, a novel highlight forecast model is built to predict whether there will be a highlight in the next seconds, so that the streaming system can allocate more resource for more important segments on the fly. Comprehensive experiments based on various experimental settings demonstrate effectiveness of the proposed methods. We believe that this work is one of the early attempts on analyzing broadcasted computer game videos from the perspective of multimedia content analysis.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

Notes

  1. http://www.ustream.tv

  2. https://new.livestream.com/

  3. http://www.twitch.tv/

  4. http://www.riotgames.com

  5. https://code.google.com/p/tesseract-ocr/

  6. https://www.youtube.com/user/Kazawuna/about

  7. http://www.tgbus.com/

References

  1. Brown RG (1956) Exponential smoothing for predicting demand. Arthur D. Little Inc., Cambridge

    Google Scholar 

  2. Chang C-C, Lin C-J (2011) Libsvm: a library for support vector machines. ACM Trans Intell Syst Technol 2(27):1–27

    Article  Google Scholar 

  3. Chen C-M, Chen L-H (2014) Novel framework for sports video analysis: a basketball case study. In: Proceedings of IEEE international conference on image processing, pp 961–965

  4. Chen F, De Vleeschouwer C, Cavallaro A (2014) Resource allocation for personalized video summarization. IEEE Trans Multimedia 16(2):455–469

    Article  Google Scholar 

  5. Chiu C-Y, Lin P-C, Li S-Y, Tsai T-H, Tsai Y-L (2012) Tagging webcast text in baseball videos by video segmentation and text alignment. IEEE Trans Circuits Syst Video Technol 22(7):999–1013

    Article  Google Scholar 

  6. Chu W-T, Cheng W-H, Hsu JY-J, Wu J-L (2005) Towards semantic indexing and retrieval using hierarchical audio models. Multimedia Systems 10(6):570–583

    Article  Google Scholar 

  7. Cong Y, Yuan J, Luo J (2012) Towards scalable summarization of consumer videos via sparse dictionary selection. IEEE Trans Multimedia 14(1):66–75

    Article  Google Scholar 

  8. Dang CT, Radha H (2014) Heterogeneity image patch index and its application to consumer video summarization. IEEE Trans Image Process 23(6):2704–2718

    Article  MathSciNet  Google Scholar 

  9. Douglass J (2009) Computer visions of computer games: analysis and visualization of play recordings. In: Proceedings of workshop on media arts, science, and technology: the future of interactive media

  10. Duan L, Xu D, Chang S-F (2012) Exploiting web images for event recognition in consumer videos: a multiple source domain adaptation approach. In: Proceedings of IEEE international conference on computer vision and pattern recognition, pp 1338–1345

  11. Evangelopoulos G, Zlatintsi A, Potamianos A, Maragos P, Rapantzikos K, Skoumas G, Avrithis Y (2013) Multimodal saliency and fusion for movie summarization based on aural, visual, and textual attention. IEEE Trans Multimedia 15(7):1553–1568

    Article  Google Scholar 

  12. Fan-Chiang T-Y, Hong H-J, Hsu C-H (2015) Segment-of-interest driven live game streaming: saving bandwidth without degrading experience. In: Proceedings of international workshop on network and systems support for games, pp 1–6

  13. Gao Y, Zhao S, Yang Y, Chua T-S (2015) Multimedia social event detection in microblog. In: Proceedings of international conference on multimedia modeling, pp 269–281

  14. Hamilton WA, Garretson O, Kerne A (2014) Streaming on twitch: fostering participatory communities of play within live mixed media. In: Proceedings of ACM SIGCHI conference on human factors in computing systems, pp 1315–1324

  15. Hanjalic A, Xu L-Q (2005) Affective video content representation and modeling. IEEE Trans Multimedia 7(1):143–154

    Article  Google Scholar 

  16. Hu M-C, Chang M-H, Wu J-L, Chi L (2011) Robust camera calibration and player tracking in broadcast basketball video. IEEE Trans Multimedia 13(2):266–279

    Article  Google Scholar 

  17. Kaytoue M, Silva A, Cerf L, Meira W Jr, Raissi C (2012) Watch me playing, i am a professional: a first study on video game live streaming. In: Proceedings of international conference companion on world wide web, pp 1181–1188

  18. Lewis JM, Trinh P, Kirsh D (2011) A corpus analysis of strategy video game play in starcraft: Broodwar. In: Proceedings of the 33rd annual conference of the cognitive science society, pp 687– 692

  19. Lienhart R (1999) Comparison of automatic shot boundary detection algorithms. In: Proceedings of SPIE storage and retrieval for still image and video databases VII, vol 3656, pp 290–301

  20. Lu T, Weng Y, Wang G (2014) Audiotory movie summarization by detecting scene changes and sound events. In: Proceedings of international conference on pattern recognition, pp 756–760

  21. Nguyen N, Yoshitaka A (2014) Soccer video summarization based on cinematography and motion analysis. In: Proceedings of IEEE international workshop on multimedia signal processing

  22. Pires K, Simon G (2014) Dash in twitch: adaptive bitrate streaming in live game streaming platforms, pp 13–18

  23. Pires K, Simon G (2015) Youtube live and twitch: a tour of user-generated live streaming systems. In: Proceedings of ACM multimedia systems conference, pp 225–230

  24. Riegler M, Lux M, Charvillat V, Carlier A, Vliegendhart R, Larson M (2014) Videojot: a multifunctional video annotation tool. In: Proceedings of ACM international conference on multimedia retrieval, pp 534–537

  25. Rioult F, Metivier J-P, Helleu B, Scelles N, Durand C (2014) Mining tracks of competitive video games. AASRI Procedia 8:82–87

    Article  Google Scholar 

  26. Stensland HK, Gaddam VR, Tennoe M, Helgedagsrud E, Naess M, Alstad HK, Mortensen A, Langseth R, Ljodal S, Landsverk O, Griwodz C, Halvorsen P, Stenhaug M, Johansen D (2014) Bagadus: an integrated real-time system for soccer analytics. ACM Trans Multimed Comput Commun Appl 10 (1s):14

    Article  Google Scholar 

  27. Sulser F, Giangreco I, Schuldt H (2014) Crowd-based semantic event detection and video annotation for sports videos. In: Proceedings of ACM workshop on crowdsourcing for multimedia, pp 63–68

  28. Sun M, Farhadi A, Seitz S (2014) Ranking domain-specific highlights by analyzing edited videos. In: Proceedings of Eurpean conference on computer vision, pp 787–802

  29. Tavassolipour M, Karimian M, Kasaei S (2014) Event detection and summarization in soccer videos using Bayesian network and copula. IEEE Trans Circuits Syst Video Technol 24(2):291–304

    Article  Google Scholar 

  30. Tsai C-M, Kang L-W, Lin C-W, Lin W (2013) Scene-based movie summarization via role-community networks. IEEE Trans Circuits Syst Video Technol 23(11):1927–1940

    Article  Google Scholar 

  31. Wang M, Sheng Y, Liu B, Hua X-S (2010) In-image accessibility indication. IEEE Trans Multimedia 12(4):330–336

    Article  Google Scholar 

  32. Zhang C, Liu J (2015) On crowdsourced interactive live streaming: a twitch.tv-based measurement study. In: Proceedings of ACM workshop on network and operating systems support for digital audio and video, pp 55–60

  33. Zhao B, Xing EP (2014) Quasi real-time summarization for consumer videos. In: Proceedings of IEEE international conference on computer vision and pattern recognition, pp 2513–2520

  34. Zhao S, Yao H, Sun X, Jiang X, Xu P (2013) Flexible presentation of videos based on affective content analysis. In: Proceedings of international conference on multimedia modeling, pp 368–379

Download references

Author information

Authors and Affiliations

  1. National Chung Cheng University, Chiayi, Taiwan

    Wei-Ta Chu & Yung-Chieh Chou

Authors
  1. Wei-Ta Chu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yung-Chieh Chou
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Wei-Ta Chu.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chu, WT., Chou, YC. On broadcasted game video analysis: event detection, highlight detection, and highlight forecast. Multimed Tools Appl 76, 9735–9758 (2017). https://doi.org/10.1007/s11042-016-3577-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-016-3577-x

Keywords

Search

Navigation