demonstration

IBM High-Five: Highlights From Intelligent Video Engine

Authors:

Rogerio S. FerisAuthors Info & Claims

MM '17: Proceedings of the 25th ACM international conference on Multimedia

Pages 1249 - 1250

https://doi.org/10.1145/3123266.3127924

Published: 19 October 2017 Publication History

Get Access

Abstract

We introduce a novel multi-modal system for auto-curating golf highlights that fuses information from players' reactions (celebration actions), spectators (crowd cheering), and commentator (tone of the voice and word analysis) to determine the most interesting moments of a game. The start of a highlight is determined with additional metadata (player's name and the hole number), allowing personalized content summarization and retrieval. Our system was demonstrated at Masters 2017, a major golf tournament, generating real-time highlights from four live video streams over four days.

Supplementary Material

PDF (demo48.pdf)

PDF File

Download
2.39 MB

References

[1]

Yusuf Aytar, Carl Vondrick, and Antonio Torralba. 2016. SoundNet: Learning Sound Representations from Unlabeled Video. In NIPS.

Google Scholar

[2]

Michele Merler, Dhiraj Joshi, Quoc-Bao Nguyen, Stephen Hammer, John Kent, John R. Smith, and Rogerio S. Feris. 2017. Automatic Curation of Golf Highlights using Multimodal Excitement Features. In CVPR Int. Workshop on Sports.

Google Scholar

[3]

Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional net- works for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014).

Google Scholar

Cited By

View all

Priyanka GSenthil Kumar JPrasha Meena M(2025)DHMDL: Dynamically Hashed Multimodal Deep Learning Framework for Racket Video Summarization Using Audio and Visual MarkersApplied Artificial Intelligence10.1080/08839514.2025.246238239:1Online publication date: 18-Feb-2025
https://doi.org/10.1080/08839514.2025.2462382
Park KLim HLee JSuh B(2024)Enhancing Auto-Generated Baseball Highlights via Win Probability and Bias Injection MethodProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642021(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642021
Tang Wvan Ooijen PSival DMaurits N(2022)2D Gait Skeleton Data Normalization for Quantitative Assessment of Movement Disorders from Freehand Single Camera Video RecordingsSensors10.3390/s2211424522:11(4245)Online publication date: 2-Jun-2022
https://doi.org/10.3390/s22114245
Show More Cited By

Index Terms

IBM High-Five: Highlights From Intelligent Video Engine
1. Information systems
  1. Information retrieval
    1. Users and interactive retrieval
      1. Personalization
  2. Information systems applications
    1. Multimedia information systems
      1. Multimedia content creation

Recommendations

Bagadus: an integrated system for arena sports analytics: a soccer case study
MMSys '13: Proceedings of the 4th ACM Multimedia Systems Conference

Sports analytics is a growing area of interest, both from a computer system view to manage the technical challenges and from a sport performance view to aid the development of athletes. In this paper, we present Bagadus, a prototype of a sports ...
How Is the Stroke? Inferring Shot Influence in Badminton Matches via Long Short-term Dependencies
Identifying significant shots in a rally is important for evaluating players’ performance in badminton matches. While there are several studies that have quantified player performance in other sports, analyzing badminton data has remained untouched. In ...
Bagadus: An integrated real-time system for soccer analytics
Special issue of best papers of ACM MMSys 2013 and ACM NOSSDAV 2013

The importance of winning has increased the role of performance analysis in the sports industry, and this underscores how statistics and technology keep changing the way sports are played. Thus, this is a growing area of interest, both from a computer ...

Comments

Information & Contributors

Information

Published In

MM '17: Proceedings of the 25th ACM international conference on Multimedia

October 2017

2028 pages

ISBN:9781450349062

DOI:10.1145/3123266

General Chairs:
Qiong Liu
FXPAL, USA
,
Rainer Lienhart
Universität Augsburg, Germany
,
Haohong Wang
TCL America, USA
,
Program Chairs:
Sheng-Wei "Kuan-Ta" Chen
Academia Sinica, Taiwan
,
Susanne Boll
University of Oldenburg, Germany
,
Phoebe Chen
La Trobe University, Australia
,
Gerald Friedland
Lawrence Livermore National Lab, USA
,
Jia Li
Google, USA
,
Shuicheng Yan
Qihoo 360, China

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 October 2017

Check for updates

Author Tags

Qualifiers

Demonstration

Conference

MM '17

Sponsor:

SIGMM

MM '17: ACM Multimedia Conference

October 23 - 27, 2017

California, Mountain View, USA

Acceptance Rates

MM '17 Paper Acceptance Rate 189 of 684 submissions, 28%;

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
147
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)1

Reflects downloads up to 01 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Priyanka GSenthil Kumar JPrasha Meena M(2025)DHMDL: Dynamically Hashed Multimodal Deep Learning Framework for Racket Video Summarization Using Audio and Visual MarkersApplied Artificial Intelligence10.1080/08839514.2025.246238239:1Online publication date: 18-Feb-2025
https://doi.org/10.1080/08839514.2025.2462382
Park KLim HLee JSuh B(2024)Enhancing Auto-Generated Baseball Highlights via Win Probability and Bias Injection MethodProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642021(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642021
Tang Wvan Ooijen PSival DMaurits N(2022)2D Gait Skeleton Data Normalization for Quantitative Assessment of Movement Disorders from Freehand Single Camera Video RecordingsSensors10.3390/s2211424522:11(4245)Online publication date: 2-Jun-2022
https://doi.org/10.3390/s22114245
Zhang LRadke R(2020)A Multi-Stream Recurrent Neural Network for Social Role Detection in Multiparty InteractionsIEEE Journal of Selected Topics in Signal Processing10.1109/JSTSP.2020.299239414:3(554-567)Online publication date: Mar-2020
https://doi.org/10.1109/JSTSP.2020.2992394
Wang JQiu KPeng HFu JZhu JAmsaleg LHuet BLarson MGravier GHung HNgo CTsang Ooi W(2019)AI Coach: Deep Human Pose Estimation and Analysis for Personalized Athletic Training AssistanceProceedings of the 27th ACM International Conference on Multimedia10.1145/3343031.3350910(374-382)Online publication date: 15-Oct-2019
https://dl.acm.org/doi/10.1145/3343031.3350910
Wang JQiu KPeng HFu JZhu JAmsaleg LHuet BLarson MGravier GHung HNgo CTsang Ooi W(2019)AI CoachProceedings of the 27th ACM International Conference on Multimedia10.1145/3343031.3350609(2228-2230)Online publication date: 15-Oct-2019
https://dl.acm.org/doi/10.1145/3343031.3350609
Merler MMac KJoshi DNguyen QHammer SKent JXiong JDo MSmith JFeris R(2019)Automatic Curation of Sports Highlights Using Multimodal Excitement FeaturesIEEE Transactions on Multimedia10.1109/TMM.2018.287604621:5(1147-1160)Online publication date: May-2019
https://doi.org/10.1109/TMM.2018.2876046
Shukla PSadana HBansal AVerma DElmadjian CRaman BTurk M(2018)Automatic Cricket Highlight Generation Using Event-Driven and Excitement-Based Features2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)10.1109/CVPRW.2018.00233(1881-18818)Online publication date: Jun-2018
https://doi.org/10.1109/CVPRW.2018.00233

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

Supplementary Material

References

Cited By

Index Terms

Recommendations

Bagadus: an integrated system for arena sports analytics: a soccer case study

How Is the Stroke? Inferring Shot Influence in Badminton Matches via Long Short-term Dependencies

Bagadus: An integrated real-time system for soccer analytics

Comments

Information

Published In

Sponsors

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations