short-paper

Personal Multi-view Viewpoint Recommendation based on Trajectory Distribution of the Viewing Target

Authors:

Takatsugu Hirayama,

Kenji MaseAuthors Info & Claims

MM '16: Proceedings of the 24th ACM international conference on Multimedia

Pages 471 - 475

https://doi.org/10.1145/2964284.2967265

Published: 01 October 2016 Publication History

Abstract

Multi-camera videos with abundant information and high flexibility are expected to be useful in a wide range of applications, such as surveillance systems, web lecture broadcasting, concerts and sports viewing, etc. Viewers can enjoy a high-presence viewing experience of their own choosing by means of virtual camera switching and controlling viewing interfaces. However, some viewers may feel annoyed by continual manual viewpoint selection, especially when the number of selectable viewpoints is relatively large. In order to solve this issue, we propose an automatic viewpoint-recommending method designed especially for soccer games. This method focuses on a viewer's personal preference for viewpoint-selection, instead of common and professional editing rules. We assume that the different trajectory distributions cause a difference in the viewpoint selection according to personal preference. We therefore analyze the relationship between the viewer's personal viewpoint selecting tendency and the spatio-temporal game context. We compare methods based on a Gaussian mixture model, a general histogram+SVM and bag-of-words+SVM to seek the best representation for this relationship. The performance of the proposed methods are verified by assessing the degree of similarity between the recommended viewpoints and the viewers' edited records.

References

[1]

I. Ahmad. Multi-view video: get ready for next-generation television. IEEE Distributed Systems Online, 8(3):6--6, 2007.

Digital Library

[2]

R. T. Collins, O. Amidi, and T. Kanade. An active camera system for acquiring multi-view video. In in Proc. International Conference on Image Processing, 2002.

[3]

G. Csurka, C. Dance, L. Fan, J. Willamowski, and C. Bray. Visual categorization with bags of keypoints. In Workshop on statistical learning in computer vision, ECCV, volume 1, pages 1--2. Prague, 2004.

[4]

R. Cutler, Y. Rui, A. Gupta, J. J. Cadiz, I. Tashev, L.-w. He, A. Colburn, Z. Zhang, Z. Liu, and S. Silverberg. Distributed meetings: A meeting capture and broadcasting system. In Proceedings of the tenth ACM international conference on Multimedia, pages 503--512. ACM, 2002.

Digital Library

[5]

F. Daniyal and A. Cavallaro. Multi-camera scheduling for video production. In European Conference on Visual Media Production (CVMP), pages 11--20, 2011.

Digital Library

[6]

F. Daniyal, M. Taj, and A. Cavallaro. Content and task-based view selection from multiple video streams. Multimedia tools and applications, pages 235--258, 2010.

Digital Library

[7]

T. D'Orazio and M. Leo. A review of vision-based systems for soccer video analysis. Pattern Recognition, 43(8):2911--2926, 2010.

Digital Library

[8]

M. Goesele, N. Snavely, B. Curless, H. Hoppe, and S. M. Seitz. Multi-view stereo for community photo collections. In IEEE 11th International Conference on Computer Vision(ICCV), pages 1--8, 2007.

[9]

A. Iwatsuki, T. Hirayama, and K. Mase. Analysis of soccer coach's eye gaze behavior. In Pattern Recognition (ACPR), 2013 2nd IAPR Asian Conference on, pages 793--797, Nov 2013.

Digital Library

[10]

J. Kilner, J. Starck, and A. Hilton. A comparative study of free viewpoint video techniques for sports events. In European Conference on Visual Media Production (CVMP), pages 87--96, 2006.

[11]

J.-G. Lou, H. Cai, and J. Li. A real-time interactive multi-view video system. In Proceedings of the 13th annual ACM international conference on Multimedia, pages 161--170. ACM, 2005.

Digital Library

[12]

K. Mase, K. Niwa, and T. Marutani. Socially assisted multi-view video viewer. In Proceedings of the 13th international conference on multimodal interfaces, pages 319--322. ACM, 2011.

Digital Library

[13]

T. Matsuyama, S. Nobuhara, T. Takai, and T. Tung. 3D video and its applications. Springer, 2012.

Digital Library

[14]

Y. Muramatsu, T. Hirayama, and K. Mase. Video generation method based on user's tendency of viewpoint selection for multi-view video contents. In 5th Augmented Human International Conference, AH '14, pages 1:1--1:4, 2014.

Digital Library

[15]

A. Ranjan, R. Henrikson, J. Birnholtz, R. Balakrishnan, and D. Lee. Automatic camera control using unobtrusive vision and audio tracking. In Proceedings of Graphics Interface, pages 47--54. Canadian Information Processing Society, 2010.

Digital Library

[16]

M. K. Saini, R. Gadde, S. Yan, and W. T. Ooi. Movimash: online mobile video mashup. In Proceedings of the 20th ACM international conference on Multimedia, pages 139--148. ACM, 2012.

Digital Library

[17]

X. Wang, T. Hirayama, and K. Mase. Viewpoint sequence recommendation based on contextual information for multiview video. IEEE MultiMedia, (4):40--50, 2015.

Digital Library

[18]

C. Zhang, Y. Rui, J. Crawford, and L.-W. He. An automated end-to-end lecture capture and broadcasting system. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), 4(1):6, 2008.

Digital Library

Cited By

Bourel FWang XTeng EOrtenzi VMyhill AChristie M(2023)Real-time Computational Cinematographic Editing for Broadcasting of Volumetric-captured events: an Application to Ultimate FightingProceedings of the 16th ACM SIGGRAPH Conference on Motion, Interaction and Games10.1145/3623264.3624468(1-8)Online publication date: 15-Nov-2023
https://dl.acm.org/doi/10.1145/3623264.3624468
Endo STakegawa YFunaki AMatsumura KHirata KIgarashi T(2021)Construction of a Switching Support System for Live Broadcast of Oral PresentationJournal of Information Processing10.2197/ipsjjip.29.20629(206-214)Online publication date: 2021
https://doi.org/10.2197/ipsjjip.29.206
Pan YChen YBao QZhang NYao TLiu JMei T(2021)Smart Director: An Event-Driven Directing System for Live BroadcastingACM Transactions on Multimedia Computing, Communications, and Applications10.1145/344898117:4(1-18)Online publication date: 12-Nov-2021
https://dl.acm.org/doi/10.1145/3448981
Show More Cited By

Index Terms

Personal Multi-view Viewpoint Recommendation based on Trajectory Distribution of the Viewing Target
1. Computing methodologies
  1. Machine learning
2. Information systems

Recommendations

Preference-based user rating correction process for interactive recommendation systems

In most of the recommendation systems, user rating is an important user activity that reflects their opinions. Once the users return their ratings about items the systems have suggested, the user ratings can be used to adjust the recommendation ...
Viewing support system for multi-view videos
ICMI '16: Proceedings of the 18th ACM International Conference on Multimodal Interaction

Multi-view videos taken by multiple cameras from different angles are expected to be useful in a wide range of applications, such as web lecture broadcasting, concerts and sports viewing, etc. These videos can enhancing viewing experience of users' ...
A smart-device news recommendation technology based on the user click behavior
EDB '16: Proceedings of the Sixth International Conference on Emerging Databases: Technologies, Applications, and Theory

Studies have been conducted in regard to personalized news recommendation using collaborative filtering mechanisms based on users' click behaviors. However, few existing studies have focused on news recommendations depending on the rates of news-...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MM '16: Proceedings of the 24th ACM international conference on Multimedia

October 2016

1542 pages

ISBN:9781450336031

DOI:10.1145/2964284

General Chairs:
Alan Hanjalic
Delft University of Technology
,
Cees Snoek
Qualcomm Research Netherlands / University of Amsterdam
,
Marcel Worring
University of Amsterdam
,
Moderator:
Dick Bulterman
CWI / VU University Amsterdam
,
Program Chairs:
Benoit Huet
EURECOM
,
Aisling Kelliher
Virginia Tech
,
Yiannis Kompatsiaris
CERTH-ITI
,
Jin Li
Microsoft

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 October 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Funding Sources

JSPS KAKENHI Grant-in-aid

Conference

MM '16

Sponsor:

SIGMM

MM '16: ACM Multimedia Conference

October 15 - 19, 2016

Amsterdam, The Netherlands

Acceptance Rates

MM '16 Paper Acceptance Rate 52 of 237 submissions, 22%;

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
204
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)0

Reflects downloads up to 28 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Bourel FWang XTeng EOrtenzi VMyhill AChristie M(2023)Real-time Computational Cinematographic Editing for Broadcasting of Volumetric-captured events: an Application to Ultimate FightingProceedings of the 16th ACM SIGGRAPH Conference on Motion, Interaction and Games10.1145/3623264.3624468(1-8)Online publication date: 15-Nov-2023
https://dl.acm.org/doi/10.1145/3623264.3624468
Endo STakegawa YFunaki AMatsumura KHirata KIgarashi T(2021)Construction of a Switching Support System for Live Broadcast of Oral PresentationJournal of Information Processing10.2197/ipsjjip.29.20629(206-214)Online publication date: 2021
https://doi.org/10.2197/ipsjjip.29.206
Pan YChen YBao QZhang NYao TLiu JMei T(2021)Smart Director: An Event-Driven Directing System for Live BroadcastingACM Transactions on Multimedia Computing, Communications, and Applications10.1145/344898117:4(1-18)Online publication date: 12-Nov-2021
https://dl.acm.org/doi/10.1145/3448981
Chen JLu KTian SLittle J(2019)Learning Sports Camera Selection From Internet Videos2019 IEEE Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV.2019.00184(1682-1691)Online publication date: Jan-2019
https://doi.org/10.1109/WACV.2019.00184
WANG XHARA KENOKIBORI YHIRAYAMA TMASE K(2018)Personal Viewpoint Navigation Based on Object Trajectory Distribution for Multi-View VideosIEICE Transactions on Information and Systems10.1587/transinf.2017EDP7122E101.D:1(193-204)Online publication date: 2018
https://doi.org/10.1587/transinf.2017EDP7122
Chen JMeng LLittle J(2018)Camera Selection for Broadcasting Soccer Games2018 IEEE Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV.2018.00053(427-435)Online publication date: Mar-2018
https://doi.org/10.1109/WACV.2018.00053
Wang XEnokibori YHirayama THara KMase KAlameda-Pineda XRedi MSoleymani MSebe NChang SGosling S(2017)User Group based Viewpoint Recommendation using User Attributes for Multiview VideosProceedings of the Workshop on Multimodal Understanding of Social, Affective and Subjective Attributes10.1145/3132515.3132523(3-9)Online publication date: 27-Oct-2017
https://dl.acm.org/doi/10.1145/3132515.3132523

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten