ABSTRACT
Multi-camera videos with abundant information and high flexibility are expected to be useful in a wide range of applications, such as surveillance systems, web lecture broadcasting, concerts and sports viewing, etc. Viewers can enjoy a high-presence viewing experience of their own choosing by means of virtual camera switching and controlling viewing interfaces. However, some viewers may feel annoyed by continual manual viewpoint selection, especially when the number of selectable viewpoints is relatively large. In order to solve this issue, we propose an automatic viewpoint-recommending method designed especially for soccer games. This method focuses on a viewer's personal preference for viewpoint-selection, instead of common and professional editing rules. We assume that the different trajectory distributions cause a difference in the viewpoint selection according to personal preference. We therefore analyze the relationship between the viewer's personal viewpoint selecting tendency and the spatio-temporal game context. We compare methods based on a Gaussian mixture model, a general histogram+SVM and bag-of-words+SVM to seek the best representation for this relationship. The performance of the proposed methods are verified by assessing the degree of similarity between the recommended viewpoints and the viewers' edited records.
- I. Ahmad. Multi-view video: get ready for next-generation television. IEEE Distributed Systems Online, 8(3):6--6, 2007. Google ScholarDigital Library
- R. T. Collins, O. Amidi, and T. Kanade. An active camera system for acquiring multi-view video. In in Proc. International Conference on Image Processing, 2002.Google ScholarCross Ref
- G. Csurka, C. Dance, L. Fan, J. Willamowski, and C. Bray. Visual categorization with bags of keypoints. In Workshop on statistical learning in computer vision, ECCV, volume 1, pages 1--2. Prague, 2004.Google Scholar
- R. Cutler, Y. Rui, A. Gupta, J. J. Cadiz, I. Tashev, L.-w. He, A. Colburn, Z. Zhang, Z. Liu, and S. Silverberg. Distributed meetings: A meeting capture and broadcasting system. In Proceedings of the tenth ACM international conference on Multimedia, pages 503--512. ACM, 2002. Google ScholarDigital Library
- F. Daniyal and A. Cavallaro. Multi-camera scheduling for video production. In European Conference on Visual Media Production (CVMP), pages 11--20, 2011. Google ScholarDigital Library
- F. Daniyal, M. Taj, and A. Cavallaro. Content and task-based view selection from multiple video streams. Multimedia tools and applications, pages 235--258, 2010. Google ScholarDigital Library
- T. D'Orazio and M. Leo. A review of vision-based systems for soccer video analysis. Pattern Recognition, 43(8):2911--2926, 2010. Google ScholarDigital Library
- M. Goesele, N. Snavely, B. Curless, H. Hoppe, and S. M. Seitz. Multi-view stereo for community photo collections. In IEEE 11th International Conference on Computer Vision(ICCV), pages 1--8, 2007.Google ScholarCross Ref
- A. Iwatsuki, T. Hirayama, and K. Mase. Analysis of soccer coach's eye gaze behavior. In Pattern Recognition (ACPR), 2013 2nd IAPR Asian Conference on, pages 793--797, Nov 2013. Google ScholarDigital Library
- J. Kilner, J. Starck, and A. Hilton. A comparative study of free viewpoint video techniques for sports events. In European Conference on Visual Media Production (CVMP), pages 87--96, 2006.Google ScholarCross Ref
- J.-G. Lou, H. Cai, and J. Li. A real-time interactive multi-view video system. In Proceedings of the 13th annual ACM international conference on Multimedia, pages 161--170. ACM, 2005. Google ScholarDigital Library
- K. Mase, K. Niwa, and T. Marutani. Socially assisted multi-view video viewer. In Proceedings of the 13th international conference on multimodal interfaces, pages 319--322. ACM, 2011. Google ScholarDigital Library
- T. Matsuyama, S. Nobuhara, T. Takai, and T. Tung. 3D video and its applications. Springer, 2012. Google ScholarDigital Library
- Y. Muramatsu, T. Hirayama, and K. Mase. Video generation method based on user's tendency of viewpoint selection for multi-view video contents. In 5th Augmented Human International Conference, AH '14, pages 1:1--1:4, 2014. Google ScholarDigital Library
- A. Ranjan, R. Henrikson, J. Birnholtz, R. Balakrishnan, and D. Lee. Automatic camera control using unobtrusive vision and audio tracking. In Proceedings of Graphics Interface, pages 47--54. Canadian Information Processing Society, 2010. Google ScholarDigital Library
- M. K. Saini, R. Gadde, S. Yan, and W. T. Ooi. Movimash: online mobile video mashup. In Proceedings of the 20th ACM international conference on Multimedia, pages 139--148. ACM, 2012. Google ScholarDigital Library
- X. Wang, T. Hirayama, and K. Mase. Viewpoint sequence recommendation based on contextual information for multiview video. IEEE MultiMedia, (4):40--50, 2015.Google ScholarDigital Library
- C. Zhang, Y. Rui, J. Crawford, and L.-W. He. An automated end-to-end lecture capture and broadcasting system. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), 4(1):6, 2008. Google ScholarDigital Library
Index Terms
- Personal Multi-view Viewpoint Recommendation based on Trajectory Distribution of the Viewing Target
Recommendations
Preference-based user rating correction process for interactive recommendation systems
In most of the recommendation systems, user rating is an important user activity that reflects their opinions. Once the users return their ratings about items the systems have suggested, the user ratings can be used to adjust the recommendation ...
Viewing support system for multi-view videos
ICMI '16: Proceedings of the 18th ACM International Conference on Multimodal InteractionMulti-view videos taken by multiple cameras from different angles are expected to be useful in a wide range of applications, such as web lecture broadcasting, concerts and sports viewing, etc. These videos can enhancing viewing experience of users' ...
A smart-device news recommendation technology based on the user click behavior
EDB '16: Proceedings of the Sixth International Conference on Emerging Databases: Technologies, Applications, and TheoryStudies have been conducted in regard to personalized news recommendation using collaborative filtering mechanisms based on users' click behaviors. However, few existing studies have focused on news recommendations depending on the rates of news-...
Comments