skip to main content
10.1145/2964284.2967265acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
short-paper

Personal Multi-view Viewpoint Recommendation based on Trajectory Distribution of the Viewing Target

Published:01 October 2016Publication History

ABSTRACT

Multi-camera videos with abundant information and high flexibility are expected to be useful in a wide range of applications, such as surveillance systems, web lecture broadcasting, concerts and sports viewing, etc. Viewers can enjoy a high-presence viewing experience of their own choosing by means of virtual camera switching and controlling viewing interfaces. However, some viewers may feel annoyed by continual manual viewpoint selection, especially when the number of selectable viewpoints is relatively large. In order to solve this issue, we propose an automatic viewpoint-recommending method designed especially for soccer games. This method focuses on a viewer's personal preference for viewpoint-selection, instead of common and professional editing rules. We assume that the different trajectory distributions cause a difference in the viewpoint selection according to personal preference. We therefore analyze the relationship between the viewer's personal viewpoint selecting tendency and the spatio-temporal game context. We compare methods based on a Gaussian mixture model, a general histogram+SVM and bag-of-words+SVM to seek the best representation for this relationship. The performance of the proposed methods are verified by assessing the degree of similarity between the recommended viewpoints and the viewers' edited records.

References

  1. I. Ahmad. Multi-view video: get ready for next-generation television. IEEE Distributed Systems Online, 8(3):6--6, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. R. T. Collins, O. Amidi, and T. Kanade. An active camera system for acquiring multi-view video. In in Proc. International Conference on Image Processing, 2002.Google ScholarGoogle ScholarCross RefCross Ref
  3. G. Csurka, C. Dance, L. Fan, J. Willamowski, and C. Bray. Visual categorization with bags of keypoints. In Workshop on statistical learning in computer vision, ECCV, volume 1, pages 1--2. Prague, 2004.Google ScholarGoogle Scholar
  4. R. Cutler, Y. Rui, A. Gupta, J. J. Cadiz, I. Tashev, L.-w. He, A. Colburn, Z. Zhang, Z. Liu, and S. Silverberg. Distributed meetings: A meeting capture and broadcasting system. In Proceedings of the tenth ACM international conference on Multimedia, pages 503--512. ACM, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. F. Daniyal and A. Cavallaro. Multi-camera scheduling for video production. In European Conference on Visual Media Production (CVMP), pages 11--20, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. F. Daniyal, M. Taj, and A. Cavallaro. Content and task-based view selection from multiple video streams. Multimedia tools and applications, pages 235--258, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. T. D'Orazio and M. Leo. A review of vision-based systems for soccer video analysis. Pattern Recognition, 43(8):2911--2926, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. M. Goesele, N. Snavely, B. Curless, H. Hoppe, and S. M. Seitz. Multi-view stereo for community photo collections. In IEEE 11th International Conference on Computer Vision(ICCV), pages 1--8, 2007.Google ScholarGoogle ScholarCross RefCross Ref
  9. A. Iwatsuki, T. Hirayama, and K. Mase. Analysis of soccer coach's eye gaze behavior. In Pattern Recognition (ACPR), 2013 2nd IAPR Asian Conference on, pages 793--797, Nov 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. J. Kilner, J. Starck, and A. Hilton. A comparative study of free viewpoint video techniques for sports events. In European Conference on Visual Media Production (CVMP), pages 87--96, 2006.Google ScholarGoogle ScholarCross RefCross Ref
  11. J.-G. Lou, H. Cai, and J. Li. A real-time interactive multi-view video system. In Proceedings of the 13th annual ACM international conference on Multimedia, pages 161--170. ACM, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. K. Mase, K. Niwa, and T. Marutani. Socially assisted multi-view video viewer. In Proceedings of the 13th international conference on multimodal interfaces, pages 319--322. ACM, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. T. Matsuyama, S. Nobuhara, T. Takai, and T. Tung. 3D video and its applications. Springer, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Y. Muramatsu, T. Hirayama, and K. Mase. Video generation method based on user's tendency of viewpoint selection for multi-view video contents. In 5th Augmented Human International Conference, AH '14, pages 1:1--1:4, 2014. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. A. Ranjan, R. Henrikson, J. Birnholtz, R. Balakrishnan, and D. Lee. Automatic camera control using unobtrusive vision and audio tracking. In Proceedings of Graphics Interface, pages 47--54. Canadian Information Processing Society, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. M. K. Saini, R. Gadde, S. Yan, and W. T. Ooi. Movimash: online mobile video mashup. In Proceedings of the 20th ACM international conference on Multimedia, pages 139--148. ACM, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. X. Wang, T. Hirayama, and K. Mase. Viewpoint sequence recommendation based on contextual information for multiview video. IEEE MultiMedia, (4):40--50, 2015.Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. C. Zhang, Y. Rui, J. Crawford, and L.-W. He. An automated end-to-end lecture capture and broadcasting system. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), 4(1):6, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Personal Multi-view Viewpoint Recommendation based on Trajectory Distribution of the Viewing Target

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in
          • Published in

            cover image ACM Conferences
            MM '16: Proceedings of the 24th ACM international conference on Multimedia
            October 2016
            1542 pages
            ISBN:9781450336031
            DOI:10.1145/2964284

            Copyright © 2016 ACM

            Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            • Published: 1 October 2016

            Permissions

            Request permissions about this article.

            Request Permissions

            Check for updates

            Qualifiers

            • short-paper

            Acceptance Rates

            MM '16 Paper Acceptance Rate52of237submissions,22%Overall Acceptance Rate995of4,171submissions,24%

            Upcoming Conference

            MM '24
            MM '24: The 32nd ACM International Conference on Multimedia
            October 28 - November 1, 2024
            Melbourne , VIC , Australia

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader