skip to main content
10.1145/2535948.2535952acmconferencesArticle/Chapter ViewAbstractPublication Pagesicmi-mlmiConference Proceedingsconference-collections
research-article

Agent-assisted multi-viewpoint video viewer and its gaze-based evaluation

Published: 13 December 2013 Publication History

Abstract

Humans see things from various viewpoints but nobody attempts to see anything from every viewpoint owing to physical restrictions and the great effort required. Intelligent interfaces for viewing multi-viewpoint videos may remove the restrictions in effective ways and direct us toward a new visual world. We propose an agent-assisted multi-viewpoint video viewer that incorporates (1) target-centered viewpoint switching and (2) social viewpoint recommendation. The viewer stabilizes an object at the center of the display field using the former function, which helps to fix the user's gaze on the target object. To identify the popular viewing behavior for particular content, the latter function exploits a histogram of the viewing log in terms of time, viewpoints, and the target of many personal viewing experiences. We call this knowledge source of the director agent a viewgram. The agent automatically constructs the preferred viewpoint sequence for each target. We conducted user studies to analyze user behavior, especially eye movement, while using the viewer. The results of statistical analyses showed that the viewpoint sequence extracted from a viewgram includes a more distinct perspective for each target, and the target-centered viewpoint switching encourages the user to gaze at the display center where the target is located during the viewing. The proposed viewer can provide more effective perspectives for the main attractions in scenes.

References

[1]
R. J. K. Jacob and K. S. Karn. Eye tracking in human-computer interaction and usability research: Ready to deliver the promises, In J. Hyönä, R. Radach, and H. Deubel (Eds.), The Mind's Eye: Cognitive and Applied Aspects of Eye Movement Research. Elsevier, Amsterdam, 2003.
[2]
T. Judd, K. Ehinger, F. Durand, and A. Torralba. Learning to predict where humans look. Proc. Int'l Conf. on Computer Vision, pages 2106--2113, 2009.
[3]
M. A. Just and P. A. Carpenter. A theory of reading: from eye fixations to comprehension. Psychological Review, 87(4):329--354, 1980.
[4]
T. Kanade and P. J. Narayanan. Virtualized reality: Perspectives on 4d digitization of dynamic events. (June):32--40, 2007.
[5]
J. Kilner, J. Starck, and A. Hilton. A comparative study of free-viewpoint video techniques for sports events. Proc. the 3rd European Conf. on Visual Media Production, pages 87--96, 2006.
[6]
W.-L. Lu, K. Okuma, and J. Little. Tracking and recognizing actions of multiple hockey players using the boosted particle filter. Image and Vision Computing, 2008.
[7]
T. Matsuyama, S. Nobuhara, T. Takai, and T. Tung. 3D Video and Its Applications. Springer-Verlag, London, 2012.
[8]
H. Miyamori, S. Nakamura, and K. Tanaka. Generation of views of TV content using TV viewers' perspectives expressed in live chats on the web. Proc. the 13th ACM Multimedia, pages 853--861, 2005.
[9]
S. Tokai, T. Kawamoto, T. Fujii, and K. Mase. Pegged to point browsing: An approach to browse multi-view video with view-switching, and its applications. International Workshop on Sensing Web, 2008.
[10]
A. J. Viterbi. Error bounds for convolutional codes and an asymptotically optimum decoding algorithm. IEEE Trans. on Info. Theory, IT-13:260--267, 1967.
[11]
A. L. Yarbus. Eye Movements during Perception of Complex Objects, Eye Movements and Vision. Plenum Press, New York, 1967.

Cited By

View all
  • (2014)Video generation method based on user's tendency of viewpoint selection for multi-view video contentsProceedings of the 5th Augmented Human International Conference10.1145/2582051.2582052(1-4)Online publication date: 7-Mar-2014

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
GazeIn '13: Proceedings of the 6th workshop on Eye gaze in intelligent human machine interaction: gaze in multimodal interaction
December 2013
68 pages
ISBN:9781450325639
DOI:10.1145/2535948
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 December 2013

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. gaze behavior
  2. multi-viewpoint video
  3. recommendation

Qualifiers

  • Research-article

Conference

ICMI '13
Sponsor:

Acceptance Rates

GazeIn '13 Paper Acceptance Rate 11 of 13 submissions, 85%;
Overall Acceptance Rate 19 of 21 submissions, 90%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)2
  • Downloads (Last 6 weeks)0
Reflects downloads up to 14 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2014)Video generation method based on user's tendency of viewpoint selection for multi-view video contentsProceedings of the 5th Augmented Human International Conference10.1145/2582051.2582052(1-4)Online publication date: 7-Mar-2014

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media