skip to main content
10.1145/3281505.3283398acmconferencesArticle/Chapter ViewAbstractPublication PagesvrstConference Proceedingsconference-collections
abstract

Using deep-neural-network to extend videos for head-mounted display experiences

Published: 28 November 2018 Publication History

Abstract

Immersion is an important factor in video experiences. Therefore, various methods and video viewing systems have been proposed so far. Although head-mounted displays (HMDs) are home-friendly and more available among these devices, they can provide an immersive video experience owing to their wide field-of-view (FoV) and separation of users from the outside environment. They are often used for panoramic and stereoscopic VR videos, but the demand for viewing standard plane videos has increased in recent years. However, the theater mode, which restricts the FoV, is basically used for viewing plane videos. Thus, the advantages of HMDs are not fully utilized. Therefore, we explored an effective method for viewing plane videos by an HMD, in combination with view augmentation by LED implants to the HMD. We used deep neural network (DNN) to generate images for peripheral vision and wide FoV customization.

References

[1]
P. Isola, J. Zhu, T. Zhou, and A. A. Efros. 2017. Image-to-Image Translation with Conditional Adversarial Networks. In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 5967--5976.
[2]
Brett R. Jones, Hrvoje Benko, Eyal Ofek, and Andrew D. Wilson. 2013. IllumiRoom: Peripheral Projected Illusions for Interactive Experiences. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 869--878.
[3]
Naoki Kimura and Jun Rekimoto. 2018. ExtVision: Augmentation of Visual Experiences with Generation of Context Images for a Peripheral Vision Using Deep Neural Network. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 427, 10 pages.
[4]
Paul Lubos, Gerd Bruder, Oscar Ariza, and Frank Steinicke. 2016. Ambiculus: LED-based Low-resolution Peripheral Display Extension for Immersive Head-mounted Displays. In Proceedings of the 2016 Virtual Reality International Conference (VRIC '16). ACM, New York, NY, USA, Article 13, 4 pages.
[5]
Ruth Rosenholtz. 2016. Capabilities and Limitations of Peripheral Vision. Annual Review of Vision Science 2, 1 (2016), 437--457. 28532349.
[6]
Robert Xiao and Hrvoje Benko. 2016. Augmenting the Field-of-View of Head-Mounted Displays with Sparse Peripheral Displays. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 1221--1232.

Cited By

View all
  • (2019)Deep diveProceedings of the 8th ACM International Symposium on Pervasive Displays10.1145/3321335.3324932(1-7)Online publication date: 12-Jun-2019

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology
November 2018
570 pages
ISBN:9781450360869
DOI:10.1145/3281505
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 November 2018

Check for updates

Author Tags

  1. augmented video
  2. immersion
  3. peripheral vision
  4. sparse peripheral display
  5. video extrapolation

Qualifiers

  • Abstract

Conference

VRST '18

Acceptance Rates

Overall Acceptance Rate 66 of 254 submissions, 26%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)3
  • Downloads (Last 6 weeks)0
Reflects downloads up to 14 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2019)Deep diveProceedings of the 8th ACM International Symposium on Pervasive Displays10.1145/3321335.3324932(1-7)Online publication date: 12-Jun-2019

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media