Optimizing spatial resolution in head-mounted displays: evaluating characteristics of peripheral visual field
Article No.: 41, Pages 1 - 7
Abstract
An ideal head-mounted display (HMD) is a device that provides a visual experience indistinguishable from that given by the naked eye. Such an HMD must display images with spatial resolution surpassing that of the human visual system. However, excessively high spatial resolution is resource-wasting and inefficient. To optimize this balance, we evaluated the spatial resolution characteristics of the human visual system in the peripheral visual area. Our experiment was performed based on a head-centered coordinate system, acknowledging that users can move their eyes freely within the HMD housing fixed on the user’s head. We measured threshold eccentricities where low-pass filtered noise patterns could be distinguished from intact noise patterns, manipulating cut-off spatial frequencies between one to eight cycles per degree. The results revealed clear asymmetries between the temporal and nasal, as well as between the upper and lower visual fields. In the temporal and lower fields, lower cut-off spatial frequencies resulted in higher eccentricity thresholds. Notably, the smaller impact of spatial frequencies in the nasal and upper visual fields is likely due to visual obstruction by facial structures, such as the nose. Our results can serve as a standard for pixel arrangement design in an ideal HMD.
References
[1]
Rachel A. Albert, Anjul Patney, David P. Luebke, and Joohwan Kim. 2017. Latency Requirements for Foveated Rendering in Virtual Reality. ACM Transactions on Applied Perception (TAP) 14 (2017), 1–13. https://doi.org/10.1145/3127589
[2]
S.M. Anstis. 1974. A chart demonstrating variations in acuity with retinal position. Vision Research 14, 7 (1974), 589–592. https://doi.org/10.1016/0042-6989(74)90049-2
[3]
Antoine Barbot, Shutian Xue, and Marisa Carrasco. 2021. Asymmetries in visual acuity around the visual field. Journal of Vision 21, 1 (01 2021), 2–2. https://doi.org/10.1167/jov.21.1.2
[4]
D. H. Brainard. 1997. The Psychophysics Toolbox. Spatial Vision 10, 4 (1997), 433–436. https://doi.org/10.1163/156856897X00357
[5]
F. W. Campbell and J. G. Robson. 1968. Application of fourier analysis to the visibility of gratings. The Journal of Physiology 197, 3 (1968), 551–566. https://doi.org/10.1113/jphysiol.1968.sp008574
[6]
Aaron L. Cecala and Edward G. Freedman. 2008. Amplitude changes in response to target displacements during human eye–head movements. Vision Research 48, 2 (2008), 149–166. https://doi.org/10.1016/j.visres.2007.10.029
[7]
Robert G. Franciscus and Jeffrey C. Long. 1991. Variation in human nasal height and breadth. American Journal of Physical Anthropology 85, 4 (1991), 419–427. https://doi.org/10.1002/ajpa.1330850406
[8]
Wilson S. Geisler and Jeffrey S. Perry. 1998. Real-time foveated multiresolution system for low-bandwidth video communication. In Human Vision and Electronic Imaging III, Bernice E. Rogowitz and Thrasyvoulos N. Pappas (Eds.). Vol. 3299. International Society for Optics and Photonics, SPIE, San Jose, CA, USA, 294 – 305. https://doi.org/10.1117/12.320120
[9]
Scott S. Grigsby and Brian H. Tsou. 1994. Grating and flicker sensitivity in the near and far periphery: Naso-temporal asymmetries and binocular summation. Vision Research 34, 21 (1994), 2841–2848. https://doi.org/10.1016/0042-6989(94)90053-1
[10]
D. Guitton and M. Volle. 1987. Gaze control in humans: eye-head coordination during orienting movements to targets within and beyond the oculomotor range. Journal of Neurophysiology 58, 3 (1987), 427–459. https://doi.org/10.1152/jn.1987.58.3.427
[11]
Sahira Hanif, Fiona J. Rowe, and Anna R. O’connor. 2009. A comparative review of methods to record ocular rotations. British and Irish Orthoptic Journal 6 (Aug 2009), 47–51. https://doi.org/10.22599/bioj.8
[12]
Masamitsu Harasawa, Yamato Miyashita, and Kazuteru Komine. 2021. Perimetry on Head-Centered Coordinate System for Requirements of Head-Mounted Display. In Proceedings of the International Display Workshops, Vol. 28. International Display Workshops General Incorporated Association, Online, 587–589. https://doi.org/10.36463/idw.2021.0587
[13]
Masamitsu Harasawa, Yamato Miyashita, and Kazuteru Komine. 2023. Required Specification on Spatial Aspects for Ideal HMD Estimated on Head-Centered Coordinate System. In Proceedings of the International Display Workshops, Vol. 30. International Display Workshops General Incorporated Association, Niigata, Japan, 748–748. https://doi.org/10.36463/idw.2023.0748
[14]
Masamitsu Harasawa, Yamato Miyashita, and Kazuteru Komine. 2023. Spatial frequency characteristics against field-of-view eccentricity in head-centered coordinate system: A study for requirement specifications of ideal HMD. In Proceedings of the 28th Annual Conference of the Virtual Reality Society of Japan. The Virtual Reality Society of Japan, Hachioji, Japan, 2D1–10. https://conference.vrsj.org/ac2023/program/doc/2D1-10.pdf (In Japanese).
[15]
Lewis O. Harvey. 1986. Efficient estimation of sensory thresholds. Behavior Research Methods, Instruments, & Computers 18, 6 (01 Nov 1986), 623–632. https://doi.org/10.3758/BF03201438
[16]
Shirin E. Hassan, John C. Hicks, Hao Lei, and Kathleen A. Turano. 2007. What is the minimum field of view required for efficient navigation?Vision Research 47, 16 (2007), 2115–2123. https://doi.org/10.1016/j.visres.2007.03.012
[17]
Marc M. Himmelberg, Jonathan Winawer, and Marisa Carrasco. 2020. Stimulus-dependent contrast sensitivity asymmetries around the visual field. Journal of Vision 20, 9 (09 2020), 18–18. https://doi.org/10.1167/jov.20.9.18
[18]
Marc M. Himmelberg, Jonathan Winawer, and Marisa Carrasco. 2023. Polar angle asymmetries in visual perception and neural architecture. Trends in Neurosciences 46, 6 (2023), 445–458. https://doi.org/10.1016/j.tins.2023.03.006
[19]
Won June Lee, Ji Hong Kim, Yong Un Shin, Sunjin Hwang, and Han Woong Lim. 2019. Differences in eye movement range based on age and gaze direction. Eye 33, 7 (July 2019), 1145–1151. https://doi.org/10.1038/s41433-019-0376-4
[20]
Marc Levoy and Ross Whitaker. 1990. Gaze-directed volume rendering. In Proceedings of the 1990 Symposium on Interactive 3D Graphics (Snowbird, Utah, USA) (I3D ’90). Association for Computing Machinery, New York, NY, USA, 217–223. https://doi.org/10.1145/91385.91449
[21]
J.J.-W. Lin, H.B.L. Duh, D.E. Parker, H. Abi-Rached, and T.A. Furness. 2002. Effects of field of view on presence, enjoyment, memory, and simulator sickness in a virtual environment. In Proceedings IEEE Virtual Reality 2002. IEEE, Orlando, FL, USA, 164–171. https://doi.org/10.1109/VR.2002.996519
[22]
Pengyinjie Lyu and Hong Hua. 2021. Perceptual-driven approach to statically foveated head-mounted displays. Optical Express 29, 21 (Oct. 2021), 33890–33914. https://doi.org/10.1364/OE.440323
[23]
Kenichiro Masaoka, Masaki Emoto, Masayuki Sugawara, and Yuji Nojiri. 2007. Comparing realness between real objects and images at various resolutions. In Human Vision and Electronic Imaging XII, Bernice E. Rogowitz, Thrasyvoulos N. Pappas, and Scott J. Daly (Eds.). Vol. 6492. International Society for Optics and Photonics, SPIE, San Jose, CA, USA, 64921F. https://doi.org/10.1117/12.704947
[24]
Yamato Miyashita, Masamitsu Harasawa, Kazuhiro Hara, Yasuhito Sawahata, and Kazuteru Komine. 2023. Estimation of Required Horizontal FoV for Ideal HMD Utilizing Vignetting under Practical Range of Eye Displacement. In 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). IEEE, Shanghai, China, 691–692. https://doi.org/10.1109/VRW58643.2023.00188
[25]
Bipul Mohanto, ABM Tariqul Islam, Enrico Gobbetti, and Oliver Staadt. 2022. An integrative view of foveated rendering. Computers & Graphics 102 (2022), 474–501. https://doi.org/10.1016/j.cag.2021.10.010
[26]
Eric D. Ragan, Doug A. Bowman, Regis Kopper, Cheryl Stinson, Siroberto Scerbo, and Ryan P. McMahan. 2015. Effects of Field of View and Visual Complexity on Virtual Reality Training Effectiveness for a Visual Scanning Task. IEEE Transactions on Visualization and Computer Graphics 21, 7 (2015), 794–807. https://doi.org/10.1109/TVCG.2015.2403312
[27]
D. Regan and K. I. Beverley. 1983. Visual fields described by contrast sensitivity, by acuity, and by relative sensitivity to different orientations.Investigative Ophthalmology & Visual Science 24, 6 (06 1983), 754–759.
[28]
Jannick P. Rolland, Akitoshi Yoshida, Larry D. Davis, and John H. Reif. 1998. High-resolution inset head-mounted display. Appllied Optics 37, 19 (Jul 1998), 4183–4193. https://doi.org/10.1364/AO.37.004183
[29]
Henning Rönne 1915. On the theory and technique of Bjerrum’s visual field examination. Archive for Ophthalmology 78, 4 (1915), 284–301.
[30]
Jyrki Rovamo, Veijo Virsu, and Risto Näsänen. 1978. Cortical magnification factor predicts the photopic contrast sensitivity of peripheral vision. Nature 271, 5640 (01 Jan 1978), 54–56. https://doi.org/10.1038/271054a0
[31]
Robert H Spector. 1990. Visual Fields. In Clinical Methods: The History, Physical, and Laboratory Examinations. 3rd edition., H Kenneth Walker, W Dallas Hall, and J Willis Hurst (Eds.). Butterworths, Boston, Chapter 116, 565–572.
[32]
Cigdem P Talgar and Marisa Carrasco. 2002. Vertical meridian asymmetry in spatial resolution: visual and attentional factors. Psychonomic Bulletin & Review 9, 4 (Dec. 2002), 714–722. https://doi.org/10.3758/BF03196326
[33]
Guanjun Tan, Yun-Han Lee, Tao Zhan, Jilin Yang, Sheng Liu, Dongfeng Zhao, and Shin-Tson Wu. 2018. Foveated imaging for near-eye displays. Optics Express 26, 19 (Sep 2018), 25076–25085. https://doi.org/10.1364/OE.26.025076
[34]
Harry Moss Traquair. 1927. An Introduction to Clinical Perimetry (1st. ed.). Mosby, St. Louis, MO.
[35]
Yoshiaki Tsushima, Kazuteru Komine, Yasuhito Sawahata, and Toshiya Morita. 2016. Undetectable Changes in Image Resolution of Luminance-Contrast Gradients Affect Depth Perception. Frontiers in Psychology 7 (2016). https://doi.org/10.3389/fpsyg.2016.00242
[36]
A van der Schaaf and J H van Hateren. 1996. Modelling the power spectra of natural images: statistics and information. Vision Res. 36, 17 (Sept. 1996), 2759–2770. https://doi.org/10.1016/0042-6989(96)00002-8
[37]
Varjo. 2023. XR-4 Series. Varjo Technologies Oy. Retrieved June 13, 2024 from https://varjo.com/products/xr-4/
[38]
Una Strand Viðarsdóttir, Paul O’Higgins, and Chris Stringer. 2002. A geometric morphometric study of regional differences in the ontogeny of the modern human facial skeleton. Journal of Anatomy 201, 3 (2002), 211–229. https://doi.org/10.1046/j.1469-7580.2002.00092.x
[39]
Andrew B. Watson and Denis G. Pelli. 1983. Quest: A Bayesian adaptive psychometric method. Perception & Psychophysics 33, 2 (01 Mar 1983), 113–120. https://doi.org/10.3758/BF03202828
Index Terms
- Optimizing spatial resolution in head-mounted displays: evaluating characteristics of peripheral visual field
Recommendations
Characterizing Visual Acuity in the Use of Head Mounted Displays
Advances in Computer GraphicsAbstractIn the real world, the sense of sight is dominant for humans, and having a normal vision is essential to perform well in many common tasks. There, ophthalmology has several tools to assess and correct a person’s vision. In VR, when wearing an HMD, ...
Natural Perspective Projections for Head-Mounted Displays
The display units integrated in today's head-mounted displays (HMDs) provide only a limited field of view (FOV) to the virtual world. In order to present an undistorted view to the virtual environment (VE), the perspective projection used to render the ...
An Initial Exploration of Visual Cues in Head-Mounted Display Augmented Reality for Book Searching
MUM '22: Proceedings of the 21st International Conference on Mobile and Ubiquitous MultimediaAugmented reality (AR) is today becoming more widely utilized as it allows for interacting with the virtual objects. In this study, we propose an head-mounted display (HMD) AR system supporting book searching with visual cues. The visual cue is ...
Comments
Information & Contributors
Information
Published In
October 2024
633 pages
ISBN:9798400705359
DOI:10.1145/3641825
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 09 October 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
VRST '24: 30th ACM Symposium on Virtual Reality Software and Technology
October 9 - 11, 2024
Trier, Germany
Acceptance Rates
Overall Acceptance Rate 66 of 254 submissions, 26%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 118Total Downloads
- Downloads (Last 12 months)118
- Downloads (Last 6 weeks)36
Reflects downloads up to 08 Mar 2025
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatLogin options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in