Abstract
A video see-through head-mounted display (VSHMD) is a modified HMD having an additional small digital camera set (see-through camera set) attached in front of the HMD, which allows users to view the real scene along with virtual information in digitally mixed form. However, although VSHMD has potential utility in augmented reality applications, the visual displacement problem must be overcome. This problem is caused by the distance between the see-through camera and human eye and induces visuomotor performance deterioration. Previous studies have revealed that human adaptation improves the visuomotor performance over time, by rearranging the proprioception. In this study, we extend the visual displacement excessively to 300 mm and investigate the eye–hand and eye–foot visuomotor coordination in two experiments. In Experiment 1, the prism adaptation paradigm is used to compare task performance under various visual displacement conditions. In Experiment 2, the procedures of Experiment 1 are implemented on 3 consecutive days to evaluate the relatively long-term adaptation trend. The results reveal distinct adaptations under all conditions. When excessive visual displacement is unavoidable, sufficient training can improve task performance, similar to the previously discovered perceptual adaptation. However, with increased visual displacement, the task performance improvement decelerates significantly. This improvement attenuation increases as the task performance becomes close to that achieved under bare eye conditions. Although humans can adapt to a large amount of visual displacement, a serious usage problem arises because of this slow adaptation improvement trend.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Alexander MS, Flodin BW, Marigold DS (2011) Prism adaptation and generalization during visually guided locomotor tasks. J Neurophysiol 106:860–871. https://doi.org/10.1152/jn.01040.2010
Arthur K (2000) Effects of field of view on performance with head-mounted displays. Dissertation, University of North Carolina
Bae H, Golparvar-Fard M, White J (2013) High-precision vision-based mobile augmented reality system for context-aware architectural, engineering, construction and facility management (AEC/FM) applications. J Vis Eng 1:1–13. https://doi.org/10.1186/2213-7459-1-3
Chintamani K, Overgaard T, Tan CA, Ellis RD, Pandya A (2008) Physically-based augmented reality for remote robot tele-operation: applications in training and simulation. Proc 2008 IeRC 977–982
Cobb SVG (1999) Measurement of postural stability before and after immersion in a virtual environment. Appl Ergon 30:47–57. https://doi.org/10.1016/S0003-6870(98)00038-6
Fernandez-Ruiz J, Diaz R (1999) Prism adaptation and aftereffect: specifying the properties of a procedural memory system. Learn Mem 6:47–53. https://doi.org/10.1101/lm.6.1.47
Fernandez-Ruiz J, Hall C, Vergara P, Diaz R (2000) Prism adaptation in normal aging: slower adaptation rate and larger aftereffect. Brain Res Cogn Brain Res 9:223–226. https://doi.org/10.1016/S0926-6410(99)00057-9
Fernandez-Ruiz J, Wong W, Armstrong IT, Flanagan JR (2011) Relation between reaction time and reach errors during visuomotor adaptation. Behav Brain Res 219:8–14. https://doi.org/10.1016/j.bbr.2010.11.060
Frassinetti F, Angeli V, Meneghello F, Avanzi S, Ladavas E (2002) Long-lasting amelioration of visuospatial neglect by prism adaptation. Brain 125:608–623. https://doi.org/10.1093/brain/awf056
Hakkinen J, Vuori T, Paakka M (2002) Postural stability and sickness symptoms after HMD use. IEEE ICSMC. https://doi.org/10.1109/ICSMC.2002.1167964
Harris CS (1963) Adaptation to displaced vision: visual, motor, or proprioceptive change? Science 140:812–813. https://doi.org/10.1126/science.140.3568.812
Hay JC, Pick HL Jr (1966) Visual and proprioceptive adaptation to optical displacement of the visual stimulus. J Exp Psychol 71:150–158. https://doi.org/10.1037/h0022611
Hughes CE, Stapleton CB, Hughes DE, Smith EM (2005) Mixed reality in education, entertainment, and training. IEEE Comput Graph Appl 25:24–30. https://doi.org/10.1109/MCG.2005.139
Kennedy RS, Lilienthal MG (1994) Measurement and control of motion sickness aftereffects from immersion in virtual reality. In: Proceedings of virtual reality and medicine: the cutting edge, SIG-advanced applications, Inc., New York, pp 111–119
Kennedy RS, Lilienthal MG (1995) Implications of balance disturbances following exposure to virtual reality systems. Proc VRAIS 1995:35–39. https://doi.org/10.1109/VRAIS.1995.512477
Kim SE, Lee JH, Park JH (2014) The effects of visual displacement on simulator sickness in video see-through head mounted displays. Proc ISWC. https://doi.org/10.1145/2634317.2634339
Kollenberg T, Neumann A, Schneider D, Tews T-K, Hermann T, Ritter H, Dierker A, Koesling H (2010) Visual search in the (un)real world: How head-mounted displays affect eye movements, head movements and target detection. Proc ETRA. https://doi.org/10.1145/1743666.1743696
Lang CE, Bastian AJ (1999) Cerebellar subjects show impaired adaptation of anticipatory EMG during catching. J Neurophysiol 82:2108–2119. https://doi.org/10.1152/jn.1999.82.5.2108
Lang CE, Bastian AJ (2001) Additional somatosensory information does not improve cerebellar adaptation during catching. Clin Neurophysiol 112(5):895–907. https://doi.org/10.1016/S1388-2457(01)00518-1
LaViola JJ Jr (2000) A discussion of cybersickness in virtual environments. SIGCHI Bull 32:47–56. https://doi.org/10.1145/333329.333344
Lee JH, Kim SY, Yoon HC, Huh BK, Park JH (2013) A preliminary investigation of human adaptations for various virtual eyes in video see-through HMDS. Proc SIGCHI 2013:309–312. https://doi.org/10.1145/2470654.2470698
Luaute J, Schwartz S, Rossetti Y, Spiridon M, Rode G, Boisson D, Vuilleumier P (2009) Dynamic changes in brain activity during prism adaptation. J Neurosci 29:169–178. https://doi.org/10.1523/JNEUROSCI.3054-08.2009
Martin TA, Keating JG, Goodkin HP, Bastian AJ, Thach WT (1996) Throwing while looking through prisms. 1. Focal olivocerebellar lesions impair adaptation. Brain 119:1183–1198
McGonigle BO, Flook J (1978) Long-term retention of single and multistate prismatic adaptation by humans. Nature 272:364–366. https://doi.org/10.1038/272364a0
Moss JD, Austin J, Salley J, Coats J, Williams K, Muth ER (2011) The effects of display delay on simulator sickness. Display 32:159–168. https://doi.org/10.1016/j.displa.2011.05.010
Park M, Serefoglou S, Schmidt L, Radermacher K, Schlick C, Luczak H (2008) Hand-eye coordination using a video see-through augmented reality system. Ergon Open J 1:46–53. https://doi.org/10.2174/1875934300801010046
Pretlove J (1998) Augmenting reality for telerobotics: unifying real and virtual worlds. Ind Robot 25:401–407. https://doi.org/10.1108/01439919810240225
Reason JT (1974) Man in motion: the psychology of travel. Cox and Wyman Ltd, Reading
Reason JT (1978) Motion sickness adaptation: a neural mismatch model. J R Soc Med 71:819–829. https://doi.org/10.1177/014107687807101109
Redding GM, Wallace B (1990) Effects on prism adaptation of duration and timing of visual feedback during pointing. J Mot Behav 22:209–224. https://doi.org/10.1080/00222895.1990.10735511
Rolland JP, Holloway RL, Fuchs H (1994) A comparison of optical and video see-through head-mounted displays. SPIE Telemanipulator Telepresence Tech 2351:293–307
Rolland JP, Barlow T, Biocca FA, Kancherla A (1995) Quantification of adaptation to virtual-eye location in see-thru head-mounted displays. Proc VRAIS. https://doi.org/10.1109/vrais.1995.512480
Savin DN, Morton SM (2008) Asymmetric generalization between the arm and leg following prism-induced visuomotor adaptation. Exp Brain Res 186:175–182. https://doi.org/10.1007/s00221-007-1220-9
Serino A, Bonifazi S, Pierfederici L, Ladavas E (2007) Neglect treatment by prism adaptation: what recovers and for how long. Neuropsychol Rehabil 17:657–687. https://doi.org/10.1080/09602010601052006
Stanney KM, Salvendy G (1998) Aftereffects and sense of presence in virtual environments: formulation of a research and development agenda. Int J Hum Comput Interact 10:135–187. https://doi.org/10.1207/s15327590ijhc1002_3
Stanney KM, Kennedy RS, Drexler JM, Harm DL (1999) Motion sickness and proprioceptive aftereffects following virtual environment exposure. Appl Ergon 30:27–38. https://doi.org/10.1016/S0003-6870(98)00039-8
von Helmholtz HEF (1909/1962) Treatise on physiological optics. Southall JPC (ed) and Trans. New York: Dover. (Original work published in 1909)
Wurpts M (2000) Application of a video see-through head-mounted display to infantry training. Presented at IMAGE 2000
Acknowledgements
This work was supported by the Youngsan University Research Fund of 2018.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Lee, J.H., Park, JH. Visuomotor adaptation to excessive visual displacement in video see-through HMDs. Virtual Reality 24, 211–221 (2020). https://doi.org/10.1007/s10055-019-00390-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10055-019-00390-0