skip to main content
10.1145/2628257.2628268acmconferencesArticle/Chapter ViewAbstractPublication PagessapConference Proceedingsconference-collections
research-article

Effects of visual and proprioceptive information in visuo-motor calibration during a closed-loop physical reach task in immersive virtual environments

Published:08 August 2014Publication History

ABSTRACT

Research in visuo-motor coupling has shown that the matching of visual and proprioceptive information is important for calibrating movement. Many state-of-the art virtual reality (VR) systems, commonly known as immersive virtual environments (IVE), are created for training users in tasks that require accurate manual dexterity. Unfortunately, these systems can suffer from technical limitations that may force de-coupling of visual and proprioceptive information due to interference, latency, and tracking error. We present an empirical evaluation of how visually distorted movements affects users' reach to near field targets using a closed-loop physical reach task in an IVE. We specifically examined the recalibration of movements when the visually reached distance is scaled differently than the physically reached distance. Subjects were randomly assigned to one of three visual feedback conditions during which they reached to target while holding a tracked stylus: i) Condition 1 (-20% gain condition) in which the visual stylus appeared at 80% of the distance of the physical stylus, ii) Condition 2 (0% or no gain condition) in which the visual stylus was co-located with the physical stylus, and iii) Condition 3 (+20% gain condition) in which the visual stylus appeared at 120% of the distance of the physical stylus. In all conditions, there is evidence of visuo-motor calibration in that users' accuracy in physically reaching to the target locations improved over trials. During closed-loop physical reach responses, participants generally tended to physically reach farther in condition 1 and closer in condition 3 to the perceived location of the targets, as compared to condition 2 in which participants' physical reach was more accurate to the perceived location of the target.

References

  1. Altenhoff, B. M., Napieralski, P. E., Long, L. O., Bertrand, J. W., Pagano, C. C., Babu, S. V., and Davis, T. A. 2012. Effects of calibration to visual and haptic feedback on near-field depth perception in an immersive virtual environment. In Proceedings of the ACM Symposium on Applied Perception, ACM, 71--78. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Bingham, G. E., and Pagano, C. C. 1998. The necessity of a perception-action approach to definite distance perception: Monocular distance perception to guide reaching. Journal of Experimental Psychology: Human Perception and Performance 24, 1, 145--168.Google ScholarGoogle ScholarCross RefCross Ref
  3. Bingham, G., and Romack, J. L. 1999. The rate of adaptation to displacement prisms remains constant despite acquisition of rapid calibration. Journal of Experimental Psychology: Human Perception and Performance 25, 5, 1331.Google ScholarGoogle ScholarCross RefCross Ref
  4. Casper, J., and Murphy, R. R. 2003. Human-robot interactions during the robot-assisted urban search and rescue response at the world trade center. Systems, Man, and Cybernetics, Part B: Cybernetics, IEEE Transactions on 33, 3, 367--385. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Foley, J. M., et al. 1977. Effect of distance information and range on two indices of visually perceived distance. Perception 6, 4, 449--460.Google ScholarGoogle ScholarCross RefCross Ref
  6. Grechkin, T. Y., Nguyen, T. D., Plumert, J. M., Cremer, J. F., and Kearney, J. K. 2010. How does presentation method and measurement protocol affect distance estimation in real and virtual environments? ACM Transactions on Applied Perception (TAP) 7, 4, 26. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Hine, B., Stoker, C., Sims, M., Rasmussen, D., Hontalas, P., Fong, T., Steele, J., Barch, D., Andersen, D., Miles, E., et al. 1994. The application of telepresence and virtual reality to subsea exploration. In Proceeding of the 2nd Workshop on: Mobile Robots for Subsea Environments, International Advanced Robotics Program (IARP), MJ Lee and RB McGee (eds), Monterey, CA, 117--126.Google ScholarGoogle Scholar
  8. Kelly, J. W., Hammel, W. W., Siegel, Z. D., and Sjolund, L. A. 2014. Recalibration of perceived distance in virtual environments occurs rapidly and transfers asymmetrically across scale. IEEE Transaction on Visualization and Computer Graphics 20, 4, 588--595. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Kunz, B. R., Creem-Regher, S. H., and Thompson, W. B. 2013. Does perceptual-motor calibration generalize across two different forms of locomotion? investigations of walking and wheelchairs. PLOS one 8, 2.Google ScholarGoogle ScholarCross RefCross Ref
  10. Landy, M. S., Maloney, L. T., Johnston, E. B., and Young, M. 1995. Measurement and modeling of depth cue combination: In defense of weak fusion. Vision research 35, 3, 389--412.Google ScholarGoogle Scholar
  11. Messing, R., and Durgin, F. H. 2005. Distance perception and the visual horizon in head-mounted displays. ACM Transactions on Applied Perception (TAP) 2, 3, 234--250. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Milner, A. D., Goodale, M. A., and Vingrys, A. J. 2006. The visual brain in action, vol. 2. Oxford University Press Oxford.Google ScholarGoogle Scholar
  13. Mohler, B. J., Creem-Regehr, S. H., and Thompson, W. B. 2006. The influence of feedback on egocentric distance judgments in real and virtual environments. In Proceedings of the 3rd symposium on Applied perception in graphics and visualization, ACM, 9--14. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Napieralski, P. E., Altenhoff, B. M., Bertrand, J. W., Long, L. O., Babu, S. V., Pagano, C. C., Kern, J., and Davis, T. A. 2011. Near-field distance perception in real and virtual environments using both verbal and action responses. ACM Transactions on Applied Perception (TAP) 8, 3, 18. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Pagano, C. C., and Bingham, G. P. 1998. Comparing measures of monocular distance perception: Verbal and reaching errors are not correlated. Journal of Experimental Psychology: Human Perception and Performance 24, 4, 1037.Google ScholarGoogle ScholarCross RefCross Ref
  16. Pagano, C. C., and Isenhower, R. W. 2008. Expectation affects verbal judgments but not reaches to visually perceived egocentric distances. Psychonomic bulletin & review 15, 2, 437--442.Google ScholarGoogle Scholar
  17. Pagano, C. C., Grutzmacher, R. P., and Jenkins, J. C. 2001. Comparing verbal and reaching responses to visually perceived egocentric distances. Ecological Psychology 13, 3, 197--226.Google ScholarGoogle ScholarCross RefCross Ref
  18. Richardson, A. R., and Waller, D. 2005. The effect of feedback training on distance estimation in virtual environments. Applied Cognitive Psychology 19, 8, 1089--1108.Google ScholarGoogle ScholarCross RefCross Ref
  19. Rieser, J. J., Pick, H. L., Ashmead, D. H., and Garing, A. E. 1995. Calibration of human locomotion and models of perceptual-motor organization. Journal of Experimental Psychology: Human Perception and Performance 21, 3, 480--497.Google ScholarGoogle ScholarCross RefCross Ref
  20. Rolland, J. P., Burbeck, C. A., Gibson, W., and Ariely, D. 1995. Towards quantifying depth and size perception in 3d virtual environments. Presence: Teleoperators and Virtual Environments 4, 1, 24--48.Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Schmidt, R. A., and Lee, T. 1988. Motor Control and Learning, 5E. Human kinetics.Google ScholarGoogle Scholar
  22. Seymour, N. E. 2008. Vr to or: a review of the evidence that virtual reality simulation improves operating room performance. World journal of surgery 32, 2, 182--188.Google ScholarGoogle Scholar
  23. Singh, G., Swan II, J. E., Jones, J. A., and Ellis, S. R. 2010. Depth judgment measures and occluding surfaces in near-field augmented reality. In Proceedings of the 7th Symposium on Applied Perception in Graphics and Visualization, ACM, 149--156. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Thompson, W. B., Willemsen, P., Gooch, A. A., Creem-Regehr, S. H., Loomis, J. M., and Beall, A. C. 2004. Does the quality of the computer graphics matter when judging distances in visually immersive environments? Presence: Teleoperators and Virtual Environments 13, 5, 560--571. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Willemsen, P., Gooch, A. A., Thompson, W. B., and Creem-Regehr, S. H. 2008. Effects of stereo viewing conditions on distance perception in virtual environments. Presence: Teleoperators and Virtual Environments 17, 1, 91--101. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Willemsen, P., Coltona, M. B., Creem-Regehr, S. H., and Thompson, W. B. 2009. The effects of head-mounted display mechanical properties and field of view on distance judgments in virtual environments. ACM Transactions on Applied Perception (TAP) 6, 2, 1--14. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Witmer, B. G., and Kline, P. B. 1998. Judging perceived and traversed distance in virtual environments. Presence: Teleoperators and Virtual Environments 7, 2, 144--167. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Witmer, B. G., and Sadowski, W. J. 1998. Nonvisually guided locomotion to a previously viewed target in real and virtual environments. Human Factors: The Journal of the Human Factors and Ergonomics Society 40, 3, 478--488.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Effects of visual and proprioceptive information in visuo-motor calibration during a closed-loop physical reach task in immersive virtual environments

            Recommendations

            Comments

            Login options

            Check if you have access through your login credentials or your institution to get full access on this article.

            Sign in
            • Published in

              cover image ACM Conferences
              SAP '14: Proceedings of the ACM Symposium on Applied Perception
              August 2014
              137 pages
              ISBN:9781450330091
              DOI:10.1145/2628257

              Copyright © 2014 ACM

              Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

              Publisher

              Association for Computing Machinery

              New York, NY, United States

              Publication History

              • Published: 8 August 2014

              Permissions

              Request permissions about this article.

              Request Permissions

              Check for updates

              Qualifiers

              • research-article

              Acceptance Rates

              Overall Acceptance Rate43of94submissions,46%

            PDF Format

            View or Download as a PDF file.

            PDF

            eReader

            View online with eReader.

            eReader