Skip to main content
SpringerLink
Log in

Effects of physical walking on eyes-engaged target selection with ray-casting pointing in virtual reality

  • Original Article
  • Published:
Virtual Reality Aims and scope Submit manuscript

Abstract

Target selection in virtual reality (VR) is usually carried out with the need of visual attention. While target selection in VR has been extensively investigated in non-walking activities (e.g., sitting or standing), there have been few studies about eyes-engaged target selection during walking in virtual environments. Therefore, we conducted a comprehensive study to explore the effects of physical walking (as an independent variable with low, medium and high speeds) on eyes-engaged selection tasks with targets (three target sizes and three target depths) in two experiments: targets fixed in the virtual environment (Experiment One) and targets fixed to the virtual body (Experiment Two), respectively. Results showed that for Experiment One, the low walking speed led to the significantly longest task completion time, while the medium and high speeds had similar task completion time. For Experiment Two, higher walking speed led to longer task completion time. In both tasks, error rate significantly increased as walking speed increased. The effects of walking speed also varied across target size and target depth. We conclude our study with a set of design implications for target selection tasks when walking in VR environments.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Notes

  1. https://www.youtube.com/watch?v=wGpsQCddjwY.

  2. https://store.steampowered.com/app/597770/VINDICTA/.

  3. http://www.spacewalkervr.com/urunler/.

  4. https://aperiumreality.com/index.php/en/K01/.

  5. https://www.virtuix.com/omniverse-esports/.

References

  • Abtahi P, Gonzalez-Franco M, Ofek E, Steed A (2019) I’m a giant: Walking in large virtual environments at high speed gains. In: Proceedings of the 2019 CHI conference on human factors in computing systems, pp 1–13

  • Argelaguet F, Andujar C (2013) A survey of 3d object selection techniques for virtual environments. Comput Graph 37(3):121–136

    Article  Google Scholar 

  • Armbrüster C, Wolter M, Kuhlen T, Spijkers W, Fimm B (2008) Depth perception in virtual reality: distance estimations in peri-and extrapersonal space. Cyberpsychol Behavior 11(1):9–15

    Article  Google Scholar 

  • Banton T, Stefanucci J, Durgin F, Fass A, Proffitt D (2005) The perception of walking speed in a virtual environment. Presence Teleoper Virtual Environ 14(4):394–406

    Article  Google Scholar 

  • Barrera Machuca MD, Stuerzlinger W (2019) The effect of stereo display deficiencies on virtual hand pointing. In: Proceedings of the 2019 CHI conference on human factors in computing systems, pp 1–14

  • Batmaz AU, Mutasim AK, Stuerzlinger W (2020) Precision vs. power grip: A comparison of pen grip styles for selection in virtual reality. In: 2020 IEEE conference on virtual reality and 3D user interfaces abstracts and workshops (VRW), pp 23–28. IEEE

  • Batmaz AU, Stuerzlinger W (2021) The effect of pitch in auditory error feedback for fitts’ tasks in virtual reality training systems. In: 2021 IEEE conference on virtual reality and 3D user interfaces (VR), pp 85–94. IEEE

  • Bergström J, Dalsgaard T.-S, Alexander J, Hornbæk K (2021) How to evaluate object selection and manipulation in vr? guidelines from 20 years of studies. In: Proceedings of the 2021 CHI conference on human factors in computing systems, pp 1–20

  • Bergstrom-Lehtovirta J, Oulasvirta A, Brewster S (2011) The effects of walking speed on target acquisition on a touchscreen interface. In: Proceedings of the 13th international conference on human computer interaction with mobile devices and services, pp 143–146

  • Bowman DA, Johnson DB, Hodges LF (2001) Testbed evaluation of virtual environment interaction techniques. Presence Teleoper Virtual Environ 10(1):75–95

    Article  Google Scholar 

  • Bozgeyikli E, Rail A, Katkoori S, Dubey R (2019) Locomotion in virtual reality for room scale tracked areas. Int J Hum Comput Stud 122:38–49

    Article  Google Scholar 

  • Bruder G, Lubos P, Steinicke F (2015) Cognitive resource demands of redirected walking. IEEE Trans Visual Comput Graphics 21(4):539–544

    Article  Google Scholar 

  • Cashion J, Wingrave C, LaViola Jr J.J (2012) Dense and dynamic 3d selection for game-based virtual environments. IEEE Trans Visual Comput Graphics 18(4):634–642

    Article  Google Scholar 

  • Cherni, H., Métayer, N., & Souliman, N. (2020). Literature review of locomotion techniques in virtual reality. International Journal of Virtual Reality.  https://doi.org/10.20870/IJVR.2020.20.1.3183.

  • Chiovetto E, Giese MA (2013) Kinematics of the coordination of pointing during locomotion. PLoS ONE 8(11):79555

    Article  Google Scholar 

  • Choi J-S, Kang D-W, Seo J-W, Tack G-R (2015) Reliability of the walking speed and gait dynamics variables while walking on a feedback-controlled treadmill. J Biomech 48(7):1336–1339

    Article  Google Scholar 

  • Faul F, Erdfelder E, Lang A-G, Buchner A (2007) G* power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods 39(2):175–191

    Article  Google Scholar 

  • Feasel J, Whitton MC, Kassler L, Brooks FP, Lewek MD (2011) The integrated virtual environment rehabilitation treadmill system. IEEE Trans Neural Syst Rehabil Eng 19(3):290–297

    Article  Google Scholar 

  • Feasel J, Whitton M.C, Wendt J.D (2008) Llcm-wip: Low-latency, continuous-motion walking-in-place. In: IEEE symposium on 3D user interfaces 2008, pp 97–104

  • Fung J, Richards CL, Malouin F, McFadyen BJ, Lamontagne A (2006) A treadmill and motion coupled virtual reality system for gait training post-stroke. CyberPsychol Behavior 9(2):157–162

    Article  Google Scholar 

  • Gao B, Kim B, Kim J-I, Kim H (2019) Amphitheater layout with egocentric distance-based item sizing and landmarks for browsing in virtual reality. Int J Human-Comput Interact 35(10):831–845

    Article  Google Scholar 

  • Gao B, Lu Y, Kim H, Kim B, Long J (2019) Spherical layout with proximity-based multimodal feedback for eyes-free target acquisition in virtual reality. In: International conference on human-computer interaction, pp 44–58. Springer

  • Gao B, Mai Z, Tu H, Duh H.B.-L (2021) Evaluation of body-centric locomotion with different transfer functions in virtual reality. In: 2021 IEEE virtual reality and 3D user interfaces (VR), pp 493–500. IEEE

  • Grossman T, Balakrishnan R (2006) The design and evaluation of selection techniques for 3d volumetric displays. In: Proceedings of the 19th annual ACM symposium on user interface software and technology, pp 3–12

  • Hanson S, Paris R.A, Adams H.A, Bodenheimer B (2019) Improving walking in place methods with individualization and deep networks. In: 2019 IEEE conference on virtual reality and 3D user interfaces (VR), pp 367–376

  • Interrante V, Ries B, Anderson L (2007) Seven league boots: A new metaphor for augmented locomotion through moderately large scale immersive virtual environments. In: 2007 IEEE symposium on 3D user interfaces. IEEE

  • Iwata H (1999) Walking about virtual environments on an infinite floor. In: Proceedings IEEE virtual reality, pp 286–293

  • Iwata H, Yano H, Fukushima H, Noma H (2005) Circulafloor [locomotion interface]. IEEE Comput Graphics Appl 25(1):64–67

    Article  Google Scholar 

  • Janeh O, Langbehn E, Steinicke F, Bruder G, Gulberti A, Poetter-Nerger M (2017) Walking in virtual reality: Effects of manipulated visual self-motion on walking biomechanics. ACM Trans Appl Percept 14(2):1–15

    Article  Google Scholar 

  • Janeh O, Langbehn E, Steinicke F, Bruder G (2017) Biomechanical analysis of (non-)isometric virtual walking of older adults. In: IEEE virtual reality, pp 217–218

  • Kane S.K, Wobbrock J.O, Smith I.E (2008) Getting off the treadmill: evaluating walking user interfaces for mobile devices in public spaces. In: Proceedings of the 10th international conference on human computer interaction with mobile devices and services, pp 109–118

  • Kannape OA, Barré A, Aminian K, Blanke O (2014) Cognitive loading affects motor awareness and movement kinematics but not locomotor trajectories during goal-directed walking in a virtual reality environment. PLoS ONE 9(1):85560

    Article  Google Scholar 

  • Kassler L, Feasel J, Lewek M.D, Brooks Jr F.P, Whitton M.C (2010) Matching actual treadmill walking speed and visually perceived walking speed in a projection virtual environment. In: Proceedings of the 7th symposium on applied perception in graphics and visualization, pp 161–161

  • Keung CCW, Kim JI, Ong QM (2021) Developing a bim-based muvr treadmill system for architectural design review and collaboration. Appl Sci 11(15):6881

    Article  Google Scholar 

  • Khanwalker S, Balakrishna S, Jain R (2016) Exploration of large image corpuses in virtual reality. In: ACM multimedia, pp 596–600

  • Lin CJ, Woldegiorgis BH (2017) Egocentric distance perception and performance of direct pointing in stereoscopic displays 64:66–74

  • Lin M, Goldman R, Price KJ, Sears A, Jacko J (2007) How do people tap when walking? an empirical investigation of nomadic data entry. Int J Hum Comput Stud 65(9):759–769

    Article  Google Scholar 

  • Liu J, Prouzeau A, Ens B, Dwyer T (2020) Design and evaluation of interactive small multiples data visualisation in immersive spaces. In: 2020 IEEE conference on virtual reality and 3D user interfaces (VR), pp 588–597. IEEE

  • Lubos P, Bruder G, Steinicke F (2014) Analysis of direct selection in head-mounted display environments. In: 2014 IEEE symposium on 3D user interfaces, pp 11–18

  • Lu Y, Yu C, Shi Y (2020) Investigating bubble mechanism for ray-casting to improve 3d target acquisition in virtual reality. In: 2020 IEEE Conference on virtual reality and 3D user interfaces (VR), pp 35–43. IEEE

  • Machuca MDB, Stuerzlinger W (2018) Do stereo display deficiencies affect 3d pointing? In: Extended abstracts of 2018 CHI conference on human factors in computing systems, pp 1–6

  • Medina E, Fruland R, Weghorst S (2008) Virtusphere: Walking in a human size vr “hamster ball”. In: Proceedings of the human factors and ergonomics society annual meeting, vol. 52, pp. 2102–2106 . SAGE Publications Sage CA: Los Angeles, CA

  • Mine MR (1995) Virtual environment interaction techniques. UNC Chapel Hill CS Dept

  • Ng A, Brewster S (2013) The relationship between encumbrance and walking speed on mobile interactions. In: CHI’13 extended abstracts on human factors in computing systems, pp 1359–1364

  • Nilsson NC, Serafin S, Nordahl R (2014) Establishing the range of perceptually natural visual walking speeds for virtual walking-in-place locomotion. IEEE Trans Visual Comput Graphics 20(4):569–578

    Article  Google Scholar 

  • Nilsson NC, Serafin S, Nordahl R (2015) The effect of visual display properties and gain presentation mode on the perceived naturalness of virtual walking speeds. IEEE Virtual Reality Conf 2015:81–88

    Google Scholar 

  • Nilsson NC, Serafin S, Steinicke F, Nordahl R (2018) Natural walking in virtual reality: A review. Comput Entertain 16(2):1–22

    Article  Google Scholar 

  • Nilsson N.C, Serafin S, Laursen M.H, Pedersen K.S, Sikström E, Nordahl R (2013) Tapping-in-place: Increasing the naturalness of immersive walking-in-place locomotion through novel gestural input. In: IEEE symposium on 3D user interfaces 2013, pp 31–38. IEEE

  • Nilsson N.C, Serafin S, Nordahl R (2014) The influence of step frequency on the range of perceptually natural visual walking speeds during walking-in-place and treadmill locomotion. In: Proceedings of the 20th ACM symposium on virtual reality software and technology, pp 187–190

  • Polechoński J, Nierwińska K, Kalita B, Wodarski P (2020) Can physical activity in immersive virtual reality be attractive and have sufficient intensity to meet health recommendations for obese children? a pilot study. Int J Environ Res Public Health 17(21):8051

    Article  Google Scholar 

  • Poupyrev I, Billinghurst M, Weghorst S, Ichikawa T (1996) The go-go interaction technique: non-linear mapping for direct manipulation in vr. In: Proceedings of the 9th annual ACM symposium on user interface software and technology, pp 79–80

  • Poupyrev I, Ichikawa T, Weghorst S, Billinghurst M (1998) Egocentric object manipulation in virtual environments: empirical evaluation of interaction techniques. In: Computer graphics forum, vol. 17, pp 41–52. Wiley Online Library

  • Powell W, Stevens B, Hand S, Simmonds M (2011) Blurring the boundaries: The perception of visual gain in treadmill-mediated virtual environments. In: 3rd IEEE VR 2011 workshop on perceptual illusions in virtual environments

  • Sayyad E, Sra M, Höllerer T (2020) Walking and teleportation in wide-area virtual reality experiences. In: 2020 IEEE international symposium on mixed and augmented reality (ISMAR), pp 608–617

  • Schildbach B, Rukzio E (2010) Investigating selection and reading performance on a mobile phone while walking. In: Proceedings of the 12th international conference on human computer interaction with mobile devices and services, pp 93–102

  • Schneider S, Maruhn P, Bengler K (2018) Locomotion, non-isometric mapping and distance perception in virtual reality. In: ICCAE, pp 22–26

  • Serrar Z, Elmarzouqi N, Jarir Z, Lapayre J.-C (2014) Evaluation of disambiguation mechanisms of object-based selection in virtual environment: Which performances and features to support “pick out”? In: Proceedings of the XV international conference on human computer interaction, pp 1–8

  • Sloot L, Van der Krogt M, Harlaar J (2014) Effects of adding a virtual reality environment to different modes of treadmill walking. Gait Posture 39(3):939–945

    Article  Google Scholar 

  • Steinicke F, Ropinski T, Hinrichs K (2006) Object selection in virtual environments using an improved virtual pointer metaphor. In: Computer vision and graphics, pp 320–326

  • Suma EA, Lipps Z, Finkelstein S, Krum DM, Bolas M (2012) Impossible spaces: Maximizing natural walking in virtual environments with self-overlapping architecture. IEEE Trans Visual Comput Graphics 18(4):555–564

    Article  Google Scholar 

  • Suma E.A, Babu S, Hodges L.F (2007) Comparison of travel techniques in a complex, multi-level 3d environment. In: IEEE symposium on 3D user interfaces 2007

  • Suma E.A, Bruder G, Steinicke F, Krum D.M, Bolas M (2012) A taxonomy for deploying redirection techniques in immersive virtual environments. In: 2012 IEEE virtual reality workshops (VRW), pp 43–46. IEEE

  • Takashina T, Ito M, Nagaura H, Wakabayashi E (2021) Evaluation of curved raycasting-based interactive surfaces in virtual environments. In: 2021 IEEE conference on virtual reality and 3D user interfaces abstracts and workshops (VRW), pp 534–535

  • Teather RJ, Stuerzlinger W (2011) Pointing at 3d targets in a stereo head-tracked virtual environment. In: 2011 IEEE symposium on 3D user interfaces, pp 87–94

  • Tregillus S, Folmer E (2016) Vr-step: Walking-in-place using inertial sensing for hands free navigation in mobile vr environments. In: Proceedings of the CHI conference on human factors in computing systems, pp 1250–1255

  • Tu H, Huang S, Yuan J, Ren X, Tian F (2019) Crossing-based selection with virtual reality head-mounted displays. In: Proceedings of the 2019 CHI conference on human factors in computing systems, pp 1–14

  • Usoh M, Arthur K, Whitton M.C, Bastos R, Steed A, Slater M, Brooks Jr F.P (1999) Walking> walking-in-place> flying, in virtual environments. In: Proceedings of the 26th annual conference on computer graphics and interactive techniques, pp 359–364

  • Vanacken L, Grossman T, Coninx K (2007) Exploring the effects of environment density and target visibility on object selection in 3d virtual environments. In: 2007 IEEE symposium on 3D user interfaces. IEEE

  • Wehden L-O, Reer F, Janzik R, Tang WY, Quandt T (2021) The slippery path to total presence: How omnidirectional virtual reality treadmills influence the gaming experience. Media Commun 9(1):5–16

    Article  Google Scholar 

  • Wendt JD, Whitton MC, Brooks JFP (2010) Tgud wip: Gait-understanding-driven walking-in-place. IEEE Virtual Reality 2010:51–58

    Google Scholar 

  • Wobbrock J.O, Kay M (2016) Nonparametric statistics in human–computer interaction. In: Modern statistical methods for HCI, pp 135–170

  • Wu H, Deng Y, Pan J, Han T, Hu Y, Huang K, Zhang XL (2021) User capabilities in eyes-free spatial target acquisition in immersive virtual reality environments. Appl Ergon 94:103400

    Article  Google Scholar 

  • Yan Y, Yu C, Ma X, Huang S, Iqbal H, Shi Y (2018) Eyes-free target acquisition in interaction space around the body for virtual reality. In: Proceedings of the 2018 CHI conference on human factors in computing systems, pp 1–13

  • Yao R, Heath T, Davies A, Forsyth T, Mitchell N, Hoberman P (2014) Oculus vr best practices guide. Oculus VR 4:27–35

    Google Scholar 

  • Yatani K, Truong KN (2009) An evaluation of stylus-based text entry methods on handheld devices studied in different user mobility states. Pervasive Mob Comput 5(5):496–508

    Article  Google Scholar 

  • Yu D, Zhou Q, Newn J, Dingler T, Velloso E, Goncalves J (2020) Fully-occluded target selection in virtual reality. IEEE Trans Visual Comput Graphics 26(12):3402–3413

    Article  Google Scholar 

  • Zhou Q, Yu D, Reinoso MN, Newn J, Goncalves J, Velloso E (2020) Eyes-free target acquisition during walking in immersive mixed reality. IEEE Trans Visual Comput Graphics 26(12):3423–3433

    Article  Google Scholar 

Download references

Funding

This work was supported by the National Science Foundation of China (61902147), Natural Science Foundation of Guangdong Province (2021A1515012629), and Guangzhou Basic and Applied Basic Foundation (202102021131).

Author information

Authors and Affiliations

  1. Department of Computer Science and Information Technology, La Trobe University, Plenty Rd & Kingsbury Dr, 3086, Melbourne, VIC, Australia

    Yujun Lu, Huawei Tu, Hui Cui & Henry Been-Lirn Duh

  2. College of Information Science and Technology/Cyber Security, Guangdong Institute of Smart Education, Jinan University, No.601 West Huangpu Avenue, Guangzhou, 510632, Guangdong, China

    BoYu Gao, Weiqiang Xin & Weiqi Luo

  3. School of Communication and Design, Sun Yat-sen University, No.132, Waihuan Donglu, Guangzhou, 510006, Guangdong, China

    Huiyue Wu

Authors
  1. Yujun Lu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. BoYu Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Huawei Tu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Huiyue Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Weiqiang Xin
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Hui Cui
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Weiqi Luo
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Henry Been-Lirn Duh
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to BoYu Gao or Huawei Tu.

Ethics declarations

Consent to participant

Participants were treated strictly in accordance with the National Statement on Ethical Conduct in Research Involving Humans. Written informed consent was obtained by all participants at the start of the first session.

Consent for publication

Participants were informed that the results would be published in a way that their information could not be revealed.

Ethical approval

Ethics approval was obtained from the Jinan University Ethics Committee prior to commencing the study.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lu, Y., Gao, B., Tu, H. et al. Effects of physical walking on eyes-engaged target selection with ray-casting pointing in virtual reality. Virtual Reality 27, 603–625 (2023). https://doi.org/10.1007/s10055-022-00677-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10055-022-00677-9

Keywords

Search

Navigation