Skip to main content
SpringerLink
Log in

An experimental investigation of menu selection for immersive virtual environments: fixed versus handheld menus

  • Original Article
  • Published:
Virtual Reality Aims and scope Submit manuscript

Abstract

With the development of consumer-grade virtual reality (VR) systems, the interface and interaction design for immersive virtual environments have become a critical issue for VR application designers and developers. The previous design experience from conventional VR applications may not be effective anymore. This work investigated two types of menu interfaces (fixed menu and handheld menu) and three selection techniques, hand pointing with button press (Hand-BP), head pointing with button press (Head-BP), and head pointing with dwell (Head-DW), based on performance and subjective assessment. Results showed that the best performing selection technique for fixed menu was Hand-BP, while Head-BP was the most suitable and preferred selection technique for handheld menu. The limitations of different menu interfaces and selection techniques were discussed, and solutions were proposed to overcome the limitations that were found in the experiment. Based on the findings of this study, design guidelines were provided to help designers and developers choose the right menu interface and selection technique for different contexts of use and user groups.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  • Argelaguet F, Andujar C (2013) A survey of 3d object selection techniques for virtual environments. Comput Graph 37(3):121–136. https://doi.org/10.1016/j.cag.2012.12.003

    Article  Google Scholar 

  • Bowman DA, Hodges LF (1997) An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments. In: Proceedings of the 1997 Symposium on Interactive 3D Graphics, ACM, New York, NY, USA, I3D ’97, pp 35–ff. https://doi.org/10.1145/253284.253301,

  • Bowman DA, Wingrave CA (2001) Design and evaluation of menu systems for immersive virtual environments. In: Proceedings IEEE Virtual Reality 2001, pp 149–156. https://doi.org/10.1109/VR.2001.913781

  • Bowman DA, Hodges LF, Bolter J (1998) The virtual venue: User-computer interaction in information-rich virtual environments. Presence 7(5):478–493. https://doi.org/10.1162/105474698565866

    Article  Google Scholar 

  • Bowman DA, Johnson DB, Hodges LF (1999) Testbed evaluation of virtual environment interaction techniques. In: Proceedings of the ACM Symposium on Virtual Reality Software and Technology, ACM, New York, NY, USA, VRST ’99, pp 26–33. https://doi.org/10.1145/323663.323667

  • Bowman DA, Kruijff E, LaViola JJ, Poupyrev I (2004) 3D user interfaces: theory and practice. Addison Wesley Longman Publishing Co. Inc., Redwood City

    Google Scholar 

  • Choe M, Choi Y, Park J, Kim HK (2019) Comparison of gaze cursor input methods for virtual reality devices. Int J Hum Comput Interact 35(7):620–629. https://doi.org/10.1080/10447318.2018.1484054

    Article  Google Scholar 

  • Fang YM, Lin C (2019) The Usability Testing of VR Interface for Tourism Apps. Appl Sci Basel. https://doi.org/10.3390/app9163215

    Article  Google Scholar 

  • Figueiredo L, Rodrigues E, Teixeira J, Teichrieb V (2018) A comparative evaluation of direct hand and wand interactions on consumer devices. Computers and Graphics-UK 77:108–121, https://doi.org/10.1016/j.cag.2018.10.006, Joint Conference on 17th Brazilian Symposium on Computer Games and Digital Entertainment (SBGames) / 31st Conference on Graphics, Patterns and Images (SIBGRAPI) / 20th Symposium on Virtual and Augmented Reality (SVR), Foz do Iguacu, BRAZIL, OCT 29-NOV 01, 2018

  • Gerber D, Bechmann D (2004) Design and evaluation of the ring menu in virtual environments. In: Immersive Projection Technologies IPT 2004, Ames, Iowa, USA, pp 149–156

  • Hand C (1997) A survey of 3d interaction techniques. Comput Graph Forum 16(5):269–281. https://doi.org/10.1111/1467-8659.00194

    Article  Google Scholar 

  • Harms P (2019) Automated usability evaluation of virtual reality applications. ACM Trans Comput Hum Interact. https://doi.org/10.1145/3301423

    Article  Google Scholar 

  • Hart SG, Staveland LE (1988) Development of nasa-tlx (task load index): Results of empirical and theoretical research. In: Hancock PA, Meshkati N (eds) Human Mental Workload, Advances in Psychology, vol 52, North-Holland, pp 139 – 183. https://doi.org/10.1016/S0166-4115(08)62386-9

  • Jacob RJK (1990) What you look at is what you get: Eye movement-based interaction techniques. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, New York, NY, USA, CHI ’90, pp 11–18. https://doi.org/10.1145/97243.97246

  • Jeong S, Jung ES, Im Y (2016) Ergonomic evaluation of interaction techniques and 3d menus for the practical design of 3d stereoscopic displays. Int J Ind Ergon 53:205–218. https://doi.org/10.1016/j.ergon.2016.01.001

    Article  Google Scholar 

  • Kytö M, Ens B, Piumsomboon T, Lee GA, Billinghurst M (2018) Pinpointing: Precise head- and eye-based target selection for augmented reality. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, ACM, New York, NY, USA, CHI ’18, pp 81:1–81:14. https://doi.org/10.1145/3173574.3173655

  • Lin CJ, Ho SH, Chen YJ (2015) An investigation of pointing postures in a 3d stereoscopic environment. Appl Ergon 48:154–163. https://doi.org/10.1016/j.apergo.2014.12.001

    Article  Google Scholar 

  • Lindeman RW, Sibert JL, Hahn JK (1999) Hand-held windows: towards effective 2d interaction in immersive virtual environments. In: Proceedings IEEE Virtual Reality (Cat. No. 99CB36316), pp 205–212. https://doi.org/10.1109/VR.1999.756952

  • Myers A, Hansen CH (2012) Experimental psychology, 7th edn. Wadsworth CENGAGE Learning, Belmont

    Google Scholar 

  • Pai YS, Dingler T, Kunze K (2019) Assessing hands-free interactions for vr using eye gaze and electromyography. Virtual Real 23(2):119–131. https://doi.org/10.1007/s10055-018-0371-2

    Article  Google Scholar 

  • Salomoni P, Prandi C, Roccetti M, Casanova L, Marchetti L, Marfia G (2017) Diegetic user interfaces for virtual environments with HMDs: a user experience study with oculus rift. J Multimodal User Interfaces 11(2):173–184. https://doi.org/10.1007/s12193-016-0236-5

    Article  Google Scholar 

  • Statista (2018) Share of virtual reality head-mounted display unit sales worldwide in 2016 and 2020. URL https://www.statista.com/statistics/697171/head-mounted-display-unit-sales-share-by-platform-worldwide/

  • Steed A (2006) Towards a general model for selection in virtual environments. In: 3D User Interfaces (3DUI’06), pp 103–110. https://doi.org/10.1109/VR.2006.134

  • Steed A, Parker C (2004) 3d selection strategies for head tracked and non-head tracked operation of spatially immersive displays. In: 8th International Immersive Projection Technology Workshop, pp 13–14

  • Wang Y, Khoo ET (2017) Real-time stereoscopic rendering of realistic avatar for interactive 3d telepresence system. In: 2017 2nd International Conference on Image, Vision and Computing (ICIVC), pp 577–581. https://doi.org/10.1109/ICIVC.2017.7984621

  • Wang Y, Dubey R, Magnenat-Thalmann N, Thalmann D (2013) An immersive multi-agent system for interactive applications. Vis Comput 29(5):323–332. https://doi.org/10.1007/s00371-012-0735-7

    Article  Google Scholar 

  • Wingrave CA, Bowman DA (2005) Baseline factors for raycasting selection. In: Proceedings of HCI International, pp 61–68

  • Wolf D, Gugenheimer J, Combosch M, Rukzio E (2020) Understanding the heisenberg effect of spatial interaction: A selection induced error for spatially tracked input devices. In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, Association for Computing Machinery, Honolulu, HI, USA, pp 1–10. https://doi.org/10.1145/3313831.3376876

  • Yan Y, Yu C, Ma X, Huang S, Iqbal H, Shi Y (2018) Eyes-free target acquisition in interaction space around the body for virtual reality. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, ACM, New York, NY, USA, CHI ’18, pp 42:1–42:13. https://doi.org/10.1145/3173574.3173616

Download references

Acknowledgements

The authors are grateful to the study participants for their contributions to the research. We also want to thank the anonymous reviewers for their valuable comments. This work was supported by the Fundamental Research Funds for the Central Universities of China (Project NO. 3082018NS2018034).

Author information

Authors and Affiliations

  1. Department of Industrial Design, Nanjing University of Aeronautics and Astronautics, Jiangsu, China

    Yanbin Wang, Yizhou Hu & Yu Chen

Authors
  1. Yanbin Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yizhou Hu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yu Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yanbin Wang.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (mp4 27036 KB)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, Y., Hu, Y. & Chen, Y. An experimental investigation of menu selection for immersive virtual environments: fixed versus handheld menus. Virtual Reality 25, 409–419 (2021). https://doi.org/10.1007/s10055-020-00464-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10055-020-00464-4

Keywords

Search

Navigation