skip to main content
10.1145/3385955.3407923acmconferencesArticle/Chapter ViewAbstractPublication PagessapConference Proceedingsconference-collections
research-article

Comparing Gamepad and Naturally-mapped Controller Effects on Perceived Virtual Reality Experiences

Published: 12 September 2020 Publication History

Abstract

A virtual reality (VR) system’s interface determines its corresponding interaction fidelity. While there exist several naturally-mapped interfaces, these have not been directly compared – in terms of presence, engagement, perceived performance, and real performance – to a more commonly-used interface for interacting with virtual reality: the gamepad. Because gamepads have evolved over several decades and have widespread adoption, it is pragmatic to ask whether it is viable to import them into the design of VR experiences. To study this, we developed a first-person shooter (FPS) Virtual environment and contrasted the VR experience using the Microsoft Xbox 360 controller against the HTC VIVE wand. We assessed the effect of the input device on self-reported presence, engagement, and performance as well as real performance in terms of accuracy and speed, two metrics relevant for our particular environment. A within-subjects FPS shooting task under accuracy and time constraints confirmed our hypotheses in favor of the VIVE wand: presence, engagement, perceived performance, and real performance were deemed significantly higher than the Xbox controller condition. These results are contextualized with participants‘ comments in a post-experiment debrief, in which (paradoxically) several participants reported preferring the gamepad. We discuss the implications of our findings and how what we call genre fidelity can impact the design of VR experiences.

References

[1]
Ernest Adams. 2014. Fundamentals of Game Design. Pearson Education.
[2]
Kevin W. Arthur, Kellogg S. Booth, and Colin Ware. 1993. Evaluating 3D Task Performance for Fish Tank Virtual Worlds. ACM Transactions on Information Systems 11, 3 (jan 1993), 239–265.
[3]
Ravin Balakrishnan, Thomas Baudel, Gordon Kurtenbach, and George Fitzmaurice. 1997. The Rockin’Mouse: Integral 3D Manipulation on a Plane. In Proc. CHI. ACM, 311–318.
[4]
Woodrow Barfield, Claudia Hendrix, and Karl Bystrom. 1997. Visualizing the structure of virtual objects using head tracked stereoscopic displays. In Proc. VR. IEEE, Piscataway, NJ, USA, 114–120.
[5]
Cheryl Campanella Bracken and Paul Skalski. 2010. Immersed in media: Telepresence in everyday life. Routledge.
[6]
Michael Brown, Aidan Kehoe, Jurek Kirakowski, and Ian Pitt. 2010. Beyond the Gamepad: HCI and Game Controller Design and Evaluation. In Evaluating User Experience in Games, Regina Bernhaupt (Ed.). Springer, 209–219.
[7]
Fabio Buttussi and Luca Chittaro. 2018. Effects of Different Types of Virtual Reality Display on Presence and Learning in a Safety Training Scenario. IEEE Transactions on Visualization and Computer Graphics 24, 2(2018), 1063–1076.
[8]
Sarah S. Chance, Florence Gaunet, Andrew C. Beall, and Jack M. Loomis. 1998. Locomotion Mode Affects the Updating of Objects Encountered During Travel: The Contribution of Vestibular and Proprioceptive Inputs to Path Integration. Presence: Teleoperators and Virtual Environments 7, 2 (apr 1998), 168–178.
[9]
James C. Chung. 1992. A comparison of head-tracked and non-head-tracked steering modes in the targeting of radiotherapy treatment beams. In Proc. I3D. ACM, New York, NY, USA, 193–196.
[10]
Jacob Cohen. 1988. Statistical Power Analysis for the Behavioral Sciences (2nd ed.). Erlbaum Associates, Hillsdale, Routledge.
[11]
Jacob Cohen. 1992. A Power Primer. Psychological Bulletin 112, 1 (1992), 155–159.
[12]
Alastair H. Cummings. 2007. The Evolution of Game Controllers and Control Schemes and their Effect on their Games. In Proc. of the 17th Annual University of Southampton Multimedia Systems Conference.
[13]
James J Cummings and Jeremy N Bailenson. 2016. How immersive is enough? A meta-analysis of the effect of immersive technology on user presence. Media Psychology 19, 2 (2016), 272–309.
[14]
Yasin Farmani and Robert J Teather. 2017. Player performance with different input devices in virtual reality first-person shooter games. In Proceedings of the 5th symposium on spatial user interaction. ACM, 165–165.
[15]
Richard M. Heiberger and Naomi B. Robbins. 2014. Design of Diverging Stacked Bar Charts for Likert Scales and Other Applications. Journal of Statistical Software 57, 5 (2014), 1–32.
[16]
Edgar Heineken and Frank P. Schulte. 2007. Seeing Size and Feeling Weight: The Size-Weight Illusion in Natural and Virtual Reality. Human Factors 49, 1 (2007), 136–144.
[17]
Ken Hinckley, Joe Tullio, Randy Pausch, Dennis Proffitt, and Neal Kassell. 1997. Usability Analysis of 3D Rotation Techniques. In Proc. UIST. ACM, New York, NY, USA, 1–10.
[18]
Kwanguk Kim, M. Zachary Rosenthal, David J. Zielinski, and Rachael Brady. 2014. Effects of virtual environment platforms on emotional responses. Computer Methods and Programs in Biomedicine 113, 3 (mar 2014), 882–893.
[19]
Silvia Erika Kober, Jürgen Kurzmann, and Christa Neuper. 2012. Cortical correlate of spatial presence in 2D and 3D interactive virtual reality: An EEG study. International Journal of Psychophysiology 83, 3 (mar 2012), 365–374.
[20]
Mathias Kölsch, Andrew C. Beall, and Matthew Turk. 2003. An Objective Measure for Postural Comfort. In Proc. HFES. 725–728.
[21]
Joseph J. LaViola, Jr. and Tad Litwiller. 2011. Evaluating the Benefits of 3D Stereo in Modern Video Games. In Proc. CHI. ACM, New York, NY, USA, 2345–2354.
[22]
Jean-Luc Lugrin, Marc Cavazza, Fred Charles, Marc Le Renard, Jonathan Freeman, and Jane Lessiter. 2013. Immersive FPS Games: User Experience and Performance. In Proc. ImmersiveMe. ACM, New York, NY, USA, 7–12.
[23]
Mitchell W. McEwan, Alethea L. Blackler, Daniel M. Johnson, and Peta A. Wyeth. 2014. Natural mapping and intuitive interaction in videogames. In Proc. CHIPlay. ACM, New York, NY, USA, 191–200.
[24]
Ryan P. McMahan, Doug A. Bowman, David J. Zielinski, and Rachael B. Brady. 2012. Evaluating Display Fidelity and Interaction Fidelity in a Virtual Reality Game. IEEE Transactions on Visualization and Computer Graphics 18, 4 (apr 2012), 626–633.
[25]
Michael Narayan, Leo Waugh, Xiaoyu Zhang, Pradyut Bafna, and Doug Bowman. 2005. Quantifying the Benefits of Immersion for Collaboration in Virtual Environments. In Proc. VRST. ACM, New York, NY, USA, 78–81.
[26]
Kevin Ng. [n.d.]. ‘First-Person Control Design for Dual Analog Stick Controllers’. Gamasutra Article. 14-Jul-2004 [Online] Available: http://www.gamasutra.com/view/feature/2119/firstperson_control_design_for_.php[Accessed: 23-Nov-2018].
[27]
Donald A. Norman. 1999. Affordance, Conventions, and Design. Interactions 6, 3 (may/jun 1999), 38–43.
[28]
Michael Pereira, Ferran Argelaguet, José del R Millán, and Anatole Lécuyer. 2018. Novice shooters with lower pre-shooting alpha power have better performance during competition in a virtual reality scenario. Frontiers in psychology 9 (2018), 527.
[29]
John Polson. [n.d.]. First-person shooter design: What to save, and what to frag. Gamasutra Article. 22-May-2012 [Online] Available: https://www.gamasutra.com/view/news/170721/Firstperson_shooter_design_What_to_save_and_what_to_frag.php[Accessed: 23-Nov-2018].
[30]
Eric D. Ragan, Doug A. Bowman, Regis Kopper, Cheryl Stinson, Siroberto Scerbo, and Ryan P. McMahan. 2015. Effects of field of view and visual complexity on virtual reality training effectiveness for a visual scanning task. IEEE Transactions on Visualization and Computer Graphics 21, 7 (feb 2015), 794–807.
[31]
Dheva Raja. 2006. The Effects of Immersion on 3D Information Visualization. Ph.D. Dissertation. Virginia Polytechnic Institute and State University.
[32]
Robert Rosenthal. 1994. Parametric Measures of Effect Size. In The Handbook of Research Synthesis, Harris Cooper and Larry V. Hedges (Eds.). Russell Sage Foundation, 231–244.
[33]
Johann Schmitt, Carolin Wienrich, Marc Erich Latoschik, and Jean-Luc Lugrin. 2019. Investigating Gesture-based Commands for First-Person Shooter Games in Virtual Reality. Mensch und Computer 2019-Workshopband(2019).
[34]
Thomas Schubert, Frank Friedmann, and Holger Regenbrecht. 2001. The Experience of Presence: Factor Analytic Insights. Presence: Teleoperators and Virtual Environments 10, 3 (jun 2001), 266–281.
[35]
Paul Skalski, Ron Tamborini, Ashleigh Shelton, Michael Buncher, and Pete Lindmark. 2011. Mapping the road to fun: Natural video game controllers, presence, and game enjoyment. New Media & Society 13, 2 (2011), 224–242.
[36]
Mel Slater and Martin Usoh. 1994. Body Centred Interaction in Immersive Virtual Environments. In Artificial Life and Virtual Reality, Nadia Magnenat Thalmann and Daniel Thalmann (Eds.). John Wiley and Sons Ltd., 125–148.
[37]
Marco Torchiano. 2016. Effsize - a package for efficient effect size computation. https://doi.org/10.5281/zenodo.196082
[38]
Martin Usoh, Kevin Arthur, Mary C. Whitton, Rui Bastos, Anthony Steed, Mel Slater, and Frederick P. Brooks Jr. 1999. Walking  >  Walking-in-Place  >  Flying, in Virtual Environments. In Proc. SIGGRAPH. ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 359–364.
[39]
Colin Ware, Kevin Arthur, and Kellogg S. Booth. 1993. Fish Tank Virtual Reality. In Proc. CHI/INTERACT. ACM, New York, NY, USA, 37–42.
[40]
Colin Ware and Ravin Balakrishnan. 1994. Reaching for Objects in VR Displays: Lag and Frame Rate. ACM Transactions on Computer-Human Interaction 1, 4 (dec 1994), 331–356.
[41]
Colin Ware and Glenn Franck. 1996. Evaluating Stereo and Motion Cues for Visualizing Information Nets in Three Dimensions. ACM Transactions on Graphics 15, 2 (apr 1996), 121–140.
[42]
Catherine A. Zanbaka, Benjamin C. Lok, Sabarish V. Babu, Amy C. Ulinski, and Larry F. Hodges. 2005. Comparison of path visualizations and cognitive measures relative to travel technique in a virtual environment. IEEE Transactions on Visualization and Computer Graphics 11, 6 (nov/dec 2005), 694–705.
[43]
Shumin Zhai, Paul Milgram, and William Buxton. 1996. The Influence of Muscle Groups on Performance of Multiple Degree-of-Freedom Input. In Proc. CHI. ACM, New York, NY, USA, 308–315.
[44]
David Zielinski, Brendan Macdonald, and Regis Kopper. 2014. Comparative study of input devices for a VR mine simulation. In 2014 IEEE Virtual Reality (VR). IEEE, 125–126.

Cited By

View all
  • (2024)Hands or Controllers? How Input Devices and Audio Impact Collaborative Virtual RealityProceedings of the 30th ACM Symposium on Virtual Reality Software and Technology10.1145/3641825.3687718(1-12)Online publication date: 9-Oct-2024
  • (2024)CamTroller: An Auxiliary Tool for Controlling Your Avatar in PC Games Using Natural Motion MappingProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642511(1-17)Online publication date: 11-May-2024
  • (2024)Effects of Device Environment and Information Layout on Spatial Memory and Performance in VR Selection TasksProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642486(1-17)Online publication date: 11-May-2024
  • Show More Cited By

Index Terms

  1. Comparing Gamepad and Naturally-mapped Controller Effects on Perceived Virtual Reality Experiences
          Index terms have been assigned to the content through auto-classification.

          Recommendations

          Comments

          Information & Contributors

          Information

          Published In

          cover image ACM Conferences
          SAP '20: ACM Symposium on Applied Perception 2020
          September 2020
          137 pages
          ISBN:9781450376181
          DOI:10.1145/3385955
          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Sponsors

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          Published: 12 September 2020

          Permissions

          Request permissions for this article.

          Check for updates

          Author Tags

          1. genre fidelity
          2. interaction fidelity
          3. naturally-mapped interface
          4. virtual reality

          Qualifiers

          • Research-article
          • Research
          • Refereed limited

          Conference

          SAP '20
          Sponsor:
          SAP '20: ACM Symposium on Applied Perception 2020
          September 12 - 13, 2020
          Virtual Event, USA

          Acceptance Rates

          Overall Acceptance Rate 43 of 94 submissions, 46%

          Contributors

          Other Metrics

          Bibliometrics & Citations

          Bibliometrics

          Article Metrics

          • Downloads (Last 12 months)85
          • Downloads (Last 6 weeks)6
          Reflects downloads up to 14 Feb 2025

          Other Metrics

          Citations

          Cited By

          View all
          • (2024)Hands or Controllers? How Input Devices and Audio Impact Collaborative Virtual RealityProceedings of the 30th ACM Symposium on Virtual Reality Software and Technology10.1145/3641825.3687718(1-12)Online publication date: 9-Oct-2024
          • (2024)CamTroller: An Auxiliary Tool for Controlling Your Avatar in PC Games Using Natural Motion MappingProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642511(1-17)Online publication date: 11-May-2024
          • (2024)Effects of Device Environment and Information Layout on Spatial Memory and Performance in VR Selection TasksProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642486(1-17)Online publication date: 11-May-2024
          • (2024)Comparing Control Schemas in Isometric Balanced-based Controllers2024 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct64951.2024.00031(102-109)Online publication date: 21-Oct-2024
          • (2024)Options Matter: Exploring VR Input Fatigue ReductionITNG 2024: 21st International Conference on Information Technology-New Generations10.1007/978-3-031-56599-1_37(281-287)Online publication date: 11-Mar-2024
          • (2023)The Effects of Hand Representation on Experience and Performance for 3D Interactions in Virtual Reality GamesProceedings of the ACM on Human-Computer Interaction10.1145/36110667:CHI PLAY(1206-1233)Online publication date: 4-Oct-2023
          • (2023)A Comparative Study on Optimizing Virtual Reality Experience through User Representations in Industry2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct60411.2023.00042(175-182)Online publication date: 16-Oct-2023
          • (2022)Virtual Reality User-Scene Interaction:Head-Rotation versus Joystick Movements2022 IEEE International Conference on Metrology for Extended Reality, Artificial Intelligence and Neural Engineering (MetroXRAINE)10.1109/MetroXRAINE54828.2022.9967622(93-98)Online publication date: 26-Oct-2022
          • (2022)The right tools for the job: towards preference and performance considerations in the design of virtual reality interactionsBehaviour & Information Technology10.1080/0144929X.2022.212583142:3(278-288)Online publication date: 20-Sep-2022
          • (2022)Exploring Chemical Reactions in Virtual RealityJournal of Chemical Education10.1021/acs.jchemed.1c0104099:4(1635-1641)Online publication date: 9-Feb-2022
          • Show More Cited By

          View Options

          Login options

          View options

          PDF

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader

          HTML Format

          View this article in HTML Format.

          HTML Format

          Figures

          Tables

          Media

          Share

          Share

          Share this Publication link

          Share on social media