Huawei Tu
ABSTRACT
This paper presents the first investigation into using the goal-crossing paradigm for object selection with virtual reality (VR) head-mounted displays. Two experiments were carried out to evaluate ray-casting crossing tasks with target discs in 3D space and goal lines on 2D plane respectively in comparison to ray-casting pointing tasks. Five factors, i.e. task difficulty, the direction of movement constraint (collinear vs. orthogonal), the nature of the task (discrete vs. continuous), field of view of VR devices and target depth, were considered in both experiments. Our findings are: (1) crossing generally had shorter or no longer time, and higher or similar accuracy than pointing, indicating crossing can complement or substitute pointing; (2) crossing tasks can be well modelled with Fitts' Law; (3) crossing performance depended on target depth; (4) crossing target discs in 3D space differed from crossing goal lines on 2D plane in many aspects such as time and error performance, the effects of target depth and the parameters of Fitts' models. Based on these findings, we formulate a number of design recommendations for crossing-based interaction in VR.
Supplemental Material
- Johnny Accot and Shumin Zhai. 1997. Beyond Fitts' Law: Models for Trajectory-based HCI Tasks. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI'97). ACM, New York, NY, USA, 295--302. Google Scholar
Digital Library
- Johnny Accot and Shumin Zhai. 2002. More Than Dotting the I's - Foundations for Crossing-based Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'02). ACM, New York, NY, USA, 73--80. Google ScholarDigital Library
- Georg Apitz and François Guimbretière. 2004. CrossY: A Crossingbased Drawing Application. In Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology (UIST'04). ACM, New York, NY, USA, 3--12. Google ScholarDigital Library
- Georg Apitz, François Guimbretière, and Shumin Zhai. 2008. Foundations for Designing and Evaluating User Interfaces Based on the Crossing Paradigm. ACM Trans. Comput.-Hum. Interact. 17, 2, Article 9 (May 2008), 42 pages. Google ScholarDigital Library
- Ferran Argelaguet and Carlos Andujar. 2009. Efficient 3D pointing selection in cluttered virtual environments. IEEE Computer Graphics and Applications 29, 6 (2009), 34--43.Google ScholarCross Ref
- Ferran Argelaguet and Carlos Andujar. 2013. A survey of 3D object selection techniques for virtual environments. Computers & Graphics 37, 3 (2013), 121--136. Google ScholarDigital Library
- Xiaojun Bi, Yang Li, and Shumin Zhai. 2013. FFitts Law: Modeling Finger Touch with Fitts' Law. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 1363--1372. Google ScholarDigital Library
- Binocular visual field of humans 2018. Peripheral vision - Wikipedia. https://en.wikipedia.org/wiki/Peripheral_vision, note = Accessed: Auguest 2018,.Google Scholar
- Doug Bowman, Chadwick Wingrave, Joshua Campbell, and Vinh Ly. 2001. Using pinch gloves (tm) for both natural and abstract interaction techniques in virtual environments. Technical Report TR-01--23, Computer Science, Virginia Tech. (2001).Google Scholar
- Doug A Bowman, Donald B Johnson, and Larry F Hodges. 2001. Testbed evaluation of virtual environment interaction techniques. Presence: Teleoperators & Virtual Environments 10, 1 (2001), 75--95. Google ScholarDigital Library
- Doug A Bowman and Chadwick A Wingrave. 2001. Design and evaluation of menu systems for immersive virtual environments. In Proceedings of Virtual Reality. IEEE, 149--156. Google ScholarDigital Library
- Nathan Cournia, John D. Smith, and Andrew T. Duchowski. 2003. Gazevs. Hand-based Pointing in Virtual Environments. In CHI '03 Extended Abstracts on Human Factors in Computing Systems (CHI EA '03). ACM, New York, NY, USA, 772--773. Google ScholarDigital Library
- Raimund Dachselt and Anett Hübner. 2007. Three-dimensional menus: A survey and taxonomy. Computers & Graphics 31, 1 (2007), 53--65. Google ScholarDigital Library
- Kaushik Das and Christoph W Borst. 2010. An evaluation of menu properties and pointing techniques in a projection-based VR environment. In 3D User Interfaces (3DUI), 2010 IEEE Symposium on. IEEE, 47--50. Google ScholarDigital Library
- Morgan Dixon, François Guimbretière, and Nicholas Chen. 2008. Optimal Parameters for Efficient Crossing-based Dialog Boxes. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'08). ACM, New York, NY, USA, 1623--1632. Google ScholarDigital Library
- Sarah A. Douglas, Arthur E. Kirkpatrick, and I. Scott MacKenzie. 1999. Testing Pointing Device Performance and User Assessment with the ISO 9241, Part 9 Standard. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'99). ACM, New York, NY, USA, 215--222. Google ScholarDigital Library
- Pierre Dragicevic. 2004. Combining Crossing-based and Paper-based Interaction Paradigms for Dragging and Dropping Between Overlapping Windows. In Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology (UIST'04). ACM, New York, NY, USA, 193--196. Google ScholarDigital Library
- Paul M Fitts. 1954. The information capacity of the human motor system in controlling the amplitude of movement. Journal of experimental psychology 47, 6 (1954), 381.Google ScholarCross Ref
- Clifton Forlines and Ravin Balakrishnan. 2008. Evaluating Tactile Feedback and Direct vs. Indirect Stylus Input in Pointing and Crossing Selection Tasks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'08). ACM, New York, NY, USA, 1563--1572. Google ScholarDigital Library
- Andrew Forsberg, Kenneth Herndon, and Robert Zeleznik. 1996. Aperture Based Selection for Immersive Virtual Environments. In Proceedings of the 9th Annual ACM Symposium on User Interface Software and Technology (UIST'96). ACM, New York, NY, USA, 95--96. Google ScholarDigital Library
- Tovi Grossman and Ravin Balakrishnan. 2004. Pointing at Trivariate Targets in 3D Environments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'04). ACM, New York, NY, USA, 447--454. Google ScholarDigital Library
- Tovi Grossman and Ravin Balakrishnan. 2006. The Design and Evaluation of Selection Techniques for 3D Volumetric Displays. In Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology (UIST'06). ACM, New York, NY, USA, 3--12. Google ScholarDigital Library
- Gerwin Haan, Michal Koutek, and Frits H Post. 2005. IntenSelect: Using Dynamic Object Rating for Assisting 3D Object Selection. In IPT/EGVE. Citeseer, 201--209. Google ScholarDigital Library
- Kenneth P. Herndon, Andries van Dam, and Michael Gleicher. 1994. The Challenges of 3D Interaction: A CHI '94 Workshop. SIGCHI Bull. CHI 2019, May 4--9, 2019, Glasgow, Scotland UK H. Tu et al. 26, 4 (Oct. 1994), 36--43. Google ScholarDigital Library
- Richard H Jacoby and Stephen R Ellis. 1992. Using virtual menus in a virtual environment. In Visual Data Interpretation, Vol. 1668. International Society for Optics and Photonics, 39--49.Google ScholarCross Ref
- J Adam Jones, J Edward Swan, and Mark Bolas. 2013. Peripheral stimulation and its effect on perceived spatial scale in virtual environments. IEEE Transactions on Visualization & Computer Graphics 4 (2013), 701--710. Google ScholarDigital Library
- Kreylos, O. 2018. Optical Properties of Current VR HMDs. http://doc-ok.org/?p=1414, note = Accessed: Auguest 2018,.Google Scholar
- JJ-W Lin, Henry Been-Lirn Duh, Donald E Parker, Habib Abi-Rached, and Thomas A Furness. 2002. Effects of field of view on presence, enjoyment, memory, and simulator sickness in a virtual environment. In Virtual Reality, 2002. Proceedings. IEEE. IEEE, 164--171. Google ScholarDigital Library
- Yuexing Luo and Daniel Vogel. 2014. Crossing-based Selection with Direct Touch Input. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'14). ACM, New York, NY, USA, 2627--2636. Google ScholarDigital Library
- Yuexing Luo and Daniel Vogel. 2015. Pin-and-Cross: A Unimanual Multitouch Technique Combining Static Touches with Crossing Selection. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST'15). ACM, New York, NY, USA, 323--332. Google ScholarDigital Library
- I Scott MacKenzie. 1992. Fitts' law as a research and design tool in human-computer interaction. Human-computer interaction 7, 1 (1992), 91--139. Google ScholarDigital Library
- I. Scott MacKenzie and William Buxton. 1992. Extending Fitts' Law to Two-dimensional Tasks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'92). ACM, New York, NY, USA, 219--226. Google ScholarDigital Library
- Mark R. Mine. 1995. Virtual Environment Interaction Techniques. Technical Report. Chapel Hill, NC, USA. Google Scholar
- Peter Mitchell and Brett Wilkinson. 2016. Periphery Triggered Menus for Head Mounted Menu Interface Interactions. In Proceedings of the 28th Australian Conference on Computer-Human Interaction (OzCHI'16). ACM, New York, NY, USA, 30--33. Google ScholarDigital Library
- Abdeldjallil Naceri, Ryad Chellali, and Thierry Hoinville. 2011. Depth perception within peripersonal space using head-mounted display. Presence: Teleoperators and Virtual Environments 20, 3 (2011), 254--272. Google ScholarDigital Library
- Takashi Nakamura, Shin Takahashi, and Jiro Tanaka. 2008. DoubleCrossing: A New Interaction Technique for Hand Gesture Interfaces. In Proceedings of the 8th Asia-Pacific Conference on Computer-Human Interaction (APCHI'08). Springer-Verlag, Berlin, Heidelberg, 292--300. Google ScholarDigital Library
- Oculus Rift CV1 2018. Oculus Rift - Wikipedia. https://en.wikipedia. org/wiki/Oculus_Rift, note = Accessed: Auguest 2018,.Google Scholar
- Jeffrey S. Pierce, Andrew S. Forsberg, Matthew J. Conway, Seung Hong, Robert C. Zeleznik, and Mark R. Mine. 1997. Image Plane Interaction Techniques in 3D Immersive Environments. In Proceedings of the 1997 Symposium on Interactive 3D Graphics (I3D '97). ACM, New York, NY, USA, 39--43. Google ScholarDigital Library
- Ivan Poupyrev, Mark Billinghurst, Suzanne Weghorst, and Tadao Ichikawa. 1996. The Go-go Interaction Technique: Non-linear Mapping for Direct Manipulation in VR. In Proceedings of the 9th Annual ACM Symposium on User Interface Software and Technology (UIST '96). ACM, New York, NY, USA, 79--80. Google ScholarDigital Library
- Adrian Ramcharitar and Robert J. Teather. 2018. EZCursorVR: 2D Selection with Virtual Reality Head-Mounted Displays. In Proceedings of the Graphics Interface Conference 2018 (GI'18). ACM.Google Scholar
- Rebekka S. Renner, Boris M. Velichkovsky, and Jens R. Helmert. 2013. The Perception of Egocentric Distances in Virtual Environments - A Review. ACM Comput. Surv. 46, 2, Article 23 (Dec. 2013), 40 pages. Google ScholarDigital Library
- Frank Steinicke, Timo Ropinski, and Klaus Hinrichs. 2006. Object selection in virtual environments using an improved virtual pointer metaphor. In Computer Vision and Graphics. Springer, 320--326.Google Scholar
- Wolfgang Stuerzlinger and Robert J. Teather. 2014. Considerations for Targets in 3D Pointing Experiments. In Proceedings of HCI Korea (HCIK '15). Hanbit Media, Inc., South Korea, 162--168. Google ScholarDigital Library
- Ahmed N. Sulaiman and Patrick Olivier. 2008. Attribute Gates. In Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology (UIST '08). ACM, New York, NY, USA, 57--66. Google ScholarDigital Library
- Robert J Teather and Wolfgang Stuerzlinger. 2011. Pointing at 3D targets in a stereo head-tracked virtual environment. In 3D User Interfaces (3DUI), 2011 IEEE Symposium on. IEEE, 87--94. Google ScholarDigital Library
- Robert J. Teather and Wolfgang Stuerzlinger. 2013. Pointing at 3D Target Projections with One-eyed and Stereo Cursors. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 159--168. Google ScholarDigital Library
- Lode Vanacken, Tovi Grossman, and Karin Coninx. 2007. Exploring the effects of environment density and target visibility on object selection in 3D virtual environments. In IEEE Symposium on 3D User Interfaces. IEEE, 115--122.Google ScholarCross Ref
- Colin Ware and Kathy Lowther. 1997. Selection Using a One-eyed Cursor in a Fish Tank VR Environment. ACM Trans. Comput.-Hum. Interact. 4, 4 (Dec. 1997), 309--322. Google ScholarDigital Library
- Christopher D Wickens. 1991. Processing resources and attention. Multiple-task performance 1991 (1991), 3--34.Google Scholar
- C Wingrave and D Bowman. 2005. Baseline factors for raycasting selection. In Proceedings of HCI International. Citeseer.Google Scholar
- Jacob O. Wobbrock and Krzysztof Z. Gajos. 2008. Goal Crossing with Mice and Trackballs for People with Motor Impairments: Performance, Submovements, and Design Directions. ACM Trans. Access. Comput. 1, 1, Article 4 (May 2008), 37 pages. Google ScholarDigital Library
- Robert Xiao and Hrvoje Benko. 2016. Augmenting the Field-of-View of Head-Mounted Displays with Sparse Peripheral Displays. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI'16). ACM, New York, NY, USA, 1221--1232. Google ScholarDigital Library
- Richard Yao, Tom Heath, Aaron Davies, Tom Forsyth, Nate Mitchell, and Perry Hoberman. 2014. Oculus vr best practices guide. Oculus VR 4 (2014).Google Scholar
- Takuto Yoshikawa, Buntarou Shizuki, and Jiro Tanaka. 2012. HandyWidgets: Local Widgets Pulled-out from Hands. In Proceedings of the 2012 ACM International Conference on Interactive Tabletops and Surfaces (ITS'12). ACM, New York, NY, USA, 197--200. Google ScholarDigital Library
- Shumin Zhai, William Buxton, and Paul Milgram. 1994. The "Silk Cursor": Investigating Transparency for 3D Target Acquisition. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'94). ACM, New York, NY, USA, 459--464. Google ScholarDigital Library
Index Terms
- Crossing-Based Selection with Virtual Reality Head-Mounted Displays
Recommendations
An Exploration of Freehand Crossing Selection in Head-Mounted Augmented Reality
Crossing, or goal crossing, has proven useful in various selection scenarios, including pen, mouse, touch, and virtual reality (VR). However, crossing has not been exploited for freehand selection using augmented reality head-mounted displays (AR HMDs). ...
Estimation of virtual interpupillary distances for immersive head-mounted displays
APGV '10: Proceedings of the 7th Symposium on Applied Perception in Graphics and VisualizationHead-mounted displays (HMDs) allow users to observe virtual environments (VEs) from an egocentric perspective. In order to present a realistic stereoscopic view, the rendering system has to be adjusted to the characteristics of the HMD, e. g., the ...
Natural Perspective Projections for Head-Mounted Displays
The display units integrated in today's head-mounted displays (HMDs) provide only a limited field of view (FOV) to the virtual world. In order to present an undistorted view to the virtual environment (VE), the perspective projection used to render the ...
Comments