Ryo Ishibashi
ABSTRACT
When manipulating virtual objects in AR space, the target object is often occluded by other objects partially or completely (hereinafter, occlusion problem). In addition, the hand-ray manipulation that is commonly used in many AR devices requires the user to keep raising the arm within the range of the hand tracking sensor and causes the gorilla-arm problem. In this study, we propose an object manipulation method that combines eye gaze and a hand-held controller to mitigate the occlusion problem and gorilla-arm problem in AR environments. In the proposed method, the user controls the ray’s direction with eye gaze, and the user adjusts the length of the ray and selects objects with the hand-held controller.
Supplemental Material
- Marc Baloup, Thomas Pietrzak, and Géry Casiez. 2019. RayCursor: A 3D Pointing Facilitation Technique Based on Raycasting. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300331Google Scholar
Digital Library
- Juan David Hincapié-Ramos, Xiang Guo, Paymahn Moghadasian, and Pourang Irani. 2014. Consumed Endurance: A Metric to Quantify Arm Fatigue of Mid-Air Interactions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI ’14). Association for Computing Machinery, New York, NY, USA, 1063–1072. https://doi.org/10.1145/2556288.2557130Google ScholarDigital Library
- Robert J. K. Jacob. 1990. What You Look at is What You Get: Eye Movement-Based Interaction Techniques. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Seattle, Washington, USA) (CHI ’90). Association for Computing Machinery, New York, NY, USA, 11–18. https://doi.org/10.1145/97243.97246Google ScholarDigital Library
- Regis Kopper, Felipe Bacim, and Doug A. Bowman. 2011. Rapid and accurate 3D selection by progressive refinement. In 2011 IEEE Symposium on 3D User Interfaces (3DUI). 67–74. https://doi.org/10.1109/3DUI.2011.5759219Google ScholarCross Ref
- Microsoft Corporation. 2022. Microsoft HoloLens | Mixed Reality Technology for Business. https://www.microsoft.com/en-us/hololens. (Accessed on 08/21/2022).Google Scholar
- Microsoft Corporation. 2022. MRTK2 Unity Developer Documentation - MRTK 2 | Microsoft Docs. https://docs.microsoft.com/en-us/windows/mixed-reality/mrtk-unity/mrtk2/?view=mrtkunity-2022-05. (Accessed on 08/21/2022).Google Scholar
- Nintendo Co., Ltd.2022. Joy-Con & controllers. https://www.nintendo.com/store/hardware/joy-con-and-controllers/. (Accessed on 08/21/2022).Google Scholar
- Ludwig Sidenmark, Christopher Clarke, Xuesong Zhang, Jenny Phu, and Hans Gellersen. 2020. Outline Pursuits: Gaze-Assisted Selection of Occluded Objects in Virtual Reality. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376438Google ScholarDigital Library
- Unity Technologies. 2022. Unity Real-Time Development Platform | 3D, 2D VR & AR Engine. https://unity.com/. (Accessed on 08/21/2022).Google Scholar
- Difeng Yu, Qiushi Zhou, Joshua Newn, Tilman Dingler, Eduardo Velloso, and Jorge Goncalves. 2020. Fully-Occluded Target Selection in Virtual Reality. IEEE Transactions on Visualization and Computer Graphics 26, 12(2020), 3402–3413. https://doi.org/10.1109/TVCG.2020.3023606Google ScholarCross Ref
Index Terms
- Object Manipulation Method Using Eye Gaze and Hand-held Controller in AR Space
Recommendations
Evaluation of Gaze Depth Estimation from Eye Tracking in Augmented Reality
ETRA '20 Short Papers: ACM Symposium on Eye Tracking Research and ApplicationsGaze tracking in 3D has the potential to improve interaction with objects and visualizations in augmented reality. However, previous research showed that subjective perception of distance varies between real and virtual surroundings. We wanted to ...
Eye gaze in virtual environments: evaluating the need and initial work on implementation
Distributed Simulation, Virtual Environments and Real-time ApplicationsFor efficient collaboration between participants, eye gaze is seen as being critical for interaction. Video conferencing either does not attempt to support eye gaze (e.g. AcessGrid) or only approximates it in round table conditions (e.g. life size ...
Gaze behaviour on interacted objects during hand interaction in virtual reality for eye tracking calibration
ETRA '19: Proceedings of the 11th ACM Symposium on Eye Tracking Research & ApplicationsIn this paper, we investigate the probability and timing of attaining gaze fixations on interacted objects during hand interaction in virtual reality, with the main purpose for implicit and continuous eye tracking re-calibration. We conducted an ...
Comments