Keisuke Hattori
ABSTRACT
To smoothly operate an HMD controller in the 3D space, a variety of operation methods that are linked to the real hand movements have been proposed. Many controller recognition methods are based on outside-in tracking. Therefore, those controllers have the disadvantage that it cannot be operated if it moves into the occluded area from the sensor. In this paper, we propose an inside-out controller for HMD using a smartphone that can estimate its own position and the angle via image recognition. This is a system that transmits the controller’s 6DoF(six degrees of freedom) information to the HMD and performs raycasting based on the 6DoF information. Wherever the controller is located, the user can operate it. This method covers the disadvantages of existing HMD controllers.
Supplemental Material
Available for Download
- J. D. Hincapié-Ramos, K. Özacar, P. P. Irani, and Y. Kitamura. 2016. GyroWand: An Approach to IMU-Based Raycasting for Augmented Reality. IEEE Computer Graphics and Applications 36, 2 (2016), 90–96.Google Scholar
Digital Library
- Peter Mohr-Ziak, Markus Tatzgern, Tobias Langlotz, Andreas Lang, Dieter Schmalstieg, and Denis Kalkofen. 2019. TrackCap: Enabling Smartphones for 3D Interaction on Mobile Head-Mounted Displays. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems.Google ScholarDigital Library
Recommendations
Mobile inside-out VR tracking, now available on your phone: extended abstract
SIGGRAPH '18: ACM SIGGRAPH 2018 Appy HourUp to now in mobile Virtual Reality (VR), we have been able to only control the camera orientation with our head. However, premium smartphones already incorporate the essential technology to track user position. Apple ARKit and Google ARCore designed ...
A safe low-cost HMD for underwater VR experiences
SA '16: SIGGRAPH ASIA 2016 Mobile Graphics and Interactive ApplicationsRecently, consumer head-mounted VR displays (HMDs) like the Oculus Rift1 and Samsung Gear VR2 have driven much research into interesting applications that include full-body sensory experiences. For example, PaperDude VR [Bolton et al. 2014] uses the ...
Building and Employing Cross-Reality
This issue's Works in Progress department lists five projects with a focus on cross reality. The first two involve using Project Wonderland for collaborative projects. The next three use virtual and augmented reality to enhance user capabilities and ...
Comments