Gerard Mulvany
ABSTRACT
Virtual Reality (VR) games and applications require accurate spatial positioning of the head-mounted display (HMD) within the virtual environment. Inside-out tracking technologies such as 'Oculus Insight' derive the HMD position by tracking 'landmarks' in the user's environment. Because these technologies face specific limitations in deriving the HMD position and rotation, players can experience noticeable spatial drift[1]. To develop a better understanding of these limitations and improve tracking accuracy, we tested 'Oculus Insight' under several environmental and user conditions. We used Unreal Engine to develop a calibration program which measures the discrepancy between the HMD's real-world and its in-game positions, in order to calculate the relative spatial drift. We replicated this program in several environments, duration and distance travelled by a user. Preliminary findings suggest methods for improving spatial accuracy over time; most notably providing a white grid pattern against dark carpet, which improved tracking by a factor of 4.3. This study helps researchers and practitioners minimize spatial drift in VR optical tracking systems such as Oculus Insight.
Supplemental Material
Available for Download
Video figure captions
- M. de Silva, 'Facebook's VR sales have finally taken off,? QUARTZ - Head Games, 2019. https://qz.com/1739575/strong-oculus-quest-salesboost-facebooks-non-advertising-revenue/ (accessed Jul. 02, 2020).Google Scholar
- A. C. Romea and T. Meyer, ?SLAM: Bringing art to life through technology,? 2016. https://ai.facebook.com/blog/slam-bringing-art-tolife-through-technology/ (accessed Apr. 19, 2020).Google Scholar
- J. Hesch, A. Kozminksi, and O. Linde, 'Powered by AI: Oculus Insight,' 2019. https://ai.facebook.com/blog/powered-by-ai-oculusinsight/ (accessed Apr. 19, 2020).Google Scholar
- O. Millard, S. McLeod, S. Greuter, and P. Fraser, 'Virtual Now.' Geelong Arts Centre, Geelong, Victoria, Australia, 2019.Google Scholar
- A. Melim, 'Tracking Technology Explained: LED Matching,' Oculus developer blog, 2019. https://developer.oculus.com/blog/trackingtechnology-explained-led-matching/ (accessed Jul. 02, 2020).Google Scholar
- A. Melim, 'Optimizing Oculus Insight Controller Tracking to Work in Challenging Conditions,' Oculus developer blog, 2019. https://developer.oculus.com/blog/optimizingoculus-insight-controller-tracking-to-work-inchallenging-conditions-like-near-holiday-lights/ (accessed Jul. 02, 2020).Google Scholar
- J. C. Piao and S. D. Kim, 'Real-Time Visual-Inertial SLAM Based on Adaptive Keyframe Selection for Mobile AR Applications,' IEEE Transactions on Multimedia, vol. 21, no. 11, pp. 2827--2836, Nov. 2019, doi: 10.1109/TMM.2019.2913324.Google Scholar
- P. Graham, 'Oculus Lifts The Lid On Its Tracking Tech Oculus Insight,' VR Focus, 2019. https://www.vrfocus.com/2019/08/oculus-lifts-thelid-on-its-tracking-tech-oculus-insight/ (accessed Jul. 03, 2020).Google Scholar
- K. Lieberman, D. Greenspan, O. Moses, and G. Barach, '30-3: Ultra-High-Speed 6DOF SLAM using Optical Compression,' SID Symposium Digest of Technical Papers, vol. 49, no. 1, pp. 388--390, 2018, doi: 0097996X/18/4701-0388.Google Scholar
- F. Hu, J. Cheng, Y. Bao, and Y. He, 'Accuracy enhancement for the front-end tracking algorithm of RGB-D SLAM,' Intelligent Service Robotics, vol. 13, no. 2, pp. 207--218, Apr. 2020, doi: 10.1007/s11370-01900299-2.Google Scholar
- J. W. Creswell and J. D. Creswell, Research design: qualitative, quantitative & mixed methods approaches, Fifth. Los Angeles: SAGE, 2018.Google Scholar
- S. Wangsiripitak and D. W. Murray, 'Avoiding moving outliers in visual slam by tracking moving objects,' in Proceedings - IEEE International Conference on Robotics and Automation, 2009, pp. 375--380, doi: 10.1109/ROBOT.2009.5152290.Google Scholar
Index Terms
- Target: Zero Drift: Minimizing Spatial Drift in VR Optical Tracking Systems such as Oculus Insight
Recommendations
Development of an immersive SLAM-based VR system for teleoperation of a mobile manipulator in an unknown environment
Highlights- A SLAM-based VR system is developed for teleoperation of a mobile manipulator.
- ...
AbstractOperating a remote robot in an unknown environment is a challenge. Usually, a camera is attached to the robot to capture the images of the remote scenes. However, it is difficult to perceive a 3D environment using a 2D display. In this ...
Haptic around: multiple tactile sensations for immersive environment and interaction in virtual reality
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and TechnologyIn this paper, we present Haptic Around, a hybrid-haptic feedback system, which utilizes fan, hot air blower, mist creator and heat light to recreate multiple tactile sensations in virtual reality for enhancing the immersive environment and interaction. ...
SoEs: Attachable Augmented Haptic on Gaming Controller for Immersive Interaction
UIST '16 Adjunct: Adjunct Proceedings of the 29th Annual ACM Symposium on User Interface Software and TechnologyWe present SoEs (Sword of Elements), an attachable augmented haptic device for enhancing gaming controller in the immersive first-person game. Generally, Player can easily receive visual and auditory feedback through head-mounted displays (HMD) and ...
Comments