skip to main content
10.1145/3139131.3139136acmconferencesArticle/Chapter ViewAbstractPublication PagesvrstConference Proceedingsconference-collections
research-article

Outside-in monocular IR camera based HMD pose estimation via geometric optimization

Published: 08 November 2017 Publication History

Abstract

Accurately tracking a Head Mounted Display (HMD) with a 6 degree of freedom is essential to achieve a comfortable and a nausea free experience in Virtual Reality. Existing commercial HMD systems using synchronized Infrared (IR) camera and blinking IR-LEDs can achieve highly accurate tracking. However, most of the off-the-shelf cameras do not support frame synchronization. In this paper, we propose a novel method for real time HMD pose estimation without using any camera synchronization or LED blinking. We extended over the state of the art pose estimation algorithm by introducing geometrically constrained optimization. In addition, we propose a novel system to increase robustness to the blurred IR-LEDs patterns appearing at high-velocity movements. The quantitative evaluations showed significant improvements in pose stability and accuracy over wide rotational movements as well as a decrease in runtime.

Supplementary Material

MP4 File (a7-savkin.mp4)

References

[1]
Online; accessed 25-June-2017. Lighthouse tracking examined. http://doc-ok.org/?p=1478.
[2]
Gabriele Bleser and Didier Stricker. 2009. Advanced tracking through efficient image processing and visual-inertial sensor fusion. Computers & Graphics 33, 1 (2009), 59--72.
[3]
Eric Brachmann, Frank Michel, Alexander Krull, Michael Ying Yang, Stefan Gumhold, et al. 2016. Uncertainty-driven 6d pose estimation of objects and scenes from a single rgb image. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 3364--3372.
[4]
Mark Brown, David Windridge, and Jean-Yves Guillemaut. 2015. Globally optimal 2D-3D registration from points or lines without correspondences. In Proceedings of the IEEE International Conference on Computer Vision. 2111--2119.
[5]
Andrea Censi, Jonas Strubel, Christian Brandli, Tobi Delbruck, and Davide Scaramuzza. 2013. Low-latency localization by Active LED Markers tracking using a Dynamic Vision Sensor. In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 891--898.
[6]
Philip David, Daniel Dementhon, Ramani Duraiswami, and Hanan Samet. 2004. Soft-POSIT: Simultaneous pose and correspondence determination. International Journal of Computer Vision 59, 3 (2004), 259--284.
[7]
Fadi Dornaika and Radu Horaud. 1998. Simultaneous robot-world and hand-eye calibration. IEEE transactions on Robotics and Automation 14, 4 (1998), 617--622.
[8]
Matthias Faessler, Elias Mueggler, Karl Schwabe, and Davide Scaramuzza. 2014. A monocular pose estimation system based on infrared leds. In IEEE International Conference on Robotics and Automation (ICRA). IEEE, 907--913.
[9]
Martin A Fischler and Robert C Bolles. 1981. Random Sample Consensus: a Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography. Commun. ACM 24, 6 (1981), 381--395.
[10]
Jorge Fuentes-Pacheco, José Ruiz-Ascencio, and Juan Manuel Rendón-Mancha. 2015. Visual simultaneous localization and mapping: a survey. Artificial Intelligence Review (2015), 1--27.
[11]
Changyu He, Peter Kazanzides, Hasan Tutkun Sen, Sungmin Kim, and Yue Liu. 2015. An inertial and optical sensor fusion approach for six degree-of-freedom pose estimation. Sensors 15, 7 (2015), 16448--16465.
[12]
Vahid Kazemi and Josephine Sullivan. 2014. One millisecond face alignment with an ensemble of regression trees. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1867--1874.
[13]
Zuzana Kukelova, Martin Bujnak, and Tomas Pajdla. 2010. Closed-form solutions to minimal absolute pose problems with known vertical direction. Proceedings of the 10th Asian Conference on Computer Vision (2010), 216--229.
[14]
Steven M. LaValle. 2017. Virtual reality. Cambridge University Press.
[15]
Vincent Lepetit, Francesc Moreno-Noguer, and Pascal Fua. 2009. Epnp: An accurate o(n) solution to the pnp problem. International Journal of Computer Vision 81, 2 (2009), 155--166.
[16]
Bo Li, Lionel Heng, Gim Hee Lee, and Marc Pollefeys. 2013. A 4-point algorithm for relative pose estimation of a calibrated camera with a known relative rotation angle. In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 1595--1601.
[17]
Rainer Lienhart and Jochen Maydt. 2002. An extended set of haar-like features for rapid object detection. In Proceedings of the International Conference on Image Processing, Vol. 1. IEEE, I-I.
[18]
Eric Marchand, Hideaki Uchiyama, and Fabien Spindler. 2016. Pose estimation for augmented reality: a hands-on survey. IEEE Transactions on Visualization and Computer Graphics 22, 12 (2016), 2633--2651.
[19]
Francesc Moreno-Noguer, Vincent Lepetit, and Pascal Fua. 2008. Pose priors for simultaneously solving alignment and correspondence. Proceedings of the 10th European Conference on Computer Vision (2008), 405--418.
[20]
Nobuyuki Otsu. 1979. A threshold selection method from gray-level histograms. IEEE Transactions on Systems, Man, and Cybernetics 9, 1 (1979), 62--66.
[21]
Jason R Rambach, Aditya Tewari, Alain Pagani, and Didier Stricker. 2016. Learning to fuse: A deep learning approach to visual-inertial camera pose estimation. In IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 71--76.
[22]
Denys Rozumnyi, Jan Kotera, Filip Sroubek, Lukas Novotn, and Jiri Matas1. 2017. The World of Fast Moving Objects. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
[23]
Chris Sweeney, John Flynn, Benjamin Nuernberger, Matthew Turk, and Tobias Höllerer. 2015. Efficient computation of absolute pose for gravity-aware augmented reality. In IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 19--24.
[24]
Henning Tjaden, Ulrich Schwanecke, Frédéric Stein, and Elmar Schömer. 2015. High-Speed and Robust Monocular Tracking. In Proceedings of the 12th International Conference on Computer Vision Theory and Applications. 462--471.
[25]
Ruxin Wang and Dacheng Tao. 2014. Recent progress in image deblurring. arXiv preprint arXiv:1409.6838 (2014).
[26]
Stephen J Wright. 2015. Coordinate descent algorithms. arXiv preprint arXiv:1502.04759 (2015).

Cited By

View all
  • (2022)Development of a Low-Cost 6 DOF Brick Tracking System for Use in Advanced Gas-Cooled Reactor Model TestsSensors10.3390/s2203111022:3(1110)Online publication date: 1-Feb-2022

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
VRST '17: Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology
November 2017
437 pages
ISBN:9781450355483
DOI:10.1145/3139131
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 November 2017

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. monocular IR camera
  2. perspective-n-point problem
  3. position tracking
  4. vision-based pose estimation

Qualifiers

  • Research-article

Funding Sources

  • JST, Japan

Conference

VRST '17

Acceptance Rates

Overall Acceptance Rate 66 of 254 submissions, 26%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)28
  • Downloads (Last 6 weeks)1
Reflects downloads up to 19 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2022)Development of a Low-Cost 6 DOF Brick Tracking System for Use in Advanced Gas-Cooled Reactor Model TestsSensors10.3390/s2203111022:3(1110)Online publication date: 1-Feb-2022

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media