skip to main content
10.1145/3385956.3422121acmconferencesArticle/Chapter ViewAbstractPublication PagesvrstConference Proceedingsconference-collections
abstract

HMDPose: A large-scale trinocular IR Augmented Reality Glasses Pose Dataset

Published: 01 November 2020 Publication History

Abstract

Augmented Reality Glasses usually implement an Inside-Out tracking. In case of a driving scenario or glasses with less computation capabilities, an Outside-In tracking approach is required. However, to the best of our knowledge, no public datasets exist that collects images of users wearing AR glasses. To address this problem, we present HMDPose, an infrared trinocular dataset of four different AR Head-mounted displays captured in a car. It contains sequences of 14 subjects captured by three different cameras running at 60 FPS each, adding up to more than 3,000,000 labeled images in total. We provide a ground truth 6DoF-pose, captured by a submillimeter accurate marker-based tracker. We make HMDPose publicly available for non-profit, academic use and non-commercial benchmarking on ags.cs.uni-kl.de/datasets/hmdpose/.

References

[1]
2015. MINI Augmented Vision. https://www.press.bmwgroup.com/global/article/detail/T0212042EN/mini-augmented-vision:-a-revolutionary-display-concept-offering-enhanced-comfort-and-safety-exclusive-prototype-of-augmented-reality-eyewear-underlines-the-innovative-flair-and-creativity-of-the-mini-brand?language=en
[2]
2020. Explore Focals - North. https://www.bynorth.com/focals
[3]
2020. HoloLens (1st gen) hardware. https://docs.microsoft.com/en-us/hololens/hololens1-hardware
[4]
2020. Raptor – Everysight. https://everysight.com/product/raptor/
[5]
J. M. D. Barros, B. Mirbach, F. Garcia, K. Varanasi, and D. Stricker. 2018. Fusion of Keypoint Tracking and Facial Landmark Detection for Real-Time Head Pose Estimation. In 2018 IEEE Winter Conference on Applications of Computer Vision (WACV). 2028–2037. https://doi.org/10.1109/WACV.2018.00224
[6]
Guido Borghi, Marco Venturelli, Roberto Vezzani, and Rita Cucchiara. 2017. POSEidon: Face-From-Depth for Driver Pose Estimation. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
[7]
Ahmet Firintepe, Selim Mohamed, Alain Pagani, and Didier Stricker. 2020. The More, the Merrier? A Study on In-Car IR-based Head Pose Estimation. In 2020 IEEE Intelligent Vehicles Symposium (IV). IEEE.
[8]
Anke Schwarz, Monica Haurilet, Manuel Martinez, and Rainer Stiefelhagen. 2017. DriveAHead-a large-scale driver head pose dataset. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops. 1–10.
[9]
Mohamed Selim, Ahmet Firintepe, Alain Pagani, and Didier Stricker. 2020. AutoPOSE: Large-Scale Automotive Driver Head Pose and Gaze Dataset with Deep Head Pose Baseline. In International Conference on Computer Vision Theory and Applications (VISAPP). SCITEPRESS Digital Library.
[10]
Alexandru Telea. 2004. An Image Inpainting Technique Based on the Fast Marching Method. Journal of Graphics Tools 9, 1 (2004), 23–34.
[11]
T. Vatahska, M. Bennewitz, and S. Behnke. 2007. Feature-based head pose estimation from images. In 2007 7th IEEE-RAS International Conference on Humanoid Robots. 330–335.

Cited By

View all
  • (2021)From IR Images to Point Clouds to Pose: Point Cloud-Based AR Glasses Pose EstimationJournal of Imaging10.3390/jimaging70500807:5(80)Online publication date: 27-Apr-2021
  • (2021)A Comparison of Single and Multi-View IR image-based AR Glasses Pose Estimation Approaches2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW52623.2021.00168(571-572)Online publication date: Mar-2021
  • (2021)Comparing Head and AR Glasses Pose Estimation2021 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct54149.2021.00032(109-114)Online publication date: Oct-2021
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
VRST '20: Proceedings of the 26th ACM Symposium on Virtual Reality Software and Technology
November 2020
429 pages
ISBN:9781450376198
DOI:10.1145/3385956
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 November 2020

Check for updates

Author Tags

  1. AR Glasses
  2. Dataset
  3. Deep Learning
  4. Object Pose Estimation
  5. Tracking

Qualifiers

  • Abstract
  • Research
  • Refereed limited

Conference

VRST '20

Acceptance Rates

Overall Acceptance Rate 66 of 254 submissions, 26%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)11
  • Downloads (Last 6 weeks)0
Reflects downloads up to 17 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2021)From IR Images to Point Clouds to Pose: Point Cloud-Based AR Glasses Pose EstimationJournal of Imaging10.3390/jimaging70500807:5(80)Online publication date: 27-Apr-2021
  • (2021)A Comparison of Single and Multi-View IR image-based AR Glasses Pose Estimation Approaches2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW52623.2021.00168(571-572)Online publication date: Mar-2021
  • (2021)Comparing Head and AR Glasses Pose Estimation2021 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct54149.2021.00032(109-114)Online publication date: Oct-2021
  • (2021)Pose Tracking vs. Pose Estimation of AR Glasses with Convolutional, Recurrent, and Non-local Neural Networks: A ComparisonVirtual Reality and Mixed Reality10.1007/978-3-030-90739-6_6(85-106)Online publication date: 24-Nov-2021

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media