skip to main content
10.1145/3013971.3014023acmconferencesArticle/Chapter ViewAbstractPublication PagessiggraphConference Proceedingsconference-collections
short-paper

A mixed-reality museum tourism framework based on HMD and fisheye camera

Published: 03 December 2016 Publication History

Abstract

Mixed-reality (MR) combines virtual and physical components with display device, which can be used to construct new environments where physical and digital objects co-exist and interact in real time. In this paper, we introduce a MR museum tourism system based popular HMD and fisheye camera, which can provide a richer experience by overlying the virtual model in the real environment. First, object detection and tracking methods are used to identify the real object and to obtain its geometrical information from camera. Then, the orientation relationship between real object and camera is decided to convert them to the same coordinate system. Finally, the corresponding model is rendered in the HMD device. Experiments results show that our proposed system can accurately and stably capture the real objects and render the corresponding virtual model in real time.

References

[1]
Comport,A.,I., Marchand, E., Pressigout, M.,and Chaumette, F., Real-Time Markerless Tracking for AugmentedReality: The Virtual Visual Servoing Framework, IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, VOL. 12, NO. 4, JULY/AUGUST 2006.
[2]
Kato,H., and Billinghurst, M.,Marker Tracking and HMD Calibration for a Video-based Augmented Reality Conferencing System, Proceedings of the 2nd IEEE and ACM International Workshop on Augmented Reality '99, pp.85--94, October 20--21, 1999 San Francisco.
[3]
KIM,H., AND WOO,W., Smartwatch-assisted Robust 6-DOF Hand Tracker for Object Manipulation in HMD-based Augmented Reality, 2016 IEEE Symposium on 3D User Interfaces (3DUI) (2016).
[4]
Ozuysal, M., Calonder, M., Lepetit, V., and Fua, P., "Fast Keypoint Recognition Using Random Ferns," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 32, no. 3, pp. 448--461, Mar. 2010.
[5]
Rattanarungrot,S., White,M., and Newbury,P., A MOBILE SERVICE ORIENTED MULTIPLE OBJECT TRACKING AUGMENTED REALITY ARCHITECTURE FOR EDUCATION AND LEARNING EXPERIENCES, 10th International Conference Mobile Learning 2014.
[6]
Okuma,T., Kurata,T.,Sakaue, K.,A Natural Feature-Based 3D Object Tracking Method for Wearable Augmented Reality IEEE International Workshop on Advanced Motion Control, 2004:451--456
[7]
V. LEPETIT, F. MORENO-NOGUER, AND P. FUA, "EPnP: An Accurate O (n) Solution to the PnP Problem," Int'l J. Computer Vision, vol. 81, no. 2, pp. 155--166, Feb. 2009.
[8]
Maidi, M., Preda,M., Le,V,H., Markerless tracking for mobile augmented reality, Signal and Image Processing Applications (ICSIPA), 2011 IEEE International Conference on

Cited By

View all
  • (2024)Advancements in Mixed Reality for Autonomous Vehicle Testing and Advanced Driver Assistance Systems: A SurveyIEEE Transactions on Intelligent Transportation Systems10.1109/TITS.2024.347374025:12(19276-19294)Online publication date: Dec-2024
  • (2024)Augmented reality technology in tourism and hospitality research: a review from 2010 to 2024Journal of Science and Technology Policy Management10.1108/JSTPM-04-2024-0136Online publication date: 9-Aug-2024
  • (2023)Radial distortion correction method based on depth separable network2023 7th International Conference on Transportation Information and Safety (ICTIS)10.1109/ICTIS60134.2023.10243904(2320-2325)Online publication date: 4-Aug-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
VRCAI '16: Proceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry - Volume 1
December 2016
381 pages
ISBN:9781450346924
DOI:10.1145/3013971
  • Conference Chairs:
  • Yiyu Cai,
  • Daniel Thalmann
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 December 2016

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. head mounted display
  2. mixed-reality
  3. object detection
  4. object tracking

Qualifiers

  • Short-paper

Funding Sources

  • Program for Innovative Research Team in University of Ministry of Education of China
  • National High-tech R&D Program of China (863 Program)
  • Key scientific and technological innovation team of Shaanxi Province
  • General Program (Key Program, Major Research Plan) of National Natural Science Foundation of China

Conference

VRCAI '16
Sponsor:

Acceptance Rates

Overall Acceptance Rate 51 of 107 submissions, 48%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)17
  • Downloads (Last 6 weeks)3
Reflects downloads up to 17 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Advancements in Mixed Reality for Autonomous Vehicle Testing and Advanced Driver Assistance Systems: A SurveyIEEE Transactions on Intelligent Transportation Systems10.1109/TITS.2024.347374025:12(19276-19294)Online publication date: Dec-2024
  • (2024)Augmented reality technology in tourism and hospitality research: a review from 2010 to 2024Journal of Science and Technology Policy Management10.1108/JSTPM-04-2024-0136Online publication date: 9-Aug-2024
  • (2023)Radial distortion correction method based on depth separable network2023 7th International Conference on Transportation Information and Safety (ICTIS)10.1109/ICTIS60134.2023.10243904(2320-2325)Online publication date: 4-Aug-2023
  • (2022)Proposal of an Immersive Tourism System in Vehicle for Seasonal Scenery2022 IEEE 11th Global Conference on Consumer Electronics (GCCE)10.1109/GCCE56475.2022.10014081(820-824)Online publication date: 18-Oct-2022
  • (2021)Practical Use of Edutainment Systems for Science Museums with XR TechnologyDesign, User Experience, and Usability: Design for Contemporary Technological Environments10.1007/978-3-030-78227-6_17(233-244)Online publication date: 3-Jul-2021
  • (2020)Ambient Information Visualisation and Visitors’ Technology Acceptance of Mixed Reality in MuseumsJournal on Computing and Cultural Heritage 10.1145/335959013:2(1-22)Online publication date: 15-Jun-2020
  • (2019)Design and development of a spatial mixed reality touring guide to the Egyptian museumMultimedia Tools and Applications10.1007/s11042-019-08026-wOnline publication date: 6-Aug-2019
  • (2018)An augmented reality system for technical staff training2018 IEEE 16th International Conference on Industrial Informatics (INDIN)10.1109/INDIN.2018.8472088(899-904)Online publication date: Jul-2018

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media