Abstract
Smartphone devices constitute a low-cost, mainstream and easy to use h/w for VR rendering and main component for modern, mobile VR Head-Mounted-Displays (HMDs). They support rotational tracking from on board sensors to manage orientation changes, via their Inertial Measurement Units (IMUs), but they lack positional tracking to reflect head translational movements, a key feature that modern, desktop VR HMDs nowadays provide out-of-the-box. Taking advantage of the RGB camera sensor that each modern mobile device is equipped, we describe a novel combination of inside-out AR tracking algorithms based on both marker and markerless tracking systems to provide the missing positional tracking for mobile HMDs. We employed this system as an affordable, low-cost VR visualization h/w and s/w method, for heritage professionals to employ it for VR archeological sites and Cultural Heritage related monuments interactive walk-throughs. We also compared our results with a recent holographic AR headset (Meta AR-glasses) that supports gesture recognition and interaction with the virtual objects via its RGB-D camera sensor and integrated IMU.
This is a preview of subscription content, log in via an institution to check access.
References
Foni, A., Papagiannakis, G., Magnenat-Thalmann, N.: A taxonomy of visualization strategies for cultural heritage applications. ACM J. Comput. Cult. Heritage 3(1), 1–21 (2010)
Yudiantika, A.R., Sulistyo, S., Hantono, B.S.: The development of mobile augmented reality quiz visualization methods based on markerless tracking for museum learning application. Disampaikan pada seminar “The International Forum on Strategic Technology (IFOST)”, June 2015
Gaitatzes, A., Christopoulos, D., Roussou, M.: Reviving the past: cultural heritage meets virtual reality. In: Proceedings of the 2001 Conference on Virtual Reality, Archeology, and Cultural Heritage (VAST 2001), pp. 103–110. ACM, New York (2001)
Billinghurst, M., Clark, A., Lee, G.: A survey of augmented reality. Found. Trends Hum. Comput. Interact. 8(1), 1–202 (2015)
Billinghurst, M.: Gesture based AR interaction research at the HIT Lab NZ. Presentation (2015)
Baggio, D.L., Emami, S., Escrivá, D.M., Ievgen, K., Mahmood, N., Saragih, J., Shilkrot, R.: Mastering OpenCV with Practical Computer Vision Projects
Wagner, D., Schmalstieg, D.: ARToolKitPlus for pose tracking on mobile devices. In: Grabner, M., Grabner, H. (eds.) Computer Vision Winter Workshop 2007, St. Lambrecht, Austria, 6–8 February 2007. Graz Technical University (2007)
Papagiannakis, G., Papanikolaou, P., Greasidou, E., Trahanias, P.: glGA: an OpenGL geometric application framework for a modern, shader-based computer graphics curriculum. In: Eurographics 2014, pp. 1–8 (2014)
Kato, H., Billinghurst, M.: Marker tracking and HMD calibration for a video-based augmented reality conferencing system. In: Proceedings of the IEEE International Workshop on Augmented Reality, pp. 125–133 (1999)
Platonov, J., Heibel, H., Meier, P., Grollmann, B.: A mobile markerless AR system for maintenance and repair. In: Proceedings of the 5th IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR 2006), pp. 105–108. IEEE Computer Society, Washington, DC (2006)
Kateros, S., Georgiou, S., Papaefthymiou, M., Papagiannakis, G., Tsioumas, M.: A comparison of gamified, immersive VR curation methods for enhanced presence and human-computer interaction in digital humanities. Int. J. Heritage Digit. Era 4(2), 221–233 (2015)
Papaefthymiou, M., Feng, A., Shapiro, A., Papagiannakis, G.: A fast and robust pipeline for populating mobile AR scenes with gamified virtual characters. In: SIGGRAPH Asia 2015 Mobile Graphics and Interactive Applications (SA 2015). ACM, New York (2015). Article 22, 8 pages
Kjærgaard, M.B., Langdal, J., Godsk, T., Toftkjær, T.: EnTracked: energy-efficient robust position tracking for mobile devices. In: Proceedings of the 7th International Conference on Mobile Systems, Applications, and Services (MobiSys 2009), pp. 221–234. ACM, New York (2009)
Desai, P. R., Desai, P. N., Ajmera, K. D., Mehta, K.: Int. J. Eng. Trends Technol. (IJETT) 13(4) (2014)
Zikas, P., Bachlitzanakis, V., Papaefthymiou, M., Kateros, S., Georgiou, S., Lydatakis, N., Papagiannakis, G.: Mixed reality serious games and gamification for smart education. In: 10th European Conference on Games Based Learning (ECGBL), October 2016
Zhang, X., Fronz, S., Navab, N.: Visual marker detection and decoding in AR systems: a comparative study. In: Proceedings of the 1st International Symposium on Mixed and Augmented Reality (ISMAR 2002), p. 97. IEEE Computer Society, Washington, DC (2002)
Acknowledgements
The research leading to these results has received partial funding from the European Union People Programme (FP7- PEOPLE- 2013-ITN) under grant agreement No. 608013 and from the European Union Horizon2020 Programme (H2020-SC6-CULT-COOP-9 – CSA) under grant agreement No. 727107. Special thanks also to ARdictive (www.ardictive.com) and its CEO & founder Nils Huebner for the MetaAR glasses.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing AG
About this paper
Cite this paper
Zikas, P., Bachlitzanakis, V., Papaefthymiou, M., Papagiannakis, G. (2016). A Mobile, AR Inside-Out Positional Tracking Algorithm, (MARIOPOT), Suitable for Modern, Affordable Cardboard-Style VR HMDs. In: Ioannides, M., et al. Digital Heritage. Progress in Cultural Heritage: Documentation, Preservation, and Protection. EuroMed 2016. Lecture Notes in Computer Science(), vol 10058. Springer, Cham. https://doi.org/10.1007/978-3-319-48496-9_21
Download citation
DOI: https://doi.org/10.1007/978-3-319-48496-9_21
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-48495-2
Online ISBN: 978-3-319-48496-9
eBook Packages: Computer ScienceComputer Science (R0)