Abstract
Augmented reality (AR) applied to cultural heritage intends to improve the learning experience in archaeological sites, not only for visitants but also for researchers. 3D Pose estimation is a common problem in applications for AR, object recognition, 3D modeling, among others. AR systems use different methods to estimate the camera pose: edge detection and key-point detection among others. The choice of the method to be used depends on the features of the scenario to be detected. In this work, a comparison study of the main 3D model-based pose estimation methods is performed. In addition, we present the implementation and validation of a pose estimation algorithm, oriented to the initialization of an AR system applied to “Huaca de la Luna”, an adobe brick pyramid built by the Moche civilization in the northern Peru. The proposed algorithm presents two phases, a training phase, where 3D key-points are extracted from a reference image, and a detection phase, where the initialization process is performed by comparing 2D/3D points correspondence using a PnP algorithm. We have compared four variations of the 3D pose estimation algorithm using different methods: SIFT and SURF descriptors for key-point description and EPnP and REPPnP algorithms for PnP pose estimation. Results show a translation error of 1.54 cm, with a mean processing time of 2.78 s, a maximum re-projection error of 1.5 pixels and a successful estimation rate of 100% in scenarios with normal and high light conditions.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Papagiannakis, G., Singh, G., Magnenat-Thalmann, N.: A survey of mobile and wireless technologies for augmented reality systems. Comput. Animat. Virtual Worlds 19, 3–22 (2008)
Uceda, S.: Investigations at Huaca de la Luna, Moche Valley: an example of Moche religious architecture. Stud. Hist. Art 63, 46–67 (2001)
Chácara, C., Zvietcovich, F., Briceño, C., Marques, R., Perucchio, R., Castañeda, B., Uceda, S., Morales, R., Aguilar, R.: On-site investigation and numerical analysis for structural assessment of the archaeological complex of Huaca de la Luna. In: Proceedings of the 9th International Conference on Structural Analysis of Historical Constructions (2014)
Zvietcovich, F., Castaneda, B., Perucchio, R.: 3D solid model updating of complex ancient monumental structures based on local geometrical meshes. Digit. Appl. Archaeol. Cult. Herit. 2, 12–27 (2015)
Zavala, G., López, S., Ebinger, C., Pando, M., Lambert, C., Morales, R., Uceda, S., Perucchio, R., Castañeda, B., Aguilar, R.: Preliminary geophysical survey for assessing the geotechnical conditions and geohazards at Huaca de la Luna, Perú. In: AGU Fall Meeting Abstracts (2014)
Aguilar, R., Zavala, G., Castañeda, B., Lopez, S., Retamozo, S., Montesinos, M., Pando, M., Dong, Y., Perucchio, R.: Structural damage assessment of Huaca de la Luna, Perú: preliminary results from ongoing multidisciplinary study. In: Structural Analysis of Historical Constructions: Anamnesis, Diagnosis, Therapy, Controls: Proceedings of the 10th International Conference on Structural Analysis of Historical Constructions (SAHC), Leuven, Belgium, 13–15 September 2016, p. 465. CRC Press (2016)
Official site, Huacas del Sol y de la Luna. http://www.huacasdemoche.pe/index.php?menuid=5&submenuid=38&articuloid=87&subarticuloid=. Accessed 20 Aug 2017
Lepetit, V., Fua, P.: Monocular model-based 3D tracking of rigid objects: a survey. Found. Trends® Comput. Graph. Vis. 1, 1–89 (2005)
Lima, J.P., Simões, F., Figueiredo, L., Kelner, J.: Model based markerless 3D tracking applied to augmented reality. J. 3D Interact. Syst. 1 (2010)
VICON. https://www.vicon.com/. Accessed 20 Aug 2017
ARToolkit. http://www.hitl.washington.edu/artoolkit/. Accessed 20 Aug 2017
Simon, G., Fitzgibbon, A.W., Zisserman, A.: Markerless tracking using planar structures in the scene. In: Proceedings of the IEEE and ACM International Symposium on Augmented Reality, 2000 (ISAR 2000), pp. 120–128. IEEE (2000)
Vacchetti, L., Lepetit, V., Fua, P.: Stable real-time 3D tracking using online and offline information. IEEE Trans. Pattern Anal. Mach. Intell. 26, 1385–1391 (2004)
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60, 91–110 (2004)
Bay, H., Ess, A., Tuytelaars, T., Van Gool, L.: Speeded-up robust features (SURF). Comput. Vis. Image Underst. 110, 346–359 (2008)
Lepetit, V., Moreno-Noguer, F., Fua, P.: EPnP: an accurate O(n) solution to the PnP problem. Int. J. Comput. Vision 81, 155–166 (2009)
Ferraz, L., Binefa, X., Moreno-Noguer, F.: Very fast solution to the PnP problem with algebraic outlier rejection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 501–508 (2014)
Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24, 381–395 (1981)
Acknowledgments
We thank CIENCIACTIVA for funding the development of the research “Monitoreo remoto de la salud estructural de edificaciones emblemáticas de adobe: Integración de conocimiento y tecnología para un diagnóstico estructural adecuado” (Project ID 222-2015 FONDECYT). The authors want to dedicate this article in memory of Dr. Santiago Uceda who devoted his life to the study of Peruvian and specially Moche heritage.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this chapter
Cite this chapter
Rodriguez, R.M., Aguilar, R., Uceda, S., Castañeda, B. (2018). 3D Pose Estimation Oriented to the Initialization of an Augmented Reality System Applied to Cultural Heritage. In: Ioannides, M. (eds) Digital Cultural Heritage. Lecture Notes in Computer Science(), vol 10605. Springer, Cham. https://doi.org/10.1007/978-3-319-75826-8_23
Download citation
DOI: https://doi.org/10.1007/978-3-319-75826-8_23
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-75825-1
Online ISBN: 978-3-319-75826-8
eBook Packages: Computer ScienceComputer Science (R0)