Abstract
Located in China’s ancient capital Luoyang, Longmen Grottoes are one of the finest examples of Buddhist stone carving art. Nowadays, many caves do not have public access due to heritage preservation. In order to let people appreciate these relics, we setup a VR system with smartphones and helmets based on scanned models and textures. Motion capture system is also utilized to make the viewpoint not fixed so that users can walk freely as if in the cave. Moreover, since some sculptures have been heavily damaged, we propose a digital restoration framework to enhance exhibition contents. The framework includes general and detailed restoration from a single old image by shape from shading and landmark driven mesh deformation respectively. In practice, we develop this system for the representative Middle Binyang Cave, with interactions such as gesture recognition exploited to provide satisfactory user experience, which can ease the conflict between tourism and preservation.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Cosmas, J., Itegaki, T., Green, D., Grabczewski, E., Weimer, F., Vanrintel, D., Leberl, F., Grabner, M., Schindler, K., et al.: A novel multimedia system for archaeology. In: International Conference on Virtual Reality, Archeology, and Cultural Heritage, vol. 16 (2001)
Banno, A., Masuda, T., Oishi, T., Ikeuchi, K.: Flying laser range sensor for large-scale site-modeling and its applications in bayon digital archival project. Int. J. Comput. Vis. 78, 207–222 (2008)
Ikeuchi, K., Miyazaki, D.: Digitally Archiving Cultural Objects. Springer Science & Business Media, Heidelberg (2008)
Koller, D., Levoy, M.: Computer-aided reconstruction and new matches in the forma urbis romae. Bullettino Della Commissione Archeologica Comunale di Roma 2 (2006)
Brown, B.J., Toler-Franklin, C., Nehab, D., Burns, M., Dobkin, D., Vlachopoulos, A., Doumas, C., Rusinkiewicz, S., Weyrich, T.: A system for high-volume acquisition and matching of fresco fragments: reassembling Theran wall paintings. ACM Trans. Graph. 27, 84 (2008)
Koutsoudis, A., Pavlidis, G., Liami, V., Tsiafakis, D., Chamzas, C.: 3D pottery content-based retrieval based on pose normalisation and segmentation. J. Cult. Herit. 11, 329–338 (2010)
Pintus, R., Yang, Y., Rushmeier, H.: Athena: automatic text height extraction for the analysis of text lines in old handwritten manuscripts. J. Comput. Cult. Herit. 8, 1 (2015)
Kim, M.H., Rushmeier, H., Ffrench, J., Passeri, I., Tidmarsh, D.: Hyper 3D: 3D graphics software for examining cultural artifacts. J. Comput. Cult. Herit. 7, 14 (2014)
Rushmeier, H.: Computer graphics techniques for capturing and rendering the appearance of aging materials. In: Martin, J.W., Ryntz, R.A., Chin, J., Dickie, R. (eds.) Service Life Prediction of Polymeric Materials, pp. 283–292. Springer, Heidelberg (2009)
Wojciechowski, R., Walczak, K., White, M., Cellary, W.: Building virtual and augmented reality museum exhibitions. In: International Conference on 3D Web Technology, pp. 135–144. ACM (2004)
Inaba, M., Banno, A., Oishi, T., Ikeuchi, K.: Achieving robust alignment for outdoor mixed reality using 3D range data. In: Symposium on Virtual Reality Software and Technology, pp. 61–68. ACM (2012)
Kakuta, T., Oishi, T., Ikeuchi, K.: Development and evaluation of asuka-kyo mr contents with fast shading and shadowing. In: International Conference on Virtual Systems and MultiMedia, pp. 254–260 (2008)
Horn, B.K., Brooks, M.J.: Shape from Shading. MIT Press, Cambridge (1989)
Barron, J.T., Malik, J.: Shape, illumination, and reflectance from shading. IEEE Trans. Pattern Anal. Mach. Intell. 37, 1670–1687 (2015)
Blanz, V., Vetter, T.: A morphable model for the synthesis of 3D faces (1999)
Brown, D.C.: Decentering distortion of lenses. Photom. Eng. 32, 444–462 (1966)
Lipman, Y., Sorkine, O., Cohen-Or, D., Levin, D., Rossi, C., Seidel, H.P.: Differential coordinates for interactive mesh editing. In: International Conference on Shape Modeling Applications, pp. 181–190. IEEE (2004)
Zhou, K., Yu, Y.: Mesh editing with Poisson-based gradient field manipulation. In: ACM Transactions on Graphics, pp. 641–648 (2004)
Horn, B.K.P.: Determining lightness from an image. Graph. Models Comput. Vis. Graph. Image Process. 3, 277–299 (1974)
Ikeuchi, K., Horn, B.K.P.: Numerical shape from shading and occluding boundaries. Artif. Intell. 17, 141–184 (1981)
Zhang, R., Tsai, P., Cryer, J.E., Shah, M.: Shape-from-shading: a survey. IEEE Trans. Pattern Anal. Mach. Intell. 21, 690–706 (1999)
Cootes, T.F., Taylor, C.J., Cooper, D.H., Graham, J.: Active shape modelstheir training and application. Comput. Vis. Image Underst. 61, 38–59 (1995)
Cootes, T.F., Edwards, G., Taylor, C.J.: Active appearance models. IEEE Trans. Pattern Anal. Mach. Intell. 23, 681–685 (2001)
Zhou, E., Fan, H., Cao, Z., Jiang, Y., Yin, Q.: Extensive facial landmark localization with coarse-to-fine convolutional network cascade. In: IEEE International Conference on Computer Vision Workshops, pp. 386–391 (2013)
Huang, Z., Zhou, E., Cao, Z.: Coarse-to-fine face alignment with multi-scale local patch regression (2015). arXiv preprint arXiv:1511.04901
Gower, J.C.: Generalized procrustes analysis. Psychometrika 40, 33–51 (1975)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Wang, Z., Jin, X., Shao, D., Li, R., Zha, H., Ikeuchi, K. (2017). Digital Longmen Project: A Free Walking VR System with Image-Based Restoration. In: Chen, CS., Lu, J., Ma, KK. (eds) Computer Vision – ACCV 2016 Workshops. ACCV 2016. Lecture Notes in Computer Science(), vol 10117. Springer, Cham. https://doi.org/10.1007/978-3-319-54427-4_15
Download citation
DOI: https://doi.org/10.1007/978-3-319-54427-4_15
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-54426-7
Online ISBN: 978-3-319-54427-4
eBook Packages: Computer ScienceComputer Science (R0)