Skip to main content
SpringerLink
Log in

On-site immersive visualization and rapid degradation annotation for mural degradation interactive analysis

  • Regular Paper
  • Published:
Journal of Visualization Aims and scope Submit manuscript

Abstract

On-site investigation is a natural efficient way to cognize tangible, while immersive visualization engages human senses to percept information from data. Hence on-site immersive visualization is able to provide a better stereo environment for enhancing the understanding of real scene and gathering insight. With the development of technology, optical see-through head-mounted devices can help researchers achieve the goals. However, worldwide ancient murals suffer from various degradations related to compound environmental factors, which requires interdisciplinary researches. And because of the importance of on-site investigation in heritage protection field, on-site visualization has to meet the requirements of relative professors. In this paper, we present a novel mixed reality, on-site immersive mural degradation visualization solution for analyzing relevance between degradation and environment data. And a rapid, simple, low-cost and interactive method of degradation contour annotation is provided to solve the data sparse problem of standard degradation data. To demonstrate the visualization solution and the annotation method, two application results with real data from Mogao Grottoes and domain-expert feedback are given. The solution is on-site, immersive oriented and integrates secure designs for heritages. Our solution is flexible and effective so that it can provide a better data analysis environment than conventional planar visualizations. It also provides a promising way to change work styles.

Graphical abstract

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  • Arnold D (2014) Computer graphics and cultural heritage, part 2: continuing inspiration for future tools. IEEE Comput Gr Appl 34(4):70–79. https://doi.org/10.1109/MCG.2014.65

    Article  Google Scholar 

  • Bobick AF, Intille SS, Davis JW, Baird F, Pinhanez CS, Campbell LW, Ivanov YA, Schutte A, Wilson A (1999) The kidsroom: A perceptually-based interactive and immersive story environment. Presence Teleop Virt Environ 8(4):369–393

    Article  Google Scholar 

  • Cohen-Bendahan CCC, Beijers R, van Doornen LJP, de Weerth C (2015) Explicit and implicit caregiving interests in expectant fathers: do endogenous and exogenous oxytocin and vasopressin matter? Infant Behav Dev 41:26–37. https://doi.org/10.1016/j.infbeh.2015.06.007

    Article  Google Scholar 

  • Colizzi L, Pascalis FD, Fassi F (2007) 3d visualization and virtual reality for cultural heritage diagnostic. Conserv Sci Cult Heritage Hist Tech J 7(1):629–639

    Google Scholar 

  • Ermi L, Mayra F (2005) Fundamental components of the gameplay experience: analysing immersion. In: Digital games research conference 2005, Changing Views: Worlds in Play, June 16-20, 2005, Vancouver, British Columbia, Canada

  • Feng W, Tian FP, Zhang Q, Sun J (2016) 6d dynamic camera relocalization from single reference image. In: Computer vision and pattern recognition

  • Gordan M, Dancea O, Vlaicu A, Stoian I, Tsatos O (2008) Computer vision based decision support tool for hydro-dams surface deterioration assessment and visualization using fuzzy sets and pseudo-coloring 3:207–212

  • Guo Q, Wang X, Xue P, Zhang G, Fan Z, Hou W, Zhang Z (2009) Research on spatial distribution and relations of salinity and moisture content inside rock mass of low-layer caves in Dunhuang Mogao Grottoes. Chin J Rock Mech Eng 28(SUPPL. 2):3769–3775

    Google Scholar 

  • Kim W, Kerle N, Gerke M (2016) Mobile augmented reality in support of building damage and safety assessment. Nat Hazards Earth Syst Sci 16(1):287–298. https://doi.org/10.5194/nhess-16-287-2016

    Article  Google Scholar 

  • Lawonn K, Trostmann E, Preim B, Hildebrandt K (2017) Visualization and extraction of carvings for heritage conservation. IEEE Trans Visual Comput Graphics 23(1):801–810. https://doi.org/10.1109/TVCG.2016.2598603

    Article  Google Scholar 

  • Li H, Zhang J, Sun J (2016) A visual analytics approach for deterioration risk analysis of ancient frescoes. J Vis 19(3):529–542. https://doi.org/10.1007/s12650-015-0327-5

    Article  Google Scholar 

  • Li J, Zhang H, Fan Z, He X, He S, Sun M, Ma Y, Fang S, Zhang H, Zhang B (2013) Investigation of the renewed diseases on murals at mogao grottoes. Heritage Sci. https://doi.org/10.1186/2050-7445-1-31

    Google Scholar 

  • Liang H, Lucian A, Lange R, Cheung C, Su B (2014) Remote spectral imaging with simultaneous extraction of 3d topography for historical wall paintings. ISPRS J Photogramm Remote Sens 95:13–22. https://doi.org/10.1016/j.isprsjprs.2014.05.011

    Article  Google Scholar 

  • Liang X, Lu M, Zhang JP (2011) On-site visualization of building component erection enabled by integration of four-dimensional modeling and automated surveying. Autom Constr 20(3):236–246. https://doi.org/10.1016/j.autcon.2010.10.002

    Article  Google Scholar 

  • Lu D, Wang Z, Zhang D, Sun M (2015) System for hyperspectral data analysis, visualization and fresco deterioration detection. In: IEEE International conference on multimedia big data, pp 312–317

  • Malkawi A, Srinivasan R, Jackson B, Yi Y (2004) Interactive, immersive visualization for indoor environments: use of augmented reality, human–computer interaction and building simulation. In: Information visualisation, eighth international conference, pp 833–838

  • Mcmaster T (1990) Flow: the psychology of optimal experience (book). Library Journal

  • Nurminen A, Kruijff E, Veas E (2011) Hydrosys - a mixed reality platform for on-site visualization of environmental data. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics), vol 6574 LNCS, pp 159–175. https://doi.org/10.1007/978-3-642-19173-2-13

  • Schattel D, Tonnis M, Klinker G, Schubert G, Petzold F (2014) On-site augmented collaborative architecture visualization. In: ISMAR 2014 - IEEE International Symposium on Mixed and Augmented Reality - Science and Technology 2014, Proceedings, pp 369–370, https://doi.org/10.1109/ISMAR.2014.6948493

  • Schettino P (2015) Re-defining the concept of immersion in digital immersive environments: patterns emerging from qualitative data analysis and theoretical comparison with previous theories on immersion. In: 2015 Digital heritage international congress, digital heritage 2015, pp 409–412, https://doi.org/10.1109/DigitalHeritage.2015.7419536

  • Stanney KM, Kennedy RS, Drexler JM, Harm DL (1999) Motion sickness and proprioceptive aftereffects following virtual environment exposure. Appl Ergon 30(1):27–38. https://doi.org/10.1016/S0003-6870(98)00039-8

    Article  Google Scholar 

  • Vlahakis V, Karigiannis J, Ioannidis N, Tsotros M, Gounaris M, Sticker D, Daehne P, Almeida L (2002) 3d interactive, on-site visualization of ancient olympia. In: Proceedings - 1st international symposium on 3D data processing visualization and transmission, 3DPVT 2002, pp 337–345, https://doi.org/10.1109/TDPVT.2002.1024080

  • Yapo TC, Sheng Y, Nasman J, Dolce A, Li E, Cutler B (2010) Dynamic projection environments for immersive visualization. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops, CVPRW 2010, pp 1–8, https://doi.org/10.1109/CVPRW.2010.5543463

  • Zhang J, Kang K, Liu D, Yuan Y, Yanli E (2013) Vis4heritage: visual analytics approach on grotto wall painting degradations. IEEE Trans Visual Comput Graphics 19(12):1982–1991. https://doi.org/10.1109/TVCG.2013.219

    Article  Google Scholar 

  • Zhang Y, Zhang Z, Sun M, Ke T (2011) Precise orthoimage generation of Dunhuang wall painting. Photogramm Eng Remote Sens 77(6):631–640

    Article  Google Scholar 

  • Zhang Y, Hu K, Huang R (2012) Bundle adjustment with additional constraints applied to imagery of the dunhuang wall paintings. ISPRS J Photogramm Remote Sens 72:113–120. https://doi.org/10.1016/j.isprsjprs.2012.06.008

    Article  Google Scholar 

  • Zollmann S, Kalkofen D, Hoppe C, Kluckner S, Bischof H, Reitmayr G (2012) Interactive 4d overview and detail visualization in augmented reality. In: ISMAR 2012 - 11th IEEE international symposium on mixed and augmented reality 2012, science and technology papers, pp 167–176, https://doi.org/10.1109/ISMAR.2012.6402554

Download references

Acknowledgements

The authors wish to thank Prof. Xin Tong, Dr. Yue Dong, Microsoft Research Asia, for discussions with us. We appreciate Xudong Wang, Bomin Su, Xiaowei Wang and Bolong Chai and all the Dunhuang Academics, for providing us the Dunhuang Mogao wall painting survey data. We also thank the anonymous reviewers for their helpful suggestions and comments. This project is funded by Microsoft Research Asia through grants “Holo-Heritage: Dunhuang Cultural Heritage Conservation Research and Development based on Microsoft Hololens”.

Author information

Authors and Affiliations

  1. Tianjin University, Tianjin, China

    Jiawan Zhang & Han Tao

Authors
  1. Jiawan Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Han Tao
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jiawan Zhang.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, J., Tao, H. On-site immersive visualization and rapid degradation annotation for mural degradation interactive analysis. J Vis 21, 841–855 (2018). https://doi.org/10.1007/s12650-018-0492-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12650-018-0492-4

Keywords

Search

Navigation