Skip to main content

Mixed Reality and Volumetric Video in Cultural Heritage: Expert Opinions on Augmented and Virtual Reality

  • Conference paper
  • First Online:
Culture and Computing (HCII 2020)

Abstract

Mixed reality (MR) technology is currently growing in popularity for applications in the cultural heritage domain. Furthermore, with the ability to be viewed with six degrees of freedom, volumetric video (VV) is presently being explored as a viable approach to content creation within this area. When combined, MR technology and VV present both practitioners and audiences with innovative approaches to the creation and consumption of both tangible and intangible representations of cultural significance. While there are some existing quantitative studies appraising these new technologies, the precise effects of MR in a cultural heritage context have yet to be fully explored. Here we show the results of a systematic evaluation of MR technology as applied in a cultural heritage context, where subject matter expert interviews were conducted to identify how virtual reality and augmented reality technologies are influencing the creative practices of domain experts and audience engagements with modern dramatic literature. Gathered from high-level stakeholders within the cultural heritage domain, our results highlighted the problems, concerns, and desires of users who must consider this technology in practice. We found that MR and VV content were considered by many to be disruptive technologies for the future of film, theater, and performance practice from the perspectives of both practitioners and audiences. We anticipate that these results will help future MR and VV projects to create meaningful content that is sympathetic to the needs and requirements of creators and audiences.

N. O’Dwyer and G. W. Young—These authors contributed equally.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    VV is a capture and display technique that generates 3D models; the audience can choose their own viewpoint within a scene, thus providing interactive free navigation.

References

  1. ANU\(\_\)Productions: Anu productions (2020). http://anuproductions.ie/. Accessed 24 Feb 2020

  2. Bailenson, J.: Experience on Demand: What Virtual Reality Is, How It Works, and What It Can Do. W.W. Norton & Company, New York (2018)

    Google Scholar 

  3. Beckett, S.: The Complete Dramatic Works. Faber and Faber, London (2006)

    Google Scholar 

  4. Bolter, J.D., Grusin, R., Grusin, R.A.: Remediation: Understanding New Media. MIT Press, Cambridge (2000)

    Google Scholar 

  5. Burdea, G.C., Coiffet, P.: Virtual Reality Technology. Wiley, Hoboken (2003)

    Book  Google Scholar 

  6. Collet, A., et al.: High-quality streamable free-viewpoint video. ACM Trans. Graph. 34(4), 1–13 (2015). https://doi.org/10.1145/2766945

    Article  Google Scholar 

  7. Cronenberg, D.: Videodrome. Movie, 04 February 1983

    Google Scholar 

  8. Esslin, M.: Mediations: Essays on Brecht, Beckett, and the Media. Abacus, London (1983)

    Google Scholar 

  9. Hawley, M.: Laddering: a research interview technique for uncovering core values (2009). https://www.uxmatters.com/mt/archives/2009/07/laddering-a-research-interview-technique-for-uncovering-core-values.php. Accessed 27 Jan 2020

  10. Heider, F., Simmel, M.: An experimental study of apparent behavior. Am. J. Psychol. 57(2), 243–259 (1944)

    Article  Google Scholar 

  11. Johnson, N.: A spectrum of fidelity, an ethic of impossibility: directing Beckett. In: The Plays of Samuel Beckett, pp. 152–164. Bloomsbury/Methuen Drama, London (2013)

    Google Scholar 

  12. Koffka, K.: Principles of Gestalt Psychology. Routledge, London (2013)

    Book  Google Scholar 

  13. Milgram, P., Kishino, F.: A taxonomy of mixed reality visual displays. IEICE Trans. Inf. Syst. 77(12), 1321–1329 (1994)

    Google Scholar 

  14. Nielsen, J.: Usability Engineering. Academic Press, Boston (1993)

    Book  Google Scholar 

  15. O’Dwyer, N., et al.: Virtual play in free-viewpoint video: reinterpreting Samuel Beckett for virtual reality. In: IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct), pp. 262–267 (2017)

    Google Scholar 

  16. O’Dwyer, N. et al.: Beckett in VR: exploring narrative using free viewpoint video. In: ACM SIGGRAPH 2018, pp. 1–2. ACM (2018). https://doi.org/10.1145/3230744.3230774

  17. O’Dwyer, N., Ondřej, J., Pagés, R., Amplianitis, K., Smolić, A.: Jonathan Swift: augmented reality application for Trinity library’s long room. In: Rouse, R., Koenitz, H., Haahr, M. (eds.) ICIDS 2018. LNCS, vol. 11318, pp. 348–351. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-04028-4_39

    Chapter  Google Scholar 

  18. Orts-Escolano, S., et al.: Holoportation: virtual 3D teleportation in real-time. In: Proceedings of the 29th Annual Symposium on User Interface Software and Technology, UIST 2016, pp. 741–754. Association for Computing Machinery, New York (2016). https://doi.org/10.1145/2984511.2984517

  19. Pagés, R., Amplianitis, K., Monaghan, D., Ondřej, J., Smolić, A.: Affordable content creation for free-viewpoint video and VR/AR applications. J. Visual Commun. Image Represent. 53, 192–201 (2018). https://doi.org/10.1016/j.jvcir.2018.03.012

    Article  Google Scholar 

  20. Paradiso, J.A., Landay, J.A.: Guest editors’ introduction: cross-reality environments. IEEE Pervasive Comput. 8(3), 14–15 (2009). https://doi.org/10.1109/MPRV.2009.47

    Article  Google Scholar 

  21. Punch\(\_\)Drunk: Punch drunk international (2019). https://www.punchdrunk.org.uk/. Accessed 24 Feb 2020

  22. Schreer, O., et al.: Capture and 3D video processing of volumetric video. In: IEEE International Conference on Image Processing (ICIP), pp. 4310–4314, September 2019. https://doi.org/10.1109/ICIP.2019.8803576

  23. Smolic, A., et al.: 3D video and free viewpoint video - technologies, applications and MPEG standards. In: IEEE International Conference on Multimedia and Expo (ICME), pp. 2161–2164, July 2006. https://doi.org/10.1109/ICME.2006.262683

  24. Start VR: Awake. https://startvr.co/project/awake/. Accessed 27 Jan 2020

Download references

Acknowledgments

This publication has emanated from research conducted with the financial support of Science Foundation Ireland (SFI) under Grant Number 15/RP/2776.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Néill O’Dwyer .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

O’Dwyer, N., Young, G.W., Johnson, N., Zerman, E., Smolic, A. (2020). Mixed Reality and Volumetric Video in Cultural Heritage: Expert Opinions on Augmented and Virtual Reality. In: Rauterberg, M. (eds) Culture and Computing. HCII 2020. Lecture Notes in Computer Science(), vol 12215. Springer, Cham. https://doi.org/10.1007/978-3-030-50267-6_16

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-50267-6_16

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-50266-9

  • Online ISBN: 978-3-030-50267-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics