Skip to main content

Virtualization and Vice Versa: A New Procedural Model of the Reverse Virtualization for the User Behavior Tracking in the Virtual Museums

  • Conference paper
  • First Online:
Extended Reality (XR Salento 2022)

Abstract

In this paper we present a method of the user behavior (UB) tracking by capturing and measuring user activities through the defined procedural model of the reverse virtualization process, implementing a proof of concept on a real case scenario: the Civic Gallery of Ascoli. In order to define the universal model of such “vice versa” virtual reality (VR) experience, we assigned particular descriptive functions (descriptors) to each interactive feature of the virtual user space. In this virtualization phase we store user interaction information locally using the web-socket streams protocol, ensuring complete control and manipulation of monitored functions. Our algorithm firstly collects the user interaction data and extracts the descriptors’ arguments into the indexed vector of corresponding variables. The next step determines UB pattern by solving the inverse descriptive functions in combination with an appropriate statistical analysis of gathered data. The final result of the proposed method is the repository of salient data that is used in the further user experience improvement, as well as to enable the museums to distinguish the most important points of the visitor interest in the virtual web tours. Our approach also offers a potential benefit of obtained results in an automatic calculation and prediction of UB patterns using artificial intelligence (AI).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Mortara, M., Eva Catalano, C., Bellotti, F., Fiucci, G., Houry-Panchetti, M., Petridis, P.: Learning cultural heritage by serious games. J. Cult. Herit. 15, 318–325 (2014). https://doi.org/10.1016/j.culher.2013.04.004

    Article  Google Scholar 

  2. Gaitatzes, A., Christopoulos, D., Roussou, M.: Reviving the past. In: Proceedings of the 2001 Conference on Virtual Reality, Archeology, and Cultural Heritage – VAST 2001, p. 103. ACM Press, New York, New York, USA (2001)

    Google Scholar 

  3. Fuhrmann, S., Langguth, F., Moehrle, N., Waechter, M., Goesele, M.: MVE - an image-based reconstruction environment. Comput. Graph. (Pergamon) 53, 44–53 (2015). https://doi.org/10.1016/j.cag.2015.09.003

  4. Garau, C.: From territory to smartphone: smart fruition of cultural heritage for dynamic tourism development. Plann. Pract. Res. 29, 238–255 (2014). https://doi.org/10.1080/02697459.2014.929837

  5. Samaroudi, M., Echavarria, K.R., Perry, L.: Heritage in lockdown: digital provision of memory institutions in the UK and US of America during the COVID-19 pandemic. Museum Manage. Curatorship 35, 337–361 (2020). https://doi.org/10.1080/09647775.2020.1810483

  6. Garlandini, A.: Museums and Heritage in the digital age. The challenge of cultural change and technological innovation. SCIRES-IT – Sci. Res. Inf. Technol. 11, 11–18 (2021). https://doi.org/10.2423/I22394303V11N1P11

  7. Forte, M., Lercari, N., Galeazzi, F., Borra, D.: Metaverse communities and archaeology: the case of Teramo. Digital heritage. In: Third International Conference EuroMed 2010 Dedicated on Digital Heritage. Short Papers. Limassol, Cyprus, 8–13 November 2010 (2010)

    Google Scholar 

  8. Sylaiou, S., Pavlidis, G., Giannini, T., Bowen, J.P.: Museums and digital culture: from reality to digitality in the age of COVID-19. Heritage 5, 192–214 (2022). https://doi.org/10.3390/heritage5010011

  9. Watson, J.B.: Psychology as the behaviourist views it. Psychol. Rev. 20, 158–177 (1913). https://doi.org/10.1037/h0074428

  10. Bekele, M.K., Pierdicca, R., Frontoni, E., Malinverni, E.S., Gain, J.: A survey of augmented, virtual, and mixed reality for cultural heritage. J. Comput. Cult. Heritage 11, 1–36 (2018). https://doi.org/10.1145/3145534

    Article  Google Scholar 

  11. Tcha-Tokey, K., Christmann, O., Loup-Escande, E., Loup, G., Richir, S.: Towards a model of user experience in immersive virtual environments. Adv. Human-Comput. Interact. 2018, 1–10 (2018). https://doi.org/10.1155/2018/7827286

  12. de Freitas, S., Neumann, T.: The use of “exploratory learning” for supporting immersive learning in virtual environments. Comput. Educ. 52, 343–352 (2009). https://doi.org/10.1016/j.compedu.2008.09.010

  13. Pierdicca, R., Sasso, M., Tonetto, F., Bonelli, F., Felicetti, A., Paolanti, M.: Immersive insights: virtual tour analytics system for understanding visitor behavior. In: De Paolis, L.T., Arpaia, P., Bourdot, P. (eds.) AVR 2021. LNCS, vol. 12980, pp. 135–155. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-87595-4_11

    Chapter  Google Scholar 

  14. Angeloni, R., Pierdicca, R., Mancini, A., Paolanti, M., Tonelli, A.: Measuring and evaluating visitors’ behaviors inside museums: the Co.ME. project. SCIRES-IT – Sci. Res. Inf. Technol. 11, 167–178 (2021). https://doi.org/10.2423/I22394303V11N1P167

  15. Quattrini, R., Pierdicca, R., Paolanti, M., Clini, P., Nespeca, R., Frontoni, E.: Digital interaction with 3D archaeological artefacts: evaluating user’s behaviours at different representation scales. Digital Appl. Archaeol. Cult. Heritage. 18, e00148 (2020). https://doi.org/10.1016/j.daach.2020.e00148

  16. Rossi, L., Paolanti, M., Pierdicca, R., Frontoni, E.: Human trajectory prediction and generation using LSTM models and GANs. Pattern Recogn. 120, 108136 (2021). https://doi.org/10.1016/J.PATCOG.2021.108136

    Article  Google Scholar 

  17. Paolanti, M., Pietrini, R., Mancini, A., Frontoni, E., Zingaretti, P.: Deep understanding of shopper behaviours and interactions using RGB-D vision. Mach. Vis. Appl. 31(7–8), 1–21 (2020). https://doi.org/10.1007/s00138-020-01118-w

    Article  Google Scholar 

  18. Fangi, G., Nardinocchi, C.: Photogrammetric processing of spherical panoramas. Photogram. Rec. 28, 293–311 (2013). https://doi.org/10.1111/phor.12031

  19. Xiao, J., Ehinger, K.A., Oliva, A., Torralba, A.: Recognizing scene viewpoint using panoramic place representation. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (2012)

    Google Scholar 

  20. Vasic, I.: Virtual Tour of Civic Art Gallery in Ascoli Piceno. https://dhekalos.it/tour/ascoli/index.html

Download references

Acknowledgments

The authors acknowledge the research presented here is part of Project V.I.T.A. (Virtual Immersion in Territorial Arts), funded by the Marche region and object of the grants among the Dep. DICEA and the cooperatives PULCHRA, TOGHETER WE CARE and GREEN PARK. The authors would like to thank also to the Director of the Civic Gallery of Ascoli, Prof. Stefano Papetti.

The panoramic acquisition and processing were carried out by Luigi Sagone and the TLS acquisition by Floriano Capponi.

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Iva Vasic , Aleksandra Pauls , Adriano Mancini , Ramona Quattrini , Roberto Pierdicca , Renato Angeloni , Eva S. Malinverni , Emanuele Frontoni , Paolo Clini or Bata Vasic .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Vasic, I. et al. (2022). Virtualization and Vice Versa: A New Procedural Model of the Reverse Virtualization for the User Behavior Tracking in the Virtual Museums. In: De Paolis, L.T., Arpaia, P., Sacco, M. (eds) Extended Reality. XR Salento 2022. Lecture Notes in Computer Science, vol 13446. Springer, Cham. https://doi.org/10.1007/978-3-031-15553-6_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-15553-6_23

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-15552-9

  • Online ISBN: 978-3-031-15553-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics