Skip to main content

The Virtual Revival of the City of Saarlouis via a Multimodal Augmented/Mixed Reality Touristic HoloLens App

  • Conference paper
  • First Online:
Culture and Computing (HCII 2023)

Abstract

In this paper, we present our framework for Augmented and Mixed Reality touristic applications, which we are currently developing with the city of Saarlouis (Germany). It aims to provide tourists and visitors with a new augmented experience to discover the unique history of the city. Whereas most Augmented and Mixed Reality touristic applications are designed for a single user without any human city guide, our app, called SaAR-Louis, offers a more immersive touristic experience as it displays holographic information via Augmented and Mixed Reality on HoloLens/iPad in addition to the explanations of the tour guide. Moreover, thanks to geolocation and 3D scanning of the surroundings, our application provides tourists with the unique experience of discovering 3D reconstructed ancient/old buildings that no longer exist and offers multimodal interaction with a 3D Avatar that gives insights about the historic buildings. In the following, we will explain the app architecture, the pipeline of creating the 3D virtual revival of the city of Saarlouis, and the challenges behind designing, conceiving, implementing, and deploying the SaAR-Louis app.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Poller, P., Chikobava, M., Hodges, J., Kritzler, M., Michahelles, F., Becker, T.: Back-end semantics for multimodal dialog on XR devices. In: Proceedings of the 26th International Conference on Intelligent User Interfaces – Companion, pp. 75–77. ACM, New York (2021)

    Google Scholar 

  2. PeakLens. https://play.google.com/store/apps/details?id=com.peaklens.ar&hl=de&gl=US&pli=1. Accessed 08 Feb 2023

  3. CityGuydApp. https://cityguydapp.com/. Accessed 08 Feb 2023

  4. Efkleidou, K., et al.: Smart eye: an application for in situ accessibility to “invisible” heritage sites. J. Comput. Appl. Archaeol. 5, 286–298 (2022)

    Google Scholar 

  5. Krupke, D., Steinicke, F., Lubos, P., Jonetzko, Y., Görner, M., Zhang, J.: Comparison of multimodal heading and pointing gestures for co-located mixed reality human-robot interaction. In: Proceedings of the 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 1–9. IEEE (2018)

    Google Scholar 

  6. Ens, B., Quigley, A., Yeo, H. S., Irani, P., Piumsomboon, T., Billinghurst, M.: Exploring mixed-scale gesture interaction. In: SIGGRAPH Asia 2017 Posters, pp. 1–2. ACM, New York (2017)

    Google Scholar 

  7. Iacoviello, R., Zappia, D.: HoloCities: a shared reality application for collaborative tourism. In: IOP Conference Series: Materials Science and Engineering, vol. 949, no. 1, pp. 1–8. IOP Publishing (2020)

    Google Scholar 

  8. Egger, R., Neuburger, L.: Augmented, virtual, and mixed reality in tourism. In: Xiang, Z., Fuchs, M., Gretzel, U., Höpken, W. (eds.) Handbook of e-Tourism. Springer, Cham (2022). https://doi.org/10.1007/978-3-030-48652-5_19

  9. Hamburg: Speicherstadt digital. https://www.hamburg.de/bkm/unesco-speicher-kontore/11703088/praktisches-speicherstadt-digital/. Accessed 05 Feb 2023

  10. Sons, K., Demme, G., Herget, W., Slusallek, P.: Fortress city saarlouis: development of an interactive 3D city model using web technologies. In: Traviglia, A. (ed.) Across Space and Time. Papers from the 41st Annual Conference of Computer Applications and Quantitative Methods in Archaeology (CAA), pp. 408–414. Amsterdam University Press, Amsterdam (2013)

    Google Scholar 

  11. A journey to Pfaffenthal in the 19th century. https://www.vdl.lu/en/city/projects-and-commitments/smart-city/smart-living. Accessed 05 Feb 2023

  12. Microsoft HoloLens 2. https://www.microsoft.com/en-us/hololens. Accessed 06 Feb 2023

  13. Mont-Saint-Michel: The historic 3D model comes to life. https://unlocked.microsoft.com/mont-saint-michel/. Accessed 05 Feb 2023

  14. Fraunhofer IGD uses augmented reality to visualize Corvey monastery in its original state. https://www.igd.fraunhofer.de/en/media-center/press-releases/fraunhofer-igd-uses-augmented-reality-to-visualize-corvey-monastery.html. Accessed 05 Feb 2023

  15. Katsaros, K., et al.: Enhancing tourist experiences through 5G – the 5G smart tourism case study. In: Proceedings of the 2019 IEEE 2nd 5G World Forum (5GWF), pp. 471–476. IEEE (2019)

    Google Scholar 

  16. Guo, H.-J., Prabhakaran, B.: HoloLens 2 technical evaluation as mixed reality guide. arXiv:2207.09554 (2022)

    Google Scholar 

  17. Comic Saarlouis – Saarlouis im Fluss der Zeit. https://www.saarlouis.de/leben-in-saarlouis/kultur/stadtisches-museum/comic-saarlouis-im-fluss-der-zeit/alle-staffeln-von-fluxus-zum-download/. Accessed 05 Feb 2023

  18. Community, B.O.: Blender - a 3D modelling and rendering package. Stichting Blender Foundation, Amsterdam (2018). http://www.blender.org

  19. Adobe: Mixamo - Animate 3D characters for games, film, and more. https://www.mixamo.com/

  20. Schenk, T.: Introduction to Photogrammetry. Ohio State University, Columbus (2005)

    Google Scholar 

  21. Koutsoudis, A., Arnaoutoglou, F., Chamzas, C.: On 3D reconstruction of the old city of Xanthi. A minimum budget approach to virtual touring based on photogrammetry. J. Cult. Heritage 8(1), 26–31 (2007)

    Article  Google Scholar 

  22. Talha, A., Fritsch, D.: Integration of laser scanning and photogrammetry in 3D/4D cultural heritage preservation–a review. Int. J. Appl. Sci. Technol. 9(4), 76–91 (2019)

    Google Scholar 

  23. Löckelt, M., Deru, M., Schulz, C.H., Bergweiler, S., Becker, T., Reithinger, N.: A unified approach for semantic-based multimodal interaction. In: Wahlster, W., Grallert, H.-J., Wess, S., Friedrich, H., Widenka, T. (eds.) Towards the Internet of Services: The THESEUS Research Program. CT, pp. 131–144. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-06755-1_11

    Chapter  Google Scholar 

  24. Porta, D., Deru, M., Bergweiler, S., Herzog, G., Poller, P.: Building multimodal dialog user interfaces in the context of the internet of services. In: Wahlster, W., Grallert, H.-J., Wess, S., Friedrich, H., Widenka, T. (eds.) Towards the Internet of Services: The THESEUS Research Program. CT, pp. 145–162. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-06755-1_12

    Chapter  Google Scholar 

Download references

Acknowledgments

This work was supported by the Project “5G-Inno-SLS” funded by the German Federal Ministry for Digital and Transport (BMDV) under grant number 45FGU105 and the Project “GridAnalysis” funded by the German Federal Ministry for Economic Affairs and Climate Action (BMWK) under grant number 03EI6034D. The authors would like to thank the comic artist Bernd Kissel for supporting us during the 3D conversion of the comic character Fluxus. We also thank the city museum of Saarlouis for their support in providing us with accurate historical documents, and the Architects HDK Dutt & Kist GmbH, Saarbrücken for providing us with current plans from Ravelin V.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Matthieu Deru .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Deru, M. et al. (2023). The Virtual Revival of the City of Saarlouis via a Multimodal Augmented/Mixed Reality Touristic HoloLens App. In: Rauterberg, M. (eds) Culture and Computing. HCII 2023. Lecture Notes in Computer Science, vol 14035. Springer, Cham. https://doi.org/10.1007/978-3-031-34732-0_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-34732-0_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-34731-3

  • Online ISBN: 978-3-031-34732-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics