Abstract
In this paper, we present our framework for Augmented and Mixed Reality touristic applications, which we are currently developing with the city of Saarlouis (Germany). It aims to provide tourists and visitors with a new augmented experience to discover the unique history of the city. Whereas most Augmented and Mixed Reality touristic applications are designed for a single user without any human city guide, our app, called SaAR-Louis, offers a more immersive touristic experience as it displays holographic information via Augmented and Mixed Reality on HoloLens/iPad in addition to the explanations of the tour guide. Moreover, thanks to geolocation and 3D scanning of the surroundings, our application provides tourists with the unique experience of discovering 3D reconstructed ancient/old buildings that no longer exist and offers multimodal interaction with a 3D Avatar that gives insights about the historic buildings. In the following, we will explain the app architecture, the pipeline of creating the 3D virtual revival of the city of Saarlouis, and the challenges behind designing, conceiving, implementing, and deploying the SaAR-Louis app.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Poller, P., Chikobava, M., Hodges, J., Kritzler, M., Michahelles, F., Becker, T.: Back-end semantics for multimodal dialog on XR devices. In: Proceedings of the 26th International Conference on Intelligent User Interfaces – Companion, pp. 75–77. ACM, New York (2021)
PeakLens. https://play.google.com/store/apps/details?id=com.peaklens.ar&hl=de&gl=US&pli=1. Accessed 08 Feb 2023
CityGuydApp. https://cityguydapp.com/. Accessed 08 Feb 2023
Efkleidou, K., et al.: Smart eye: an application for in situ accessibility to “invisible” heritage sites. J. Comput. Appl. Archaeol. 5, 286–298 (2022)
Krupke, D., Steinicke, F., Lubos, P., Jonetzko, Y., Görner, M., Zhang, J.: Comparison of multimodal heading and pointing gestures for co-located mixed reality human-robot interaction. In: Proceedings of the 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 1–9. IEEE (2018)
Ens, B., Quigley, A., Yeo, H. S., Irani, P., Piumsomboon, T., Billinghurst, M.: Exploring mixed-scale gesture interaction. In: SIGGRAPH Asia 2017 Posters, pp. 1–2. ACM, New York (2017)
Iacoviello, R., Zappia, D.: HoloCities: a shared reality application for collaborative tourism. In: IOP Conference Series: Materials Science and Engineering, vol. 949, no. 1, pp. 1–8. IOP Publishing (2020)
Egger, R., Neuburger, L.: Augmented, virtual, and mixed reality in tourism. In: Xiang, Z., Fuchs, M., Gretzel, U., Höpken, W. (eds.) Handbook of e-Tourism. Springer, Cham (2022). https://doi.org/10.1007/978-3-030-48652-5_19
Hamburg: Speicherstadt digital. https://www.hamburg.de/bkm/unesco-speicher-kontore/11703088/praktisches-speicherstadt-digital/. Accessed 05 Feb 2023
Sons, K., Demme, G., Herget, W., Slusallek, P.: Fortress city saarlouis: development of an interactive 3D city model using web technologies. In: Traviglia, A. (ed.) Across Space and Time. Papers from the 41st Annual Conference of Computer Applications and Quantitative Methods in Archaeology (CAA), pp. 408–414. Amsterdam University Press, Amsterdam (2013)
A journey to Pfaffenthal in the 19th century. https://www.vdl.lu/en/city/projects-and-commitments/smart-city/smart-living. Accessed 05 Feb 2023
Microsoft HoloLens 2. https://www.microsoft.com/en-us/hololens. Accessed 06 Feb 2023
Mont-Saint-Michel: The historic 3D model comes to life. https://unlocked.microsoft.com/mont-saint-michel/. Accessed 05 Feb 2023
Fraunhofer IGD uses augmented reality to visualize Corvey monastery in its original state. https://www.igd.fraunhofer.de/en/media-center/press-releases/fraunhofer-igd-uses-augmented-reality-to-visualize-corvey-monastery.html. Accessed 05 Feb 2023
Katsaros, K., et al.: Enhancing tourist experiences through 5G – the 5G smart tourism case study. In: Proceedings of the 2019 IEEE 2nd 5G World Forum (5GWF), pp. 471–476. IEEE (2019)
Guo, H.-J., Prabhakaran, B.: HoloLens 2 technical evaluation as mixed reality guide. arXiv:2207.09554 (2022)
Comic Saarlouis – Saarlouis im Fluss der Zeit. https://www.saarlouis.de/leben-in-saarlouis/kultur/stadtisches-museum/comic-saarlouis-im-fluss-der-zeit/alle-staffeln-von-fluxus-zum-download/. Accessed 05 Feb 2023
Community, B.O.: Blender - a 3D modelling and rendering package. Stichting Blender Foundation, Amsterdam (2018). http://www.blender.org
Adobe: Mixamo - Animate 3D characters for games, film, and more. https://www.mixamo.com/
Schenk, T.: Introduction to Photogrammetry. Ohio State University, Columbus (2005)
Koutsoudis, A., Arnaoutoglou, F., Chamzas, C.: On 3D reconstruction of the old city of Xanthi. A minimum budget approach to virtual touring based on photogrammetry. J. Cult. Heritage 8(1), 26–31 (2007)
Talha, A., Fritsch, D.: Integration of laser scanning and photogrammetry in 3D/4D cultural heritage preservation–a review. Int. J. Appl. Sci. Technol. 9(4), 76–91 (2019)
Löckelt, M., Deru, M., Schulz, C.H., Bergweiler, S., Becker, T., Reithinger, N.: A unified approach for semantic-based multimodal interaction. In: Wahlster, W., Grallert, H.-J., Wess, S., Friedrich, H., Widenka, T. (eds.) Towards the Internet of Services: The THESEUS Research Program. CT, pp. 131–144. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-06755-1_11
Porta, D., Deru, M., Bergweiler, S., Herzog, G., Poller, P.: Building multimodal dialog user interfaces in the context of the internet of services. In: Wahlster, W., Grallert, H.-J., Wess, S., Friedrich, H., Widenka, T. (eds.) Towards the Internet of Services: The THESEUS Research Program. CT, pp. 145–162. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-06755-1_12
Acknowledgments
This work was supported by the Project “5G-Inno-SLS” funded by the German Federal Ministry for Digital and Transport (BMDV) under grant number 45FGU105 and the Project “GridAnalysis” funded by the German Federal Ministry for Economic Affairs and Climate Action (BMWK) under grant number 03EI6034D. The authors would like to thank the comic artist Bernd Kissel for supporting us during the 3D conversion of the comic character Fluxus. We also thank the city museum of Saarlouis for their support in providing us with accurate historical documents, and the Architects HDK Dutt & Kist GmbH, Saarbrücken for providing us with current plans from Ravelin V.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Deru, M. et al. (2023). The Virtual Revival of the City of Saarlouis via a Multimodal Augmented/Mixed Reality Touristic HoloLens App. In: Rauterberg, M. (eds) Culture and Computing. HCII 2023. Lecture Notes in Computer Science, vol 14035. Springer, Cham. https://doi.org/10.1007/978-3-031-34732-0_2
Download citation
DOI: https://doi.org/10.1007/978-3-031-34732-0_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-34731-3
Online ISBN: 978-3-031-34732-0
eBook Packages: Computer ScienceComputer Science (R0)