Skip to main content

Multimodal Interactive System for Visualization of Energy Data in Extended Reality (XR) Settings

  • Conference paper
  • First Online:
HCI International 2023 Posters (HCII 2023)

Abstract

The municipal utility supervises all aspects of the city's public utilities, e.g., the power grid. For example, power grid maintenance requires the technician to know where underground cables are installed while having their hands free for maintenance work. Using an immersive headset such as HoloLens provides a technician with these capabilities. This contribution presents DENKI (Data, Energy, Network, Knowledge, Interaction). This HoloLens application supports technicians of the municipal utility “Stadtwerke Saarlouis GmbH” with a detailed overview of the equipment, its utilization, and possibilities to investigate malfunctions. We will exemplify some app functions.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Brandherm, B., Deru, M., Ndiaye, A., et al.: Integration of renewable energies—AI-based prediction methods for electricity generation from photovoltaic systems. In: Barton, T., Müller, C. (eds.) Apply Data Science: Introduction, Applications and Projects, pp. 137–158. Springer Fachmedien, Wiesbaden (2023). https://doi.org/10.1007/978-3-658-38798-3_9

    Chapter  Google Scholar 

  2. Poller, P., Chikobava, M., Hodges, J., et al.: Back-end semantics for multimodal dialog on XR devices (2021)

    Google Scholar 

  3. Prange, A., Chikobava, M., Poller, P., et al.: A multimodal dialogue system for medical decision support inside virtual reality. In: Proceedings of the 18th Annual SIGdial Meeting on Discourse and Dialogue. pp. 23–26 (2017)

    Google Scholar 

  4. Lawson, S.W., Pretlove, J.R.G.: Augmented reality for underground pipe inspection and maintenance. In: Telemanipulator and Telepresence Technologies V. SPIE, pp. 98–104 (1998)

    Google Scholar 

  5. Stylianidis, E., et al.: Augmented reality geovisualisation for underground utilities. PFG – J. Photogrammetry Remote Sens. Geoinf. Sci. 88(2), 173–185 (2020). https://doi.org/10.1007/s41064-020-00108-x

    Article  Google Scholar 

  6. Schall, G., Zollmann, S., Reitmayr, G.: Smart Vidente: advances in mobile augmented reality for interactive visualization of underground infrastructure. Pers. Ubiquitous Comput. 17, 1533–1549 (2013). https://doi.org/10.1007/s00779-012-0599-x

    Article  Google Scholar 

  7. Soria, G., Ortega Alvarado, L.M., Feito, F.R.: Augmented and virtual reality for underground facilities management. J. Comput. Inf. Sci. Eng. 18, 041008 (2018). https://doi.org/10.1115/1.4040460

    Article  Google Scholar 

  8. Kolaei, A.Z., Hedayati, E., Khanzadi, M., Amiri, G.G.: Challenges and opportunities of augmented reality during the construction phase. Autom. Constr. 143, 104586 (2022). https://doi.org/10.1016/j.autcon.2022.104586

    Article  Google Scholar 

  9. Schall, G., Mendez, E., Kruijff, E., et al.: Handheld augmented reality for underground infrastructure visualization. Pers. Ubiquitous Comput. 13, 281–291 (2009). https://doi.org/10.1007/s00779-008-0204-5

    Article  Google Scholar 

  10. Deru, M., Ndiaye, A.: Deep learning MIT TensorFlow, Keras und TensorFlow.js. Rheinwerke Computing (2022)

    Google Scholar 

  11. Schmeyer, T., Kiefer, G.-L., Brandherm, B., et al.: Assistance system for AI-based monitoring and prediction in smart grids (2023)

    Google Scholar 

  12. Shneiderman, B., Plaisant, C., Cohen, M., et al.: Designing the User Interface: Strategies for Effective Human-Computer Interaction, 6th Ed. CCE Fac Books Book Chapters (2016)

    Google Scholar 

  13. Botín-Sanabria, D.M., Mihaita, A.-S., Peimbert-García, R.E., et al.: Digital twin technology challenges and applications: a comprehensive review. Remote Sens. 14, 1335 (2022). https://doi.org/10.3390/rs14061335

    Article  Google Scholar 

Download references

Acknowledgement

This work was supported by the Project “5G-Inno-SLS” funded by the German Federal Ministry for Digital and Transport (BMDV) under grant number 45FGU105 and the Project “GridAnalysis” funded by the German Federal Ministry for Economic Affairs and Climate Action (BMWK) under grant number 03EI6034D.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Margarita Chikobava .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Chikobava, M. et al. (2023). Multimodal Interactive System for Visualization of Energy Data in Extended Reality (XR) Settings. In: Stephanidis, C., Antona, M., Ntoa, S., Salvendy, G. (eds) HCI International 2023 Posters. HCII 2023. Communications in Computer and Information Science, vol 1836. Springer, Cham. https://doi.org/10.1007/978-3-031-36004-6_22

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-36004-6_22

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-36003-9

  • Online ISBN: 978-3-031-36004-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics