Skip to main content
SpringerLink
Log in

Interacting with FEM Simulated Tubes in AR

  • Conference paper
  • First Online:
Book cover HCI International 2021 - Late Breaking Papers: Multimodality, eXtended Reality, and Artificial Intelligence (HCII 2021)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 13095))

Included in the following conference series:

  • 1604 Accesses

Abstract

This paper presents the results of a study the authors conducted to identify the opportunities and challenges of interfacing complex engineering simulations run on dedicated systems with mobile devices visualizing the simulation results and providing inputs in real-time. We build upon an existing finite element method (FEM) simulation, which we tuned to deliver snapshots to an Augmented Reality (AR) application for real-time visualization. On this basis we develop interaction designs for tablets and Optical See-Through Head-Mounted Displays (OST-HMD) utilizing the interaction methods available on such mobile devices to manipulate FEM simulated tubes in AR, as well as an evaluation of these interaction designs.

Our design goal is an intuitive workflow concept that allows usage of an AR application without training overhead. To this end we introduce movable proxies on the virtual tube that provide the simulation with input data. Since the described client devices belong to very different device classes, we show intuitive interaction designs for all of them.

Our client application is supposed to be run at the tube installation site, so we can not rely on stable high bandwidth connections to the simulation server in every case. Therefore, we implemented an asynchronous communication, enabling the use with reduced update rates.

Our system enables the user to quickly reconfigure tube configurations and compare different approaches. At the same time the interaction is intuitive so training the user is unnecessary.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://visionlib.com/.

  2. 2.

    https://www.cgal.org/.

  3. 3.

    https://developer.nvidia.com/cuda-zone.

  4. 4.

    https://unity.com/unity/features/arfoundation.

  5. 5.

    https://developers.google.com/protocol-buffers.

  6. 6.

    https://github.com/eidheim/Simple-WebSocket-Server.

  7. 7.

    https://github.com/endel/NativeWebSocket.

  8. 8.

    https://github.com/microsoft/MixedRealityToolkit-Unity.

References

  1. Huang, J., Ong, S.K., Nee, A.Y.: Visualization and interaction of finite element analysis in augmented reality. Comput. Aided Des. 84, 1–14 (2017)

    Article  Google Scholar 

  2. Fiorentino, M., Monno, G., Uva, A.: Interactive “touch and see’’ fem simulation using augmented reality. Int. J. Eng. Educ. 25(6), 1124–1128 (2009)

    Google Scholar 

  3. Olbrich, M., Wuest, H., Riess, P., Bockholt, U.: Augmented reality pipe layout planning in the shipbuilding industry. In: 2011 10th IEEE International Symposium on Mixed and Augmented Reality, pp. 269–270 (2011)

    Google Scholar 

  4. Weber, D., Kalbe, T., Stork, A., Fellner, D., Goesele, M.: Interactive deformable models with quadratic bases in Bernstein-Bézier-form. Vis. Comput. 27, 473–483 (2011)

    Article  Google Scholar 

  5. Weber, D., Mueller-Roemer, J., Altenhofen, C., Stork, A., Fellner, D.: Deformation simulation using cubic finite elements and efficient p-multigrid methods. Comput. Graph. 53(PB), 185–195 (2015)

    Google Scholar 

  6. Müller, M., Gross, M.: Interactive virtual materials. In: Proceedings of Graphics Interface 2004, GI 2004, School of Computer Science, University of Waterloo, Waterloo, Ontario, Canada, Canadian Human-Computer Communications Society, pp. 239–246 (2004)

    Google Scholar 

  7. Weber, D., Bender, J., Schnoes, M., Stork, A., Fellner, D.: Efficient GPU data structures and methods to solve sparse linear systems in dynamics applications. Comput. Graph. Forum 32(1), 16–26 (2013)

    Article  Google Scholar 

  8. Baraff, D., Witkin, A.: Large steps in cloth simulation. Comput. Graph. 32, 43–54 (1998)

    Google Scholar 

  9. Mueller-Roemer, J.S., Stork, A.: GPU-based polynomial finite element matrix assembly for simplex meshes. Comput. Graph.Forum 37(7), 443–454 (2018)

    Article  Google Scholar 

  10. Keil, J., Schmitt, F., Engelke, T., Graf, H., Olbrich, M.: Augmented reality views: discussing the utility of visual elements by mediation means in industrial AR from a design perspective. In: HCI (2018)

    Google Scholar 

  11. Leonard, J., Durrant-Whyte, H.: Simultaneous map building and localization for an autonomous mobile robot. In: Proceedings IROS 1991: IEEE/RSJ International Workshop on Intelligent Robots and Systems, vol. 3, pp. 1442–1447 (1991)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Fraunhofer IGD, Darmstadt, Germany

    Manuel Olbrich, Andreas Franek & Daniel Weber

  2. TU Darmstadt, Darmstadt, Germany

    Manuel Olbrich, Andreas Franek & Daniel Weber

Authors
  1. Manuel Olbrich
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Andreas Franek
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Daniel Weber
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Manuel Olbrich .

Editor information

Editors and Affiliations

  1. University of Creteand Foundation for Research and Technology – Hellas (FORTH), Heraklion, Crete, Greece

    Constantine Stephanidis

  2. The Open University of Japan, Chiba, Japan

    Masaaki Kurosu

  3. U.S. Army Research Laboratory, Aberdeen Proving Ground, MD, USA

    Jessie Y. C. Chen

  4. U.S. Army Combat Capabilities Development Command Soldier Center, Orlando, FL, USA

    Gino Fragomeni

  5. Smart Future Initiative, Frankfurt am Main, Hessen, Germany

    Norbert Streitz

  6. Faculty of Arts and Science, Kyushu University, Fukuoka, Japan

    Shin'ichi Konomi

  7. Siemens (United States), Princeton, NJ, USA

    Helmut Degen

  8. Foundation for Research and Technology – Hellas (FORTH), Heraklion, Crete, Greece

    Stavroula Ntoa

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Olbrich, M., Franek, A., Weber, D. (2021). Interacting with FEM Simulated Tubes in AR. In: Stephanidis, C., et al. HCI International 2021 - Late Breaking Papers: Multimodality, eXtended Reality, and Artificial Intelligence. HCII 2021. Lecture Notes in Computer Science(), vol 13095. Springer, Cham. https://doi.org/10.1007/978-3-030-90963-5_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-90963-5_23

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-90962-8

  • Online ISBN: 978-3-030-90963-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation