Skip to main content
SpringerLink
Log in

Mixed reality system for nondestructive evaluation training

  • Original Article
  • Published:
Virtual Reality Aims and scope Submit manuscript

Abstract

nondestructive evaluation (NDE) is an analysis technique used to evaluate the properties of a material, component, structure or system without causing damage. In this paper, we introduce a novel mixed reality system for NDE training. In particular, we model and simulate the inspected object and the inspection probe. The operator trainees with the wearable headsets are able to move and zoom the inspected object in a mixed environment, i.e., reality with virtual objects overlaid. In addition, the trainees use their gaze, gesture, and voice to control and interact with the virtual objects within the NDE training session. They can also access the help manual in order to follow the training instruction. The system is successfully operated on HoloLens, the state-of-the-art mixed reality headset. Evaluational results demonstrate that the use of mixed reality training provides significant benefit for the potential technician trainees.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Notes

  1. https://www.creaform3d.com.

  2. Alternatively, the captured photographs can be fed into a free off-the-shelf SfM software/service like Autodesk Recap 360 (https://www.autodesk.com/products/recap/overview) to turn the photos into a 3D model.

  3. https://docs.microsoft.com/en-us/windows/mixed-reality/text-in-unity.

  4. https://unity3d.com/partners/microsoft/mixed-reality.

References

  • Amza CG, Zapciu A, Teodorescu O (2018) Augmented reality application for industrial nondestructive inspection training. In: AIP conference proceedings, vol. 1932, pp 030002. AIP Publishing LLC

  • Amza CG, Zapciu A, Teodorescu O (2018) Augmented reality application for industrial nondestructive inspection training. In: Proceedings of international conference on structural analysis of advanced materials, pp 1–4

  • Autodesk recap 360. https://www.autodesk.com/products/recap/overview, Retrieved 21 May 2020

  • Avgoustinov N, Boller C, Dobmann G, Wolter B (2011) Virtual reality in planning of nondestructive testing solutions. In: Bernard A (ed) Global product development. Springer, Berlin, pp 705–710

    Chapter  Google Scholar 

  • Bohil C, Owen CB, Jeong E, Alicea B, Biocca F (2009) Virtual reality and presence. In: Twenty first century communication: a reference handbook, pp 534–544

  • Bozgeyikli L, Bozgeyikli E, Aguirrezabal A, Alqasemi R, Raij A, Sundarrao S, Dubey RV (2018) Using immersive virtual reality serious games for vocational rehabilitation of individuals with physical disabilities. In: Proceedings of HCI conference, pp 48–57

  • Burdea GC, Coiffet P (2003) Virtual reality technology. John Wiley & Sons, New Jersey

    Book  Google Scholar 

  • Carmigniani J, Furht B, Anisetti M, Ceravolo P, Damiani E, Ivkovic M (2011) Augmented reality technologies, systems and applications. Multimed Tools Appl 51(1):341–377

    Article  Google Scholar 

  • Christou CG, Michael-Grigoriou D, Sokratous D (2018) Virtual buzzwire: Assessment of a prototype VR game for stroke rehabilitation. In: 2018 IEEE conference on virtual reality and 3D user interfaces, VR, pp 531–532

  • Crescenzio FD, Fantini M, Persiani F, di Stefano L, Azzari P, Salti S (2011) Augmented reality for aircraft maintenance training and operations support. IEEE Comput Gr Appl 31(1):96–101

    Article  Google Scholar 

  • Epson Moverio glasses. https://epson.com/moverio-augmented-reality, Retrieved 21 May 2020

  • Eschen H, Kötter T, Rodeck R, Harnisch M, Schüppstuhl T (2018) Augmented and virtual reality for inspection and maintenance processes in the aviation industry. Procedia Manuf 19:156–163

    Article  Google Scholar 

  • Fiorentino M, Uva AE, Gattullo M, Debernardis S, Monno G (2014) Augmented reality on large screen for interactive maintenance instructions. Comput Ind 65(2):270–278

    Article  Google Scholar 

  • Gopalan V, Zulkifli AN, Abubakar J (2016) A study of students motivation based on ease of use, engaging, enjoyment and fun using the augmented reality science textbook. J Fac Eng 31:27–35

    Google Scholar 

  • Henderson SJ, Feiner S (2009) Evaluating the benefits of augmented reality for task localization in maintenance of an armored personnel carrier turret. In: IEEE international symposium on mixed and augmented reality, pp 135–144

  • Henderson SJ, Feiner S (2011) Exploring the benefits of augmented reality documentation for maintenance and repair. IEEE Trans Vis Comput Gr. 17(10):1355–1368

    Article  Google Scholar 

  • HoloLens Mixed Reality documentation. https://docs.microsoft.com/en-us/windows/mixed-reality/, Retrieved 21 May 2020

  • HTC Vive. https://www.vive.com/us/, Retrieved 21 May 2020

  • Kaur K (1997) Designing virtual environments for usability. In: International conference on human-computer interaction, pp 636–639

  • Kim J, Mandayam S, Udpa S, Lord W, Udpa L (1996) Virtual reality for nondestructive evaluation applications. In: Review of progress in quantitative nondestructive evaluation, pp 897–902. Springer

  • Ma M, Jain LC, Anderson P et al (2014) Virtual, augmented reality and serious games for healthcare 1, vol 1. Springer, Berlin

    Book  Google Scholar 

  • Magic Leap One. https://www.magicleap.com, Retrieved 21 May 2020

  • MeshLab. http://www.meshlab.net/, Retrieved 21 May 2020

  • Microsoft HoloLens | Mixed Reality Technology. https://www.microsoft.com/en-us/hololens, Retrieved 21 May 2020

  • Milgram P, Kishino F (1994) A taxonomy of mixed reality visual displays. IEICE Trans Inf Syst 77(12):1321–1329

    Google Scholar 

  • Moro C, Stromberga Z, Raikos A, Stirling A (2017) The effectiveness of virtual and augmented reality in health sciences and medical anatomy. Anat Sci Edu 10(6):549–559

    Article  Google Scholar 

  • Nguyen TV, Liu S, Ni B, Tan J, Rui Y, Yan S (2012) Sense beauty via face, dressing, and/or voice. In: Proceedings of the 20th ACM multimedia conference, MM ’12, Nara, Japan, October 29–November 02, 2012, pp 239–248

  • Nguyen TV, Mirza B, Tan D, Sepulveda J (2018) ASMIM: augmented reality authoring system for mobile interactive manuals. In: Proceedings of international conference on ubiquitous information management and communication, pp 3:1–3:6

  • Nguyen TV, Sepulveda J (2016) Augmented immersion: video cutout and gesture-guided embedding for gaming applications. J Multimed Tools Appl 75(20):12351–12363

    Article  Google Scholar 

  • Nguyen TV, Tan D, Mirza B, Sepulveda J (2016) MARIM: mobile augmented reality for interactive manuals. In: Proceedings of ACM conference on multimedia conference, pp 689–690

  • Oculus Rift. https://www.oculus.com, Retrieved 21 May 2020

  • Omer M, Hewitt S, Hadi Mosleh M, Margetts L, Parwaiz M (2018) Performance evaluation of bridges using virtual reality. In: Proceedings of European conference on computational mechanics, pp 1–12, 06

  • PlayStation VR. https://www.playstation.com/en-us/explore/playstation-vr/, Retrieved 21 May 2020

  • Pokemon Go. https://www.pokemongo.com/en-us/, Retrieved 21 May 2020

  • Samsung Gear VR. https://www.samsung.com/global/galaxy/gear-vr/specs/, Retrieved 21 May 2020

  • Second Life. https://secondlife.com/, Retrieved 21 May 2020

  • Suárez-Warden F, Rodriguez M, Hendrichs N, García-Lumbreras S, Mendívil EG (2015) Small sample size for test of training time by augmented reality: an aeronautical case. Procedia Comput Sci 75:17–27

    Article  Google Scholar 

  • The Best VR Headsets for PC. https://thewirecutter.com/reviews/best-desktop-virtual-reality-headset/, Retrieved 21 May 2020

  • UDRI’s Nondestructive Evaluation (NDE). https://udayton.edu/udri/capabilities/materials/nondestructive_evaluation.php, Retrieved 21 May 2020

  • Urbasa U, Vrabiča R, Vukašinovića N (2019) Displaying product manufacturing information in augmented reality for inspection. Procedia CIRP 81:832–837

    Article  Google Scholar 

  • Valve Index VR. https://store.steampowered.com/valveindex, Retrieved 21 May 2020

  • What are augmented reality markers? https://anymotion.com/en/wissensgrundlagen/augmented-reality-marker, Retrieved 21 May 2020

  • Wikitude geo-based augmented reality. https://www.wikitude.com/geo-augmented-reality/, Retrieved 21 May 2020

  • Wilcoxon F (1992) Individual comparisons by ranking methods. In: Breakthroughs in statistics, pp 196–202. Springer

Download references

Acknowledgements

This project is funded under National Science Foundation (NSF) under Grant No. 2025234 and UD/UDRI Research Fellowship Program.

Author information

Authors and Affiliations

  1. Department of Computer Science, University of Dayton, Dayton, USA

    Tam V. Nguyen, Somaraju Kamma & Vamsi Adari

  2. NDE Engineering Group, University of Dayton Research Institute, Dayton, USA

    Tyler Lesthaeghe, Thomas Boehnlein & Victoria Kramb

Authors
  1. Tam V. Nguyen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Somaraju Kamma
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Vamsi Adari
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Tyler Lesthaeghe
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Thomas Boehnlein
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Victoria Kramb
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Tam V. Nguyen.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Nguyen, T.V., Kamma, S., Adari, V. et al. Mixed reality system for nondestructive evaluation training. Virtual Reality 25, 709–718 (2021). https://doi.org/10.1007/s10055-020-00483-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10055-020-00483-1

Keywords

Search

Navigation