Skip to main content
SpringerLink
Log in
Book cover

International Conference on Augmented Reality, Virtual Reality and Computer Graphics

AVR 2019: Augmented Reality, Virtual Reality, and Computer Graphics pp 43–59Cite as

Exploring the Benefits of the Virtual Reality Technologies for Assembly Retrieval Applications

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 11613))

Abstract

Virtual reality technologies offer several intuitive and natural interactions that can be used to enhance and increase awareness during the different phases of the product design, such as the virtual prototyping or the project reviews. In this work, we focus on the benefits of virtual reality environments for assembly retrieval applications, which usually are employed to reuse existing CAD models by operating minor modifications. The retrieval system adopted to evaluate the different similarity among CAD assemblies is able to detect three different similarity criteria (i.e. shape, joint and position) at different levels (globally and locally). Considering the complexity of assembly models, conveying these different types of information simultaneously is quite difficult, especially through the traditional desktop systems. Hence, this paper presents a system for the visualization and the inspection of the results returned by a retrieval system with the aim of easing the analysis especially when the retrieved objects to analyze are complex. The proposed tool exploits the 3D space to represent and communicate the different types of similarity and gestures as well as voice commands to interact in the VR environment. Finally, the usability of the system has been tested over a sample of interviewers, who used the system and the different functionalities provided and then expressed their judgment filling out a questionnaire. The results indicate that user are able to interpret the different similarity criteria and that the gestures help acting in a natural manner.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   79.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Abraham, L., Urru, A., Normani, N., Wilk, M., Walsh, M., O’Flynn, B.: Hand tracking and gesture recognition using lensless smart sensors. Sensors 18(9), 2834 (2018)

    Article  Google Scholar 

  2. Abulrub, A.H.G., Attridge, A.N., Williams, M.A.: Virtual reality in engineering education: the future of creative learning. In: 2011 IEEE Global Engineering Education Conference (EDUCON), pp. 751–757. IEEE (2011)

    Google Scholar 

  3. Argelaguet, F., Andujar, C.: A survey of 3D object selection techniques for virtual environments. Comput. Graph. 37(3), 121–136 (2013)

    Article  Google Scholar 

  4. Bachmann, D., Weichert, F., Rinkenauer, G.: Review of three-dimensional human-computer interaction with focus on the leap motion controller. Sensors 18(7), 2194 (2018)

    Article  Google Scholar 

  5. Beattie, N., Horan, B., McKenzie, S.: Taking the leap with the oculus hmd and CAD-plucking at thin air? Proc. Technol. 20, 149–154 (2015)

    Article  Google Scholar 

  6. Bordegoni, M.: Product Virtualization: An Effective Method for the Evaluation of Concept Design of New Products, pp. 117–141. Springer, London (2011). https://doi.org/10.1007/978-0-85729-775-4_7

    Book  Google Scholar 

  7. Bougaa, M., Bornhofen, S., Kadima, H., Rivière, A.: Virtual reality for manufacturing engineering in the factories of the future. Appl. Mech. Mater. 789, 1275–1282 (2015)

    Article  Google Scholar 

  8. Bourdot, P., Convard, T., Picon, F., Ammi, M., Touraine, D., Vézien, J.M.: VR-CAD integration: multimodal immersive interaction and advanced haptic paradigms for implicit edition of CAD models. Comput. Aided Des. 42(5), 445–461 (2010)

    Article  Google Scholar 

  9. Caggianese, G., Gallo, L., Neroni, P.: An investigation of leap motion based 3D manipulation techniques for use in egocentric viewpoint. In: De Paolis, L.T., Mongelli, A. (eds.) AVR 2016. LNCS, vol. 9769, pp. 318–330. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-40651-0_26

    Chapter  Google Scholar 

  10. Choi, S., Jung, K., Noh, S.D.: Virtual reality applications in manufacturing industries: past research, present findings, and future directions. Concur. Eng. 23(1), 40–63 (2015)

    Article  Google Scholar 

  11. Choi, S., Cheung, H.: A versatile virtual prototyping system for rapid product development. Comput. Ind. 59(5), 477–488 (2008)

    Article  Google Scholar 

  12. Cook, M.: Virtual serendipity: preserving embodied browsing activity in the 21st century research library. J. Acad. Librariansh. 44(1), 145–149 (2018)

    Article  Google Scholar 

  13. Cordeiro, E., Giannini, F., Monti, M., Mendes, D., Ferreira, A.: A study on natural 3D shape manipulation in VR. In: Livesu, M., Pintore, G., Signoroni, A. (eds.) Smart Tools and Apps for Graphics - Eurographics Italian Chapter Conference. The Eurographics Association (2018). https://doi.org/10.2312/stag.20181296

  14. Cui, J., Kuijper, A., Fellner, D.W., Sourin, A.: Understanding people’s mental models of mid-air interaction for virtual assembly and shape modeling. In: Proceedings of the 29th International Conference on Computer Animation and Social Agents, pp. 139–146. ACM (2016)

    Google Scholar 

  15. Cui, J., Kuijper, A., Sourin, A.: Exploration of natural free-hand interaction for shape modeling using leap motion controller. In: 2016 International Conference on Cyberworlds (CW), pp. 41–48. IEEE (2016)

    Google Scholar 

  16. Cui, J., Sourin, A.: Mid-air interaction with optical tracking for 3D modeling. Comput. Graph. 74, 1–11 (2018)

    Article  Google Scholar 

  17. Gunawardane, P., Medagedara, N.T.: Comparison of hand gesture inputs of leap motion controller & data glove in to a soft finger. In: 2017 IEEE International Symposium on Robotics and Intelligent Sensors (IRIS), pp. 62–68. IEEE (2017)

    Google Scholar 

  18. Henriques, D., Mendes, D., Pascoal, P., Trancoso, I., Ferreira, A.: Poster: evaluation of immersive visualization techniques for 3D object retrieval. In: 2014 IEEE Symposium on 3D User Interfaces (3DUI), pp. 145–146. IEEE (2014)

    Google Scholar 

  19. Jezernik, A., Hren, G.: A solution to integrate computer-aided design (CAD) and virtual reality (VR) databases in design and manufacturing processes. Int. J. Adv. Manuf. Technol. 22(11–12), 768–774 (2003)

    Article  Google Scholar 

  20. Koutsabasis, P., Domouzis, C.K.: Mid-air browsing and selection in image collections. In: Proceedings of the International Working Conference on Advanced Visual Interfaces, pp. 21–27. ACM (2016)

    Google Scholar 

  21. Kovar, J., Mouralova, K., Ksica, F., Kroupa, J., Andrs, O., Hadas, Z.: Virtual reality in context of industry 4.0 proposed projects at brno university of technology. In: 2016 17th International Conference on Mechatronics-Mechatronika (ME), pp. 1–7. IEEE (2016)

    Google Scholar 

  22. Lawson, G., Salanitri, D., Waterfield, B.: Future directions for the development of virtual reality within an automotive manufacturer. Appl. Ergon. 53, 323–330 (2016)

    Article  Google Scholar 

  23. Lin, J., Schulze, J.P.: Towards naturally grabbing and moving objects in VR. Electron. Imaging 2016(4), 1–6 (2016)

    Article  Google Scholar 

  24. Liu, H., Ju, Z., Ji, X., Chan, C.S., Khoury, M.: Human Motion Sensing and Recognition. SCI, vol. 675. Springer, Heidelberg (2017). https://doi.org/10.1007/978-3-662-53692-6

    Book  Google Scholar 

  25. Liu, L., Huai, Y.: Dynamic hand gesture recognition using lmc for flower and plant interaction. Int. J. Pattern Recognit Artif Intell. 33(01), 1950003 (2018)

    Article  Google Scholar 

  26. Lupinetti, K., Giannini, F., Monti, M., Pernot, J.P.: Multi-criteria similarity assessment for CAD assembly models retrieval. IMATI Report Series (18–07), 21 (08/2018 2018). http://irs.imati.cnr.it/reports/irs18-07

  27. Lupinetti, K., Giannini, F., Monti, M., Pernot, J.P.: Multi-criteria retrieval of CAD assembly models. J. Comput. Des. Eng. 5(1), 41–53 (2018)

    Google Scholar 

  28. Mujber, T.S., Szecsi, T., Hashmi, M.S.: Virtual reality applications in manufacturing process simulation. J. Mater. Process. Technol. 155, 1834–1838 (2004)

    Article  Google Scholar 

  29. Nakazato, M., Huang, T.S.: 3D Mars: immersive virtual reality for content-based image retrieval. In: IEEE International Conference on Multimedia and Expo, 2001. ICME 2001. (ICME). pp. 44–47 (2001). https://doi.org/10.1109/ICME.2001.1237651

  30. Nguyen, T.T.H., Duval, T., Pontonnier, C.: A new direct manipulation technique for immersive 3D virtual environments. In: ICAT-EGVE 2014: the 24th International Conference on Artificial Reality and Telexistence and the 19th Eurographics Symposium on Virtual Environments, p. 8 (2014)

    Google Scholar 

  31. Okuya, Y., Ladeveze, N., Fleury, C., Bourdot, P.: Shapeguide: shape-based 3D interaction for parameter modification of native CAD data. Front. Robot. AI 5, 118 (2018)

    Article  Google Scholar 

  32. Okuya, Y., Ladeveze, N., Gladin, O., Fleury, C., Bourdot, P.: Distributed architecture for remote collaborative modification of parametric CAD data. In: IEEE VR International Workshop on 3D Collaborative Virtual Environments (3DCVE 2018) (2018)

    Google Scholar 

  33. Ottosson, S.: Virtual reality in the product development process. J. Eng. Des. 13(2), 159–172 (2002)

    Article  Google Scholar 

  34. Park, H., Son, J.S., Lee, K.H.: Design evaluation of digital consumer products using virtual reality-based functional behaviour simulation. J. Eng. Des. 19(4), 359–375 (2008)

    Article  Google Scholar 

  35. Peng, C., Hansberger, J.T., Cao, L., Shanthakumar, V.A.: Hand gesture controls for image categorization in immersive virtual environments. In: 2017 IEEE Virtual Reality (VR), pp. 331–332. IEEE (2017)

    Google Scholar 

  36. Rucco, M., Lupinetti, K., Giannini, F., Monti, M., Pernot, J.-P.: CAD assembly retrieval and browsing. In: Ríos, J., Bernard, A., Bouras, A., Foufou, S. (eds.) PLM 2017. IAICT, vol. 517, pp. 499–508. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-72905-3_44

    Chapter  Google Scholar 

  37. Seif, M.A., Umeda, R., Higa, H.: An attempt to control a 3D object in medical training system using leap motion. In: 2017 International Conference on Intelligent Informatics and Biomedical Sciences (ICIIBMS), pp. 159–162. IEEE (2017)

    Google Scholar 

  38. Toyama, S., Al Sada, M., Nakajima, T.: VRowser: a virtual reality parallel web browser. In: Chen, J.Y.C., Fragomeni, G. (eds.) VAMR 2018. LNCS, vol. 10909, pp. 230–244. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-91581-4_17

    Chapter  Google Scholar 

  39. Vanacken, L., Grossman, T., Coninx, K.: Exploring the effects of environment density and target visibility on object selection in 3D virtual environments. In: IEEE Symposium on 3D User Interfaces, pp. 115–222. IEEE (2007)

    Google Scholar 

  40. Vitali, A., Regazzoni, D., Rizzi, C.: Guidelines to develop natural user interfaces for virtual reality solutions. In: International Conference on Innovative Design and Manufacturing: ICIDM2017, Milan, Italy, July 2017 (2017)

    Google Scholar 

  41. Vosinakis, S., Koutsabasis, P., Makris, D., Sagia, E.: A kinesthetic approach to digital heritage using leap motion: the cycladic sculpture application. In: 2016 8th International Conference on Games and Virtual Worlds for Serious Applications (VS-GAMES), pp. 1–8 (2016). https://doi.org/10.1109/VS-GAMES.2016.7590334

Download references

Author information

Authors and Affiliations

  1. Istituto di Matematica Applicata e Tecnologie Informatiche “Enrico Magenes”, CNR Via De Marini 6, 16149, Genova, Italy

    Katia Lupinetti, Brigida Bonino, Franca Giannini & Marina Monti

Authors
  1. Katia Lupinetti
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Brigida Bonino
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Franca Giannini
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Marina Monti
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Katia Lupinetti .

Editor information

Editors and Affiliations

  1. University of Salento, Lecce, Italy

    Lucio Tommaso De Paolis

  2. University of Paris-Sud, Orsay, France

    Patrick Bourdot

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Lupinetti, K., Bonino, B., Giannini, F., Monti, M. (2019). Exploring the Benefits of the Virtual Reality Technologies for Assembly Retrieval Applications. In: De Paolis, L., Bourdot, P. (eds) Augmented Reality, Virtual Reality, and Computer Graphics. AVR 2019. Lecture Notes in Computer Science(), vol 11613. Springer, Cham. https://doi.org/10.1007/978-3-030-25965-5_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-25965-5_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-25964-8

  • Online ISBN: 978-3-030-25965-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation