Abstract
Virtual assembly simulations are used in the industry to save costs in early stages of product development. As previous work, the so called mixed mock-up was developed to support the assembly planning of an automotive supplier. The mixed mock-up extends cardboard engineering through Augmented Reality (AR) visualizations. Virtual components are assembled virtually at the physical assembly mock-up. The evaluation of the first mixed mock-up prototype revealed various deficits in the technical implementation and the user interaction. This paper describes the further development of the existing system with the aim of making the simulation more realistic and increasing the practical suitability of the application. Based on a generic system description, the system has been improved in its individual components. A new pair of AR glasses is used to extend the field of vision. In addition, innovative force feedback gloves are used to support the user interaction. The gloves enhance the handling and ensure a natural interaction with the system and the virtual components. The effort for the preparation of the simulation data and the configuration of the assembly scene is reduced by a semi-automatic data processing step. This makes it easy to exchange CAD data and enables a productive use of the system. An evaluation by experts of the industry partner resulted in a thoroughly positive feedback. The mixed mock-up application has become more realistic and intuitive overall.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
CONSENS is a specification technique for mechatronic systems developed at the Heinz Nixdorf Institute in Paderborn, Germany.
- 2.
- 3.
- 4.
Simultaneous localization and mapping.
- 5.
References
Wang, X., Ong, S., Nee, A.: Real-virtual interaction in AR assembly simulation based on component contact handling strategy. Assembly Autom. 35(4), 376–394 (2015). https://doi.org/10.1108/AA-02-2015-012
Jayasekera, R.D.M.D., Xu, X.: Assembly validation in virtual reality—a demonstrative case. Int. J. Adv. Manuf. Tech. 105(9), 3579–3592 (2019). https://doi.org/10.1007/s00170-019-03795-y
Boothroyd, G.: Product design for manufacture and assembly. Comput. Aided Des. 26(7), 505–520 (1994). https://doi.org/10.1016/0010-4485(94)90082-5
Al-Ahmari, A.M., Abidi, M.H., Ahmad, A., Darmoul, S.: Development of a virtual manufacturing assembly simulation system. Adv. Mech. Eng. 8(3) (2016). https://doi.org/10.1177/1687814016639824
Stöcklein, J., Bansmann, M., Berssenbrügge, J., Foullois, M.: AR-basierte Arbeitsplatzgestaltung für manuelle Montageabläufe. Virtuelle und Erweiterte Realität. In: 15. Workshop der GI-Fachgruppe VR/AR (2018). https://doi.org/10.2370/9783844062151
Valentini, P.P.: Natural interface for interactive virtual assembly in augmented reality using leap motion controller. Int. J. Interact. Des. Manuf. 12(4), 1157–1165 (2018). https://doi.org/10.1007/s12008-018-0461-0
Wang, Z.B., Ong, S.K., Nee, A.Y.C.: Augmented reality aided interactive manual assembly design. Int. J. Adv. Manuf. Tech. 69, 1311–1321 (2013). https://doi.org/10.1007/s00170-013-5091-x
Zaldívar-Colado, U., Garbaya, S., Tamayo-Serrano, P., Zaldívar-Colado, X., Blazevic, P.: A mixed reality for virtual assembly. In: International Symposium on Robot and Human Interactive Communication, vol. 26, pp. 739–744. IEEE, Lisbon (2017). https://doi.org/10.1109/ROMAN.2017.8172385
Murakami, K., Kiyama, R., Narumi, T., Tanikawa, T., Hirose, M.: Poster: a wearable augmented reality system with haptic feedback and its performance in virtual assembly tasks. In: Symposium on 3D User Interfaces (3DUI), pp. 161–162. IEEE (2013). https://doi.org/10.1109/3DUI.2013.6550228
Gonzalez-Badillo, G., Medellín-Castillo, H.I., Lim, T.: Development of a haptic virtual reality system for assembly planning and evaluation. Procedia Tech. 7, 265–272 (2013). https://doi.org/10.1016/j.protcy.2013.04.033
Carlson, P., Vance, J.M., Berg, M.: An evaluation of asymmetric interfaces for bimanual virtual assembly with haptics. Virtual Reality 20, 193–201 (2016). https://doi.org/10.1007/s10055-016-0290-z
Acknowledgements
The results were developed within the project “IviPep - Work 4.0 in product development”. The joint project is funded by the German Federal Ministry of Education and Research (BMBF) and the European Social Fund (ESF) as part of the “Future of Work” programme.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Dyck, F., Stöcklein, J., Eckertz, D., Dumitrescu, R. (2020). Mixed Mock-up – Development of an Interactive Augmented Reality System for Assembly Planning. In: Chen, J.Y.C., Fragomeni, G. (eds) Virtual, Augmented and Mixed Reality. Design and Interaction. HCII 2020. Lecture Notes in Computer Science(), vol 12190. Springer, Cham. https://doi.org/10.1007/978-3-030-49695-1_3
Download citation
DOI: https://doi.org/10.1007/978-3-030-49695-1_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-49694-4
Online ISBN: 978-3-030-49695-1
eBook Packages: Computer ScienceComputer Science (R0)