Arvin Christopher C. Reyes
Jordan Aiko P. Deja
ABSTRACT
We developed a mixed reality guidance system (MRGS) for motherboard assembly with purpose of exploring the usability and viability of using mixed reality and tangible augmented reality (TAR) for simulating hands-on manual assembly tasks. TAR was used to remove the need for real-world parts as well as to provide a natural interaction medium for our system. To evaluate our system, we conducted two usability studies involving 25 (10 experienced and 15 naive) participants. For the first study, participants were tasked to rate only the proposed interaction technique. Both experienced and naive participants gave acceptable scores, with experienced users giving significantly higher ratings. In the second study, participants were tasked to partially assemble the motherboard using the MRGS. Participants who utilized the MRGS were able to properly determine the correct orientation and location of the motherboard parts, in contrast to the control group. Observations of users while performing the tasks as well as user feedback through survey questionnaires and interviews are presented and discussed in this paper.
- N Gavish, T Gutierrez, SWebel, J Rodriguez, M Peveri, U Bockholt, and F Tecchia. Evaluating virtual reality and augmented reality training for industrial maintenance and assembly tasks. Interactive Learning Environment, 23(6):778--798, 2015.Google Scholar
Cross Ref
- J. E Brough, M Schwartz, S. K Gupta, D. K Anand, R Kavetsky, and R Pettersen. Towards the development of a virtual environment-based training system for mechanical assembly operations. Virtual reality, 11(4): 189-206, 2007.Google Scholar
- F Ganier, C Hoareau, and J Tisseau. Evaluation of procedural learning transfer from a virtual environment to a real situation: a case study on tank maintenance training. Ergonomics, 57(6):828--843, 2014.Google ScholarCross Ref
- T Gutierrez, J Rodriguez, Y Velaz, S Casado, A Suescun, and E. J Sanchez. Ima-vr: a multimodal virtual training system for skills transfer in industrial maintenance and assembly tasks. In RO-MAN, 2010 IEEE, pages 428-433. IEEE, 2010.Google ScholarCross Ref
- D Jia, A Bhatti, and S Nahavandi. Design and evaluation of a haptically enable virtual environment for object assembly training. In Haptic Audio visual Environments and Games, 2009. HAVE 2009. IEEE International Workshop, pages 75-80. IEEE, 2009.Google Scholar
- Enrique Gallegos-Nieto, Hugo I Medellín-Castillo, Germánico González-Badillo, Theodore Lim, and James Ritchie. The analysis and evaluation of the influence of haptic-enabled virtual assembly training on real assembly performance. The International Journal of Advanced Manufacturing Technology, 89(l-4):581--598, 2017.Google Scholar
- Patrick Reuter, Guillaume Rivière, Nadine Couture, Stéphanie Mahut, Nicolas Sorraing, and Loïc Espinasse. Archeotui-tangible interaction with foot pedal declutching for the virtual reassembly of fractured archeological objects. In Proceedings of the 2008 ACM symposium on Virtual reality software and technology, pages 307-308. ACM, 2008.Google ScholarDigital Library
- Mikel Sagardia, Thomas Hulin, Katharina Hertkorn, Philipp Kremer, and Simon Schätzle. A platform for bimanual virtual assembly training with haptic feedback in large multi-object environments. In Proceedings of the 22nd ACM Conference on Virtual Reality Software and Technology, pages 153-162. ACM, 2016.Google ScholarDigital Library
- Jürgen Hahn, Bernd Ludwig, and Christian Wolff. Augmented reality-based training of the pcb assembly process. In Proceedings of the 14th International Conference on Mobile and Ubiquitous Multimedia, pages 395-399. ACM, 2015.Google ScholarDigital Library
- L Hou, X Wang, L Bernold, and P. E Love. Using animated augmented reality to cognitively guide assembly. Journal of Computing in Civil Engineering, 27(5):439--451, 2013.Google ScholarCross Ref
- Aaron Kotranza, John Quarles, and Benjamin Lok. Mixed reality: are two hands better than one? In Proceedings of the ACM symposium on Virtual reality software and technology, pages 31-34. ACM, 2006.Google ScholarDigital Library
- Mark Rice, Hong Huei Tay, Jamie Ng, Calvin Lim, Senthil Kumar Selvaraj, and Ellick Wu. Comparing three task guidance interfaces for wire harness assembly. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, pages 2279-2284. ACM, 2016.Google ScholarDigital Library
- S Webel, U Bockholt, T Engelke, N Gavish, M Olbrich, and C Preusche. An augmented reality training platform for assembly and maintenance skills. Robotics and Autonomous Systems, 61(4):389--403, 2013.Google ScholarDigital Library
- G Westerfield, A Mitrovic, and M Billinghurst. Intelligent augmented reality training for motherboard assembly. International Journal of Artificial Intelligence in Education, 25(1): 157-172, 2015.Google ScholarCross Ref
- Mark Billinghurst, Hirokazu Kato, and Ivan Poupyrev. Tangible augmented reality. ACM SIGGRAPH ASIA 7, 2008.Google Scholar
- S. R Barber, S Jain, Y. J Son, and E. H Chang. Virtual functional endoscopic sinus surgery simulation with 3d-printed models for mixed-reality nasal endoscopy. Otolaryngology-Head and Neck Surgery, 2018.Google ScholarCross Ref
- J Hiansen, A Mashari, and M Meineri. Advanced Perioperative Imaging Lab (APIL). https://vuforia.com/case-studies/apil.html, March 2018.Google Scholar
- Woohun Lee and Jun Park. Augmented foam: A tangible augmented reality for product design. In Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR '05), pages 106-109. IEEE, 2005.Google Scholar
- Michael Saenz, Joshua Strunk, Kelly Maset, Jinsil Harwaryoung Seo, and Erica Malone. Flexar: anatomy education through kinetic tangible augmented reality. In ACM SIGGRAPH 2015 Posters, page 21. ACM, 2015.Google Scholar
- Anna Syberfeldt, Oscar Danielsson, Magnus Holm, and Lihui Wang. Visual assembling guidance using augmented reality. Procedia Manufacturing, 1:98--109, 2015.Google ScholarCross Ref
- J Birt, E Moore, and MCowling. Improving paramedic distance education through mobile mixed reality simulation. Australasian Journal of Educational Technology, 33(6), 2017.Google ScholarCross Ref
- Jean-Philippe Farrugia. Virtualhaus: a collaborative mixed reality application with tangible interface. 2018.Google ScholarDigital Library
- Martin Fischbach, Hendrik Striepe, Marc Erich Latoschik, and Birgit Lugrin. A low-cost, variable, interactive surface for mixed-reality tabletop games. In Proceedings of the 22nd ACM Conference on Virtual Reality Software and Technology, pages 297-298. ACM, 2016.Google ScholarDigital Library
- Fábio Rodrigues, Fernando Sato, Leonardo Botega, and Allan Oliveira. Augmented reality and tangible user interfaces integration for enhancing the user experience. In Proceedings of the 11th ACM SIGGRAPH International Conference on Virtual- Reality Continuum and its Applications in Industry, pages 67-70. ACM, 2012.Google ScholarDigital Library
- Steven J Henderson and Steven Feiner. Opportunistic controls: leveraging natural affordances as tangible user interfaces for augmented reality. In Proceedings of the 2008 ACM symposium on Virtual reality software and technology, pages 211-218. ACM, 2008.Google ScholarDigital Library
- Y. Velaz, J. R. Arce, T. Gutiérrez, and A. Suescun. The influence of interaction technology on the learning of assembly tasks using virtual reality. Journal of Computing and Information Science in Engineering, 14(4), 2014.Google ScholarCross Ref
- U Zaldivar-Colado, S Garbaya, P Tamayo-Serrano, X Zaldívar-Colado, and P Blazevic. A mixed reality for virtual assembly. In Robot and Human Interactive Communication (RO-MAN), 2017 26th IEEE International Symposium, pages 739-744. IEEE, 2017.Google ScholarDigital Library
- P. P. Valentini. Natural interface for interactive virtual assembly in augmented reality using leap motion controller. International Journal on Interactive Design and Manufacturing (IJIDeM), 12(4): 1157-1165, 2018.Google ScholarCross Ref
- Valéria Farinazzo Martins, Marcelo de Paiva Guimaràes, and Ana Grasielle Correa. Usability test for augmented reality applications. In 2013 XXXIX Latin American Computing Conference (CLEI), pages 1-10. IEEE, 2013.Google ScholarCross Ref
- William Albert and Thomas Tullis. Measuring the user experience: collecting, analyzing, and presenting usability metrics. Newnes, 2013.Google ScholarDigital Library
Index Terms
- Mixed Reality Guidance System for Motherboard Assembly Using Tangible Augmented Reality
Recommendations
Occlusion based interaction methods for tangible augmented reality environments
VRCAI '04: Proceedings of the 2004 ACM SIGGRAPH international conference on Virtual Reality continuum and its applications in industryTraditional Tangible Augmented Reality (Tangible AR) interfaces combine a mixture of tangible user interface and augmented reality technology, complementing each other for novel interaction methods and real world anchored visualization. However, well ...
Design of Virtual Assembly Guidance System Based on Mixed Reality
Image and GraphicsAbstractMixed reality technology has evolved from virtual reality and enables the creation of interactive feedback loops between the real and virtual worlds. It has practical applications in training and industrial manufacturing. This paper proposes a ...
Multimodal augmented reality: the norm rather than the exception
MVAR '16: Proceedings of the 2016 workshop on Multimodal Virtual and Augmented RealityAugmented reality (AR) is commonly seen as a technology that overlays virtual imagery onto a participant's view of the world. In line with this, most AR research is focused on what we see. In this paper, we challenge this focus on vision and make a case ...
Comments