Alia Rukubayihunga
ABSTRACT
Augmented Reality is a media which purpose is to attach digital information to real world scenes in order to enhance the user experience. It has been used in the field of maintenance in order to show the user the operations he has to perform.
Our goal is to go one step further so that our system is able to detect when the user has performed a step of the task. It requires some understanding of what is occurring and where objects are located in order to display correct instructions for the task.
This paper is focusing on using an intermediate computation result of the usual augmented reality process, which is the pose computation: we propose to use the transformation matrix not only for objects pose estimation, but also to characterise their motion during an assembly task. With this matrix, we can induce spatial relationship between assembly parts and determine which motion occurs. Then we analyse translation and rotation parameters contained in the transformation matrix during the action. We demonstrate that these data correctly characterise the movement between object's fragments. Therefore, by analysing such a matrix, not only we can achieve the required registration step of the augmented reality process, but we can also understand the actions performed by the user.
- H. Bay, A. Ess, T. Tuytelaars, and L. V. Gool. Speeded-up robust features (surf). Computer Vision and Image Understanding, 110(3):346 -- 359, 2008. Similarity Matching in Computer Vision and Multimedia. Google Scholar
Digital Library
- M. Billinghurst, M. Hakkarainen, and C. Woodward. Augmented assembly using a mobile phone. In Proceedings of the 7th International Conference on Mobile and Ubiquitous Multimedia, MUM '08, pages 84--87, New York, NY, USA, 2008. ACM. Google ScholarDigital Library
- G. Bleser, D. Damen, A. Behera, G. Hendeby, K. Mura, M. Miezal, A. Gee, N. Petersen, G. Maçães, H. Domingues, et al. Cognitive learning, monitoring and assistance of industrial workflows using egocentric sensor networks. PloS one, 10(6), 2015. Google ScholarCross Ref
- J. Carmigniani and B. Furht. Augmented reality: an overview. In Handbook of Augmented Reality, page 3--46. Springer, 2011. Google ScholarCross Ref
- B. A. Delail, L. Weruaga, and M. J. Zemerly. Caviar: Context aware visual indoor augmented reality for a university campus. In Proceedings of the The 2012 IEEE/WIC/ACM International Joint Conferences on Web Intelligence and Intelligent Agent Technology - Volume 03, WI-IAT '12, pages 286--290, Washington, DC, USA, 2012. IEEE Computer Society.Google ScholarDigital Library
- J.-Y. Didier, D. Roussel, M. Mallem, S. Otmane, S. Naudet, Q.-C. Pham, S. Bourgeois, C. Mégard, C. Leroux, and A. Hocquard. Amra: Augmented reality assistance in train maintenance tasks. In Workshop on Industrial Augmented Reality (ISMAR'05), Vienna (Austria), October 5th 2005.Google Scholar
- W. Friedrich, D. Jahn, and L. Schmidt. ARVIKA-Augmented reality for development, production and service. In ISMAR, volume 2002, page 3--4. Citeseer, 2002. Google ScholarCross Ref
- T. Gleue and P. Dähne. Design and implementation of a mobile device for outdoor augmented reality in the archeoguide project. In Proceedings of the 2001 Conference on Virtual Reality, Archeology, and Cultural Heritage, VAST '01, pages 161--168, New York, NY, USA, 2001. ACM. Google ScholarDigital Library
- V. Huikari, H. Koskimäki, P. Siirtola, and J. Roning. User-independent activity recognition for industrial assembly lines-feature vs. instance selection. In Pervasive Computing and Applications (ICPCA), 2010 5th International Conference on, pages 307--312, Dec 2010.Google ScholarCross Ref
- T. Höllerer, S. Feiner, T. Terauchi, G. Rashid, and D. Hallaway. Exploring mars: Developing indoor and outdoor user interfaces to a mobile augmented reality system. Computers and Graphics, 23:779--785, 1999. Google ScholarCross Ref
- K. Ikeuchi, M. Kawade, and T. Suehiro. Assembly task recognition with planar, curved and mechanical contacts. In Robotics and Automation, 1993. Proceedings., 1993 IEEE International Conference on, pages 688--694 vol.2, May 1993. Google ScholarCross Ref
- G. Lee and M. Billinghurst. Cityviewar outdoor ar visualization. In Proceedings of the 13th International Conference of the NZ Chapter of the ACM's Special Interest Group on Human-Computer Interaction, CHINZ '12, pages 97--97, New York, NY, USA, 2012. ACM. Google ScholarDigital Library
- V. Lepetit, F. Moreno-Noguer, and P. Fua. Epnp: An accurate o(n) solution to the pnp problem. International Journal of Computer Vision, 81(2):155--166, 2009. Google ScholarDigital Library
- M. Muja and D. G. Lowe. Fast approximate nearest neighbors with automatic algorithm configuration. In International Conference on Computer Vision Theory and Application VISSAPP'09), pages 331--340. INSTICC Press, 2009.Google Scholar
- J. Park. Augmented reality based re-formable mock-up for design evaluation. In Ubiquitous Virtual Reality, 2008. ISUVR 2008. International Symposium on, pages 17--20, July 2008. Google ScholarDigital Library
- J. Sääski, T. Salonen, M. Hakkarainen, S. Siltanen, C. Woodward, and J. Lempiäinen. Integration of design and assembly using augmented reality. In Micro-Assembly Technologies and Applications, page 395--404. Springer, 2008. Google ScholarCross Ref
- B. Thomas, B. Close, J. Donoghue, J. Squires, P. De Bondi, M. Morris, and W. Piekarski. Arquake: an outdoor/indoor augmented reality first person application. In Wearable Computers, The Fourth International Symposium on, pages 139--146, Oct 2000.Google Scholar
- J. Ward, P. Lukowicz, G. Troster, and T. Starner. Activity recognition of assembly tasks using body-worn microphones and accelerometers. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 28(10):1553--1567, Oct 2006.Google ScholarDigital Library
- Z. Zhang. Flexible camera calibration by viewing a plane from unknown orientations. In Computer Vision, 1999. The Proceedings of the Seventh IEEE International Conference on, volume 1, pages 666--673. IEEE, 1999. Google ScholarCross Ref
Recommendations
Haptics in Augmented Reality
ICMCS '99: Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2An augmented reality system merges synthetic sensory information into a user's perception of a three-dimensional environment. An important performance goal for an augmented reality system is that the user perceives a single seamless environment. In most ...
Augmented reality as perceptual reality
VSMM'06: Proceedings of the 12th international conference on Interactive Technologies and Sociotechnical SystemsAs shown in Paul Milgram et al’s Reality-Virtuality Continuum (1994), Augmented Reality occupies a very unique status in the spectrum of Mixed Reality. Unlike Virtual Reality, which is completely made up of the virtual and has been the most important ...
Multimodal augmented reality: the norm rather than the exception
MVAR '16: Proceedings of the 2016 workshop on Multimodal Virtual and Augmented RealityAugmented reality (AR) is commonly seen as a technology that overlays virtual imagery onto a participant's view of the world. In line with this, most AR research is focused on what we see. In this paper, we challenge this focus on vision and make a case ...
Comments