Xingya Yan
ABSTRACT
Augmented reality is a three-dimensional visualization technology that can carry out human-computer interaction. Virtual information is placed in the designated area of the real world to enhance real-world information. Based on the existing implementation process of augmented reality, this paper proposes an augmented reality method based on deep learning, aiming at the inaccurate positioning and model drift of the augmented reality method without markers in complex backgrounds, light changes, and partial occlusion. The proposed method uses the lightweight SSD model for target detection, the SURF algorithm to extract feature points and the FLANN algorithm for feature matching. Experimental results show that this method can effectively solve the problems of inaccurate positioning and model drift under particular circumstances while ensuring the operational efficiency of the augmented reality system.
- Siriwardhana Y, Porambage P, Liyanage M, A survey on mobile augmented reality with 5G mobile edge computing: architectures, applications, and technical aspects[J]. IEEE Communications Surveys & Tutorials, 2021, 23(2): 1160-1192.Google Scholar
Cross Ref
- Xie X, Cheng G, Wang J, Oriented r-cnn for object detection[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision. 2021: 3520-3529.Google Scholar
- Redmon J, Divvala S, Girshick R, You only look once: Unified, real-time object detection[C]//Proceedings of the IEEE conference on computer vision and pattern recognition. 2016: 779-788.Google Scholar
- Liu P, Zhang H, Zhang K, Multi-level Wavelet-CNN for Image Restoration[J]. 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2018:88600-88609.Google Scholar
- Zhai S, Shang D, Wang S, DF-SSD: An improved SSD object detection algorithm based on DenseNet and feature fusion[J]. IEEE access, 2020, 8: 24344-24357.Google Scholar
- Wu T, Zhang Z, Liu Y, A lightweight small object detection algorithm based on improved SSD[J]. Infrared and Laser Engineering, 2018, 47(7): 0703005.Google ScholarCross Ref
- Huanjie C, Qiqi W, Guowei Y, SSD object detection algorithm with multi-scale convolution feature fusion[J]. Journal of Frontiers of Computer Science & Technology, 2019, 13(6): 1049.Google Scholar
- Howard A G, Zhu M, Chen B, MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications[J]. 2017: 118-125.Google Scholar
- Li J, Chen J, Un K F, A 50.4 GOPs/W FPGA-Based MobileNetV2 Accelerator using the Double-Layer MAC and DSP Efficiency Enhancement[C]//2021 IEEE Asian Solid-State Circuits Conference (A-SSCC). IEEE, 2021: 1-3.Google Scholar
- Muja M, Lowe D G. Fast approximate nearest neighbors with automatic algorithm configuration[J]. VISAPP (1), 2009, 2(331-340): 2.Google Scholar
- Raguram R, Chum O, Pollefeys M, USAC: A universal framework for random sample consensus[J]. IEEE transactions on pattern analysis and machine intelligence, 2012, 35(8): 2022-2038.Google Scholar
- Shi G, Xu X, Dai Y. SIFT feature point matching based on improved RANSAC algorithm[C]//2013 5th International Conference on Intelligent Human-Machine Systems and Cybernetics. IEEE, 2013, 1: 474-477.Google Scholar
Index Terms
- An Augmented Reality Tracking Registration Method Based on Deep Learning
Recommendations
Haptics in Augmented Reality
ICMCS '99: Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2An augmented reality system merges synthetic sensory information into a user's perception of a three-dimensional environment. An important performance goal for an augmented reality system is that the user perceives a single seamless environment. In most ...
Multimodal augmented reality: the norm rather than the exception
MVAR '16: Proceedings of the 2016 workshop on Multimodal Virtual and Augmented RealityAugmented reality (AR) is commonly seen as a technology that overlays virtual imagery onto a participant's view of the world. In line with this, most AR research is focused on what we see. In this paper, we challenge this focus on vision and make a case ...
Augmented reality as perceptual reality
VSMM'06: Proceedings of the 12th international conference on Interactive Technologies and Sociotechnical SystemsAs shown in Paul Milgram et al’s Reality-Virtuality Continuum (1994), Augmented Reality occupies a very unique status in the spectrum of Mixed Reality. Unlike Virtual Reality, which is completely made up of the virtual and has been the most important ...
Comments