Tawatchai Perdpunya
ABSTRACT
A machine is an essential factor for industrial production. Industry 4.0 is the revolution that causes improvement of machines to have higher efficiency. Accordingly, inspection and maintenance are becoming more important. However, most of factories are not changed the operating process, there is no data logging for evaluation and analysis for preventive maintenance. This research aims to develop a model for machine inspection using augmented reality with object detection and marker techniques on real world machines and mask R-CNN algorithm allowing inspector to perform inspections. This study, we demonstrate the process of development of the proposed model by showing steps of data acquisition from a machine in a factory. The dataset is images of machines in different perspectives, and they were used for training and testing the model. The testing is done on a mobile device of an inspector. With computer vision technique and the proposed model, the instant precision tracking and detection are provided. Then the trained model is transferred to the mobile devices for testing without any modification by an expert. Some images of machines are randomly selected to verify the accuracy of the model. The result shows that the efficiency of the model is acceptable in real usage.
- Di. Chatzopoulos, C. Bermejo, Z. Huang, and P. Hui, “Mobile Augmented Reality Survey: From Where We Are to Where We Go,” IEEE Access, vol. 5, pp. 6917–6950, 2017, doi: 10.1109/ACCESS.2017.2698164.Google Scholar
Cross Ref
- T. P. Caudell and D. W. Mizell, “Augmented reality: an application of heads-up display technology to manual manufacturing processes,” in Proceedings of the Twenty-Fifth Hawaii International Conference on System Sciences, Jan. 1992, vol. ii, pp. 659–669 vol.2, doi: 10.1109/HICSS.1992.183317.Google ScholarCross Ref
- K. He, G. Gkioxari, P. Dollár, and R. Girshick, “Mask R-CNN.” 2018.Google Scholar
- G. Zvejnieks, “Marker-based vs markerless augmented reality: pros, cons & examples,” 2019. .Google Scholar
- A. Cīrulis, K. Brigmanis-Briģis, and G. Zvejnieks, “Analysis of Suitable Natural Feature Computer Vision Algorithms for Augmented Reality Services,” Baltic Journal of Modern Computing, vol. 8, no. 1, pp. 174–181, Jan. 2020, doi: 10.22364/bjmc.2020.8.1.10.Google ScholarCross Ref
- G. Levi and T. Hassner, “LATCH: Learned arrangements of three patch codes,” in 2016 IEEE Winter Conference on Applications of Computer Vision (WACV), Mar. 2016, pp. 1–9, doi: 10.1109/WACV.2016.7477723.Google ScholarCross Ref
- A. Robertson, “Google ARCode gives android users augmented reality without tango,” 2017. .Google Scholar
Index Terms
- Augmented Reality with Mask R-CNN (ARR-CNN) inspection for Intelligent Manufacturing
Recommendations
Head-mounted display augmented reality in manufacturing: A systematic review
AbstractHead-mounted display (HMD) augmented reality (AR) has attracted more and more attention in manufacturing activities, as it enables operators to access visual guidance in front of their view directly while freeing human's two hands. ...
A survey of industrial augmented reality
Highlights- State of the art review of Augmented Reality in industrial environments.
- ...
AbstractThis article aims to evaluate the impact of Augmented Reality (AR) applicability and usefulness on real industrial processes by employing a systematic literature review (SLR). The SLR was performed in five digital libraries to identify ...
A comparative study of Augmented Reality rendering techniques for industrial assembly inspection
AbstractIn the manufacturing industry, Augmented Reality (AR) has shown significant potential in enhancing operators’ capabilities while performing inspection and assembly activities. However, the augmented visualization of virtual models on physical ...
Highlights- AR technology is a way to improve assembly inspection in the industrial environment.
- Comparison of AR rendering techniques based on qualitative and quantitative metrics.
- AR rendering techniques affect user performance in assembly ...
Comments