Abstract
The requirements for accuracy and reliability in the manufacturing processes of large aircraft structures are among the most demanding in the industry due to the continuous development of advanced manufacturing processes with tight tolerances and high requirements for process integrity. The main technique for the operation of many of these processes is the detection and precise measurement of fasteners by artificial vision systems in real time, however these systems require adjustment of multiple parameters and do not work correctly in uncontrolled scenarios, which require intervention operations such as manual supervision of the measurement process, leading into a reduction in the autonomy of automated systems.
In this study, a new Deep Learning algorithm based on a Single Shot Detector neural network is proposed for the detection and measurement drills and other fixation elements (such as rivets and temporary fasteners) in an uncontrolled industrial manufacturing environment. The convergence of the new network has been optimized for the detection of elements of a circular nature, instead of the generic anchor boxes usually used. In addition, a fine-tuning algorithm based on a new characterization parameter of the circular geometry is applied to the results obtained from the network. This new metric has made it possible to define a quality parameter with respect to the measurement made.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bauer, J., Bas, G., Durakbasa, N., Kopacek, P.: Development trends in automation and metrology. IFAC-PapersOnLine 48(24), 168–172 (2015)
Bevilacqua, M.G., Caroti, G., Piemonte, A., Terranova, A.A.: Digital technology and mechatronic systems for the architectural 3D metric survey. In: Ottaviano, E., Pelliccio, A., Gattulli, V. (eds.) Mechatronics for Cultural Heritage and Civil Engineering. ISCASE, vol. 92, pp. 161–180. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-68646-2_7
Carmignato, S., De Chiffre, L., Bosse, H., Leach, R., Balsamo, A., Estler, W.: Dimensional artefacts to achieve metrological traceability in advanced manufacturing. CIRP Annal. 69(2), 693–716 (2020)
Cavas-Martinez, F., Fernandez-Pacheco, D.G.: Virtual simulation: a technology to boost innovation and competitiveness in industry (2019)
Conesa, J., Cavas-Martínez, F., Fernández-Pacheco, D.G.: An agent-based paradigm for detecting and acting on vehicles driving in the opposite direction on highways. Exp. Syst. Appl. 40(13), 5113–5124 (2013)
Elgeneidy, K., Al-Yacoub, A., Usman, Z., Lohse, N., Jackson, M., Wright, I.: Towards an automated masking process: a model-based approach. Proc. Inst. Mech. Eng. Part B: J. Eng. Manuf. 233(9), 1923–1933 (2019)
Ghilani, C.D.: Adjustment Computations: Spatial Data Analysis. Wiley, New York (2017)
Gramegna, N., Bonollo, F., Della Corte, E., Grosselle, F., Cocco, M.: Innovative and integrated technologies for the development of aeronautic components (2010)
Howard, A.G., et al.: Mobilenets: efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861 (2017)
Ioffe, S., Szegedy, C.: Batch normalization: accelerating deep network training by reducing internal covariate shift. In: International Conference on Machine Learning, pp. 448–456. PMLR (2012)
Jiao, L., Zhang, F., Liu, F., Yang, S., Li, L., Feng, Z., Qu, R.: A survey of deep learning-based object detection. IEEE Access 7, 128837–128868 (2019). https://doi.org/10.1109/ACCESS.2019.2939201
Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)
Kupke, M., Gerngross, T.: Production technology in aeronautics: upscaling technologies from lab to shop floor (2018)
Lin, T.Y., Goyal, P., Girshick, R., He, K., Dollár, P.: Focal loss for dense object detection. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2980–2988 (2013)
Liu, W., et al.: SSD: single shot multiBox detector. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9905, pp. 21–37. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46448-0_2
Lozano, R., Leandro: Detección y clasificación de elementos de fijación aeronáutica mediante técnicas de machine learning (2021). https://doi.org/10.31428/10317/9465
Maria Fernanda Barbato, S., Carlos Henrique Pereira, M., Eduardo Gomes, S.: Prioritization of product-service business model elements at aerospace industry using analytical hierarchy process. Acta Scientiarum. Technology 41(1) (2019). https://doi.org/10.4025/actascitechnol.v41i1.37934, https://periodicos.uem.br/ojs/index.php/ActaSciTechnol/article/view/37934
Rocha, L., Bills, P., Marxer, M., Savio, E.: Training in the aeronautic industry for geometrical quality control and large scale metrology. In: Majstorovic, V.D., Durakbasa, N. (eds.) IMEKOTC14 2019. LNME, pp. 162–169. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-18177-2_16
Ruiz, L., Torres, M., Gómez, A., Díaz, S., González, J.M., Cavas, F.: Detection and classification of aircraft fixation elements during manufacturing processes using a convolutional neural network. Appl. Sci. 10(19) (2020). https://doi.org/10.3390/app10196856
Wang, Z., Zhou, Y., Li, G.: Anomaly detection for machinery by using big data real-time processing and clustering technique. In: Proceedings of the 2019 3rd International Conference on Big Data Research, pp. 30–36
Funding
This publication has been carried out in the framework of the Project “Nuevas Uniones de estructuras aeronáuticas” reference number IDI-20180754. This Project has been supported by the Spanish Ministry of Ciencia e Innovación and Centre for Industrial Technological Development (CDTI).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 Springer Nature Switzerland AG
About this paper
Cite this paper
Ruiz, L., Díaz, S., González, J.M., Cavas, F. (2022). Improvement of Fixation Elements Detection in Aircraft Manufacturing. In: Ferrández Vicente, J.M., Álvarez-Sánchez, J.R., de la Paz López, F., Adeli, H. (eds) Bio-inspired Systems and Applications: from Robotics to Ambient Intelligence. IWINAC 2022. Lecture Notes in Computer Science, vol 13259. Springer, Cham. https://doi.org/10.1007/978-3-031-06527-9_37
Download citation
DOI: https://doi.org/10.1007/978-3-031-06527-9_37
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-06526-2
Online ISBN: 978-3-031-06527-9
eBook Packages: Computer ScienceComputer Science (R0)