Abstract
IoT and smart systems have been introduced into the advanced manufacturing, especially 3D printing with the trend of the fourth industrial revolution. The rapid development of computer vision and IoT devices in recent years has led the fruitful direction to the development of real-time machine state monitoring. In this study, computer vision technology was adopted into the Smart Connected Worker (SCW) system with the use case of 3D printing. Specifically, artificial intelligence (AI) models were investigated instead of discrete labor-intensive methods to monitor the machine state and predict the errors and risks for the advanced manufacturing. The model achieves accurate supervision in real-time for twenty-four hours a day, which can reduce human resource costs significantly. At the same time, the experiments demonstrate the feasibility of adopting AI technology to more aspects of the advanced manufacturing.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Schaller, R.R.: Moore’s law: past, present and future. IEEE Spectrum 34(6), 52–59 (1997)
Weinstein, B.G.: A computer vision for animal ecology. J. Anim. Ecol. 87(3), 533–545 (2018)
Wang, Y., Zheng, P., Xun, X., Yang, H., Zou, J.: Production planning for cloud-based additive manufacturing–a computer vision-based approach. Robot. Comput.-Integr. Manuf. 58, 145–157 (2019)
Pathak, A.R., Pandey, M., Rautaray, S., Pawar, K.: Assessment of object detection using deep convolutional neural networks. In: Bhalla, S., Bhateja, V., Chandavale, A.A., Hiwale, A.S., Satapathy, S.C. (eds.) Intelligent Computing and Information and Communication. AISC, vol. 673, pp. 457–466. Springer, Singapore (2018). https://doi.org/10.1007/978-981-10-7245-1_45
Zhang, B., Jaiswal, P., Rai, R., Guerrier, P., Baggs, G.: Convolutional neural network-based inspection of metal additive manufacturing parts. Rapid Prototyping J. 25(3), 530–540 (2019)
Li, J., Götvall, P., Provost, J., Åkesson, K.: Training convolutional neural networks with synthesized data for object recognition in industrial manufacturing. In: 2019 24th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA), pp. 1544–1547 (2019)
Beschi, M., Villagrossi, E., Molinari Tosatti, L., Surdilovic, D.: Sensorless model-based object-detection applied on an underactuated adaptive hand enabling an impedance behavior. Robot. Comput.-Integr. Manuf. 46, 38–47 (2017)
Khodabandeh, M., Vahdat, A., Ranjbar, M., Macready, W.G.: A robust learning approach to domain adaptive object detection. In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), October 2019
Anitha, R., Jayalakshmi, S.: A systematic hybrid smart region based detection (SRBD) method for object detection. In: 2020 3rd International Conference on Intelligent Sustainable Systems (ICISS), pp. 139–145 (2020)
Mehmood, F., Ullah, I., Ahmad, S., Kim, D.: Object detection mechanism based on deep learning algorithm using embedded IOT devices for smart home appliances control in cot. Journal of Ambient Intelligence and Humanized Computing (2019)
Hu, L., Ni, Q.: Iot-driven automated object detection algorithm for urban surveillance systems in smart cities. IEEE Internet of Things J. 5(2), 747–754 (2018)
Sudharsan, B., Kumar, S.P., Dhakshinamurthy, R.: Ai vision: smart speaker design and implementation with object detection custom skill and advanced voice interaction capability. In: 2019 11th International Conference on Advanced Computing (ICoAC), pp. 97–102 (2019)
Wilson, G., et al.: Robot-enabled support of daily activities in smart home environments. Cognitive Syst. Res. 54, 258–272 (2019)
LeCun, Y., et al.: Backpropagation applied to handwritten zip code recognition. Neural Comput. 1(4), 541–551 (1989)
Girshick, R., Donahue, J., Darrell, T., Malik, J.: Rich feature hierarchies for accurate object detection and semantic segmentation (2014)
Cortes, C., Vapnik, V.: Support-vector networks. Mach. Learn. 20(3), 273–297 (1995)
Liu, W., et al.: SSD: single shot multibox detector. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9905, pp. 21–37. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46448-0_2
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition (2015)
Redmon, J., Divvala, S., Girshick, R., Ali, F.: Unified, real-time object detection, You only look once (2016)
Chen, S.L., Lin, S.C., Huang, Y., Jen, C.W., Lin, Z.L., Su, S.F.: A vision-based dual-axis positioning system with yolov4 and improved genetic algorithms. In: 2020 Fourth IEEE International Conference on Robotic Computing (IRC), pp. 127–134 (2020)
Bradski, G.: The OpenCV library. Dr. Dobb’s J. Softw. Tools 25, 120–125 (2000)
San Diego Pacific Research Platform University of California. Nautilus
Redmon, J., Farhadi, A.: Yolov3: An incremental improvement. arXiv (2018)
Lin, T.-Y., et al.: Microsoft coco: Common objects in context (2015)
He, K., Gkioxari, G., Dollár, P., Girshick, R.: Mask r-cnn (2018)
Acknowledgement
This research was mainly supported by the Technical Roadmap Project “Establishing Smart Connected Workers Infrastructure for Enabling Advanced Manufacturing: A Pathway to Implement Smart Manufacturing for Small to Medium Sized Enterprises (SMEs)” funded by the Clean Energy Smart Manufacturing Innovation Institute (CESMII) sponsored through the U.S. Department of Energy’s Office of Energy Efficiency and Renewable Energy (EERE) under the Advanced Manufacturing Office (Award Number DOE: DE-EE0007613). This work was also supported by the project “Autonomy Research Center for STEAHM” sponsored through the U.S. NASA Minority University Research and Education Project (MUREP) Institutional Research Opportunity (MIRO) program (Award Number: 80NSSC19M0200).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Bian, S. et al. (2021). Real-Time Object Detection for Smart Connected Worker in 3D Printing. In: Paszynski, M., Kranzlmüller, D., Krzhizhanovskaya, V.V., Dongarra, J.J., Sloot, P.M. (eds) Computational Science – ICCS 2021. ICCS 2021. Lecture Notes in Computer Science(), vol 12745. Springer, Cham. https://doi.org/10.1007/978-3-030-77970-2_42
Download citation
DOI: https://doi.org/10.1007/978-3-030-77970-2_42
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-77969-6
Online ISBN: 978-3-030-77970-2
eBook Packages: Computer ScienceComputer Science (R0)