Abstract
Soldering is prone to human error due to lack of concentration and corner-cutting caused by simple tasks. Therefore, it is expected that accidents can be reduced by having instructors give indication during dangerous actions or inappropriate postures during soldering iron work. In addition, it is thought that visualization of the line-of-sight can provide real-time assistance at points where mistakes are likely to occur. In this paper, in order to solve these problems, we propose soldering danger detection system and a line-of-sight estimation. The experimental results confirm that the proposed system is effective in detecting hazards during soldering by estimating the line-of-sight.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Yasunaga, T., et al.: Object detection and pose estimation approaches for soldering danger detection. In: Proceedings of the IEEE 10th Global Conference on Consumer Electronics, pp. 776–777 (2021)
Yasunaga, T., et al.: A soldering motion analysis system for danger detection considering object detection and attitude estimation. In: Barolli, L., Kulla, E., Ikeda, M. (eds.) EIDWT 2022. LNDECT, vol. 118, pp. 301–307. Springer, Cham (2022). https://doi.org/10.1007/978-3-030-95903-6_32
Toyoshima, K., et al.: Proposal of a haptics and LSTM based soldering motion analysis system. In: Proceedings of the IEEE 10th Global Conference on Consumer Electronics, pp. 1–2 (2021)
Hirota, Y., Oda, T., Saito, N., Hirata, A., Hirota, M., Katatama, K.: Proposal and experimental results of an ambient intelligence for training on soldering iron holding. In: Barolli, L., Takizawa, M., Enokido, T., Chen, H.-C., Matsuo, K. (eds.) BWCCA 2020. LNNS, vol. 159, pp. 444–453. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-61108-8_44
Oda, T., et al.: Design and implementation of an IoT-based E-learning testbed. Int. J. Web Grid Serv. 13(2), 228–241 (2017)
Liu, Y., et al.: Design and implementation of testbed using IoT and P2P technologies: improving reliability by a fuzzy-based approach. Int. J. Commun. Netw. Distrib. Syst. 19(3), 312–337 (2017)
Yang, G., et al.: Eye tracking using monocular camera for gaze estimation applications. In: 2016 IEEE International Conference on Electro Information Technology (EIT), pp. 0292–0296 (2016)
Papageorgiou, C., et al.: A general framework for object detection. In: The IEEE 6th International Conference on Computer Vision, pp. 555–562 (1998)
Felzenszwalb, P., et al.: Object detection with discriminatively trained part-based models. IEEE Trans. Pattern Anal. Mach. Intell. 32(9), 1627–1645 (2009)
Obukata, R., et al.: Design and evaluation of an ambient intelligence testbed for improving quality of life. Int. J. Space-Based Situated Comput. 7(1), 8–15 (2017)
Oda, T., Ueda, C., Ozaki, R., Katayama, K.: Design of a deep Q-network based simulation system for actuation decision in ambient intelligence. In: Barolli, L., Takizawa, M., Xhafa, F., Enokido, T. (eds.) WAINA 2019. AISC, vol. 927, pp. 362–370. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-15035-8_34
Obukata, R., et al.: Performance evaluation of an Am I testbed for improving QoL: evaluation using clustering approach considering distributed concurrent processing. In: Proceedings of IEEE AINA 2017, pp. 271–275 (2017)
Yamada, M., et al.: Evaluation of an IoT-based e-learning testbed: Performance of OLSR protocol in a NLoS environment and mean-shift clustering approach considering electroencephalogram data. Int. J. Web Inf. Syst. 13(1), 2–13 (2017)
Toshev, A., Szegedy, C.: DeepPose: human pose estimation via deep neural networks. In: Proceedings of the 27th IEEE/CVF Conference on Computer Vision and Pattern Recognition (IEEE/CVF CVPR 2014), pp. 1653–1660 (2014)
Haralick, R., et al.: Pose estimation from corresponding point data. IEEE Trans. Syst. 19(6), 1426–1446 (1989)
Fang, H., et al.: RMPE: regional multi-person pose estimation. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2334–2343 (2017)
Xiao, B., et al.: Simple baselines for human pose estimation and tracking. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 466–481 (2018)
Martinez, J., et al.: A simple yet effective baseline for 3D human pose estimation. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2640–2649 (2017)
Redmon, J., et al.: You only look once: unified, real-time object detection. In: Proceedings of the 29th IEEE/CVF Conference on Computer Vision and Pattern Recognition (IEEE/CVF CVPR 2016), pp. 779–788 (2016)
Zhou, F., et al.: Safety helmet detection based on YOLOv5. In: The IEEE International Conference on Power Electronics, Computer Applications (ICPECA), pp. 6–11 (2021)
Yu-Chuan, B., et al.: Using improved YOLOv5s for defect detection of thermistor wire solder joints based on infrared thermography. In: The 5th International Conference on Automation, Control and Robots (ICACR), pp. 29–32 (2021)
Zhang, F., et al.: MediaPipe hands: on-device real-time hand tracking. arXiv preprint arXiv:2006.10214 (2020)
Shin, J., et al.: American sign language alphabet recognition by extracting feature from hand pose estimation. Sensors 21(17), 5856 (2021)
Hirota, Y., et al.: Proposal and experimental results of a DNN based real-time recognition method for Ohsone style fingerspelling in static characters environment. In: Proceedings of the IEEE 9th Global Conference on Consumer Electronics, pp. 476–477 (2020)
Erol, A., et al.: Vision-based hand pose estimation: a review. Comput. Vis. Image Underst. 108, 52–73 (2007)
Lugaresi, C., et al.: MediaPipe: a framework for building perception pipelines. arXiv preprint arXiv:1906.08172 (2019)
Micilotta, A.S., Ong, E.-J., Bowden, R.: Real-time upper body detection and 3D pose estimation in monoscopic images. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3953, pp. 139–150. Springer, Heidelberg (2006). https://doi.org/10.1007/11744078_11
Gill, P.E., et al.: On projected Newton barrier methods for linear programming and an equivalence to Karmarkar’s projective method. Math. Program. 36, 183–209 (1986)
Acknowledgement
This work was supported by JSPS KAKENHI Grant Number JP20K19793.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Yasunaga, T. et al. (2022). Soldering Danger Detection System Using a Line-of-Sight Estimation. In: Barolli, L., Miwa, H., Enokido, T. (eds) Advances in Network-Based Information Systems. NBiS 2022. Lecture Notes in Networks and Systems, vol 526. Springer, Cham. https://doi.org/10.1007/978-3-031-14314-4_6
Download citation
DOI: https://doi.org/10.1007/978-3-031-14314-4_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-14313-7
Online ISBN: 978-3-031-14314-4
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)