Skip to main content

Soldering Danger Detection System Using a Line-of-Sight Estimation

  • Conference paper
  • First Online:
Advances in Network-Based Information Systems (NBiS 2022)

Abstract

Soldering is prone to human error due to lack of concentration and corner-cutting caused by simple tasks. Therefore, it is expected that accidents can be reduced by having instructors give indication during dangerous actions or inappropriate postures during soldering iron work. In addition, it is thought that visualization of the line-of-sight can provide real-time assistance at points where mistakes are likely to occur. In this paper, in order to solve these problems, we propose soldering danger detection system and a line-of-sight estimation. The experimental results confirm that the proposed system is effective in detecting hazards during soldering by estimating the line-of-sight.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 299.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 379.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Yasunaga, T., et al.: Object detection and pose estimation approaches for soldering danger detection. In: Proceedings of the IEEE 10th Global Conference on Consumer Electronics, pp. 776–777 (2021)

    Google Scholar 

  2. Yasunaga, T., et al.: A soldering motion analysis system for danger detection considering object detection and attitude estimation. In: Barolli, L., Kulla, E., Ikeda, M. (eds.) EIDWT 2022. LNDECT, vol. 118, pp. 301–307. Springer, Cham (2022). https://doi.org/10.1007/978-3-030-95903-6_32

    Chapter  Google Scholar 

  3. Toyoshima, K., et al.: Proposal of a haptics and LSTM based soldering motion analysis system. In: Proceedings of the IEEE 10th Global Conference on Consumer Electronics, pp. 1–2 (2021)

    Google Scholar 

  4. Hirota, Y., Oda, T., Saito, N., Hirata, A., Hirota, M., Katatama, K.: Proposal and experimental results of an ambient intelligence for training on soldering iron holding. In: Barolli, L., Takizawa, M., Enokido, T., Chen, H.-C., Matsuo, K. (eds.) BWCCA 2020. LNNS, vol. 159, pp. 444–453. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-61108-8_44

    Chapter  Google Scholar 

  5. Oda, T., et al.: Design and implementation of an IoT-based E-learning testbed. Int. J. Web Grid Serv. 13(2), 228–241 (2017)

    Article  Google Scholar 

  6. Liu, Y., et al.: Design and implementation of testbed using IoT and P2P technologies: improving reliability by a fuzzy-based approach. Int. J. Commun. Netw. Distrib. Syst. 19(3), 312–337 (2017)

    Google Scholar 

  7. Yang, G., et al.: Eye tracking using monocular camera for gaze estimation applications. In: 2016 IEEE International Conference on Electro Information Technology (EIT), pp. 0292–0296 (2016)

    Google Scholar 

  8. Papageorgiou, C., et al.: A general framework for object detection. In: The IEEE 6th International Conference on Computer Vision, pp. 555–562 (1998)

    Google Scholar 

  9. Felzenszwalb, P., et al.: Object detection with discriminatively trained part-based models. IEEE Trans. Pattern Anal. Mach. Intell. 32(9), 1627–1645 (2009)

    Article  Google Scholar 

  10. Obukata, R., et al.: Design and evaluation of an ambient intelligence testbed for improving quality of life. Int. J. Space-Based Situated Comput. 7(1), 8–15 (2017)

    Article  Google Scholar 

  11. Oda, T., Ueda, C., Ozaki, R., Katayama, K.: Design of a deep Q-network based simulation system for actuation decision in ambient intelligence. In: Barolli, L., Takizawa, M., Xhafa, F., Enokido, T. (eds.) WAINA 2019. AISC, vol. 927, pp. 362–370. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-15035-8_34

    Chapter  Google Scholar 

  12. Obukata, R., et al.: Performance evaluation of an Am I testbed for improving QoL: evaluation using clustering approach considering distributed concurrent processing. In: Proceedings of IEEE AINA 2017, pp. 271–275 (2017)

    Google Scholar 

  13. Yamada, M., et al.: Evaluation of an IoT-based e-learning testbed: Performance of OLSR protocol in a NLoS environment and mean-shift clustering approach considering electroencephalogram data. Int. J. Web Inf. Syst. 13(1), 2–13 (2017)

    Article  Google Scholar 

  14. Toshev, A., Szegedy, C.: DeepPose: human pose estimation via deep neural networks. In: Proceedings of the 27th IEEE/CVF Conference on Computer Vision and Pattern Recognition (IEEE/CVF CVPR 2014), pp. 1653–1660 (2014)

    Google Scholar 

  15. Haralick, R., et al.: Pose estimation from corresponding point data. IEEE Trans. Syst. 19(6), 1426–1446 (1989)

    Google Scholar 

  16. Fang, H., et al.: RMPE: regional multi-person pose estimation. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2334–2343 (2017)

    Google Scholar 

  17. Xiao, B., et al.: Simple baselines for human pose estimation and tracking. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 466–481 (2018)

    Google Scholar 

  18. Martinez, J., et al.: A simple yet effective baseline for 3D human pose estimation. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2640–2649 (2017)

    Google Scholar 

  19. Redmon, J., et al.: You only look once: unified, real-time object detection. In: Proceedings of the 29th IEEE/CVF Conference on Computer Vision and Pattern Recognition (IEEE/CVF CVPR 2016), pp. 779–788 (2016)

    Google Scholar 

  20. Zhou, F., et al.: Safety helmet detection based on YOLOv5. In: The IEEE International Conference on Power Electronics, Computer Applications (ICPECA), pp. 6–11 (2021)

    Google Scholar 

  21. Yu-Chuan, B., et al.: Using improved YOLOv5s for defect detection of thermistor wire solder joints based on infrared thermography. In: The 5th International Conference on Automation, Control and Robots (ICACR), pp. 29–32 (2021)

    Google Scholar 

  22. Zhang, F., et al.: MediaPipe hands: on-device real-time hand tracking. arXiv preprint arXiv:2006.10214 (2020)

  23. Shin, J., et al.: American sign language alphabet recognition by extracting feature from hand pose estimation. Sensors 21(17), 5856 (2021)

    Article  Google Scholar 

  24. Hirota, Y., et al.: Proposal and experimental results of a DNN based real-time recognition method for Ohsone style fingerspelling in static characters environment. In: Proceedings of the IEEE 9th Global Conference on Consumer Electronics, pp. 476–477 (2020)

    Google Scholar 

  25. Erol, A., et al.: Vision-based hand pose estimation: a review. Comput. Vis. Image Underst. 108, 52–73 (2007)

    Article  Google Scholar 

  26. Lugaresi, C., et al.: MediaPipe: a framework for building perception pipelines. arXiv preprint arXiv:1906.08172 (2019)

  27. Micilotta, A.S., Ong, E.-J., Bowden, R.: Real-time upper body detection and 3D pose estimation in monoscopic images. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3953, pp. 139–150. Springer, Heidelberg (2006). https://doi.org/10.1007/11744078_11

    Chapter  Google Scholar 

  28. Gill, P.E., et al.: On projected Newton barrier methods for linear programming and an equivalence to Karmarkar’s projective method. Math. Program. 36, 183–209 (1986)

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgement

This work was supported by JSPS KAKENHI Grant Number JP20K19793.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Tetsuya Oda .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Yasunaga, T. et al. (2022). Soldering Danger Detection System Using a Line-of-Sight Estimation. In: Barolli, L., Miwa, H., Enokido, T. (eds) Advances in Network-Based Information Systems. NBiS 2022. Lecture Notes in Networks and Systems, vol 526. Springer, Cham. https://doi.org/10.1007/978-3-031-14314-4_6

Download citation

Publish with us

Policies and ethics