Abstract
In the manufacturing field, the soldering process of brazing electronic components into circuit boards and the milling process of using cutting tools to remove unnecessary parts from materials are part of the manual labor process. To ensure worker safety and improve product quality in the many tasks performed by humans, studies are promoting the collection and analysis of worker motion data. Non-contact sensing systems consider camera to capture images of the worker and detects the worker posture and dangerous movements by utilizing skeletal estimation and object recognition. However for the analysis, the worker body should be completely within the cameras angle of view. If the worker body is outside the camera angle of view or is only partially captured, the data necessary for analysis will still be lost. To capture the motion of the whole body of a worker, multiple cameras using a network of cameras are used in some cases, while in limited environments it is also important to acquire the motion data by a monocular camera. In this paper, we propose a simulation system for decision of camera angle of view and placement. We compare the simulation end experimental results. The evaluation results we conclude that the proposed system can effectively decide the camera placement and angle.
References
Toyoshima, K., et al.: Proposal of a haptics and LSTM based soldering motion analysis system. In: Proceedings of the IEEE 10-th Global Conference on Consumer Electronics, pp. 1-2 (2021)
Toyoshima, K., et al.: Design and implementation of a haptics based soldering education system. In: Proceedings of IMIS-2022, pp. 54-64 (2022)
Toyoshima, K., et al.: Experimental results of a haptics based soldering education system: a comparison study of RNN and LSTM for detection of dangerous movements. In: Proceedings of INCoS-2022, pp. 212-223 (2022)
Oda, T., et al.: Design of a deep Q-network based simulation system for actuation decision in ambient intelligence. In: Proceedings of AINA-2019, pp. 362-370 (2019)
Hirota, Y., et al.: Proposal and experimental results of an ambient intelligence for training on soldering iron holding. In: Proceedings of BWCCA-2020, pp. 444-453 (2020)
Hirota, Y., et al.: Proposal and experimental results of a DNN based real-time recognition method for ohsone style fingerspelling in static characters environment. In: Proceedings of the IEEE 9-th Global Conference on Consumer Electronics, pp. 476-477 (2020)
Andriyanov, N., et al.: Intelligent system for estimation of the spatial position of apples based on YOLOv3 and real sense depth camera D415. Symmetry 14(1) (2022)
Yang, D., et al.: Research of target detection and distance measurement technology based on YOLOv5 and depth camera. In: 2022 4th International Conference on Communications, Information System and Computer Engineering (CISCE), pp. 346-349 (2022)
Toyoshima, K., et al.: Analysis of a soldering motion for dozing state and attention posture detection. In: Proceedings of 3PGCIC-2022, pp. 146-153 (2022)
Toyoshima, K., et al.: A soldering motion analysis system for monitoring whole body of people with developmental disabilities. In: Proceedings of AINA-2023, pp. 38-46 (2023)
Toshev, A., Szegedy, C.: DeepPose: human pose estimation via deep neural networks. In: Proceedings of the 27-th IEEE/CVF Conference on Computer Vision and Pattern Recognition (IEEE/CVF CVPR-2014), pp. 1653-1660 (2014)
Haralick, R., et al.: Pose estimation from corresponding point data. IEEE Trans. Syst. 19(6), 1426–1446 (1989)
Fang, H., et al.: Rmpe: regional multi-person pose estimation. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2334-2343 (2017)
Xiao, B., Wu, H., Wei, Y.: Simple baselines for human pose estimation and tracking. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds.) ECCV 2018. LNCS, vol. 11210, pp. 472–487. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01231-1_29
Martinez, J., et al.: A simple yet effective baseline for 3d human pose estimation. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2640-2649 (2017)
Yasunaga, T., et al.: Object detection and pose estimation approaches for soldering danger detection. In: Proceedings of the IEEE 10-th Global Conference on Consumer Electronics, pp. 776-777 (2021)
Yasunaga, T., et al.: A soldering motion analysis system for danger detection considering object detection and attitude estimation. In: Proceedings of the 10-th International Conference on Emerging Internet, Data & Web Technologies, pp. 301-307 (2022)
Lugaresi, C., et al.: MediaPipe: A Framework for Building Perception Pipelines’, arXiv preprint arXiv:1906.08172 (2019)
Micilotta, A.S., Ong, E.-J., Bowden, R.: Real-time upper body detection and 3D pose estimation in monoscopic images. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3953, pp. 139–150. Springer, Heidelberg (2006). https://doi.org/10.1007/11744078_11
Julian, K., et al.: Digital game-based examination for sensor placement in context of an Industry 4.0 lecture using the Unity 3D engine-a case study. Proc. Manufact. 55, 563–570 (2022)
Acknowledgement
This work was supported by JSPS KAKENHI Grant Number JP20K19793.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Wakabayashi, K., Yukawa, C., Nagai, Y., Oda, T., Barolli, L. (2024). A Simulation System for Decision of Camera Angle View and Placement: A Comparison Study of Simulation and Experimental Results. In: Barolli, L. (eds) Advanced Information Networking and Applications. AINA 2024. Lecture Notes on Data Engineering and Communications Technologies, vol 199. Springer, Cham. https://doi.org/10.1007/978-3-031-57840-3_29
Download citation
DOI: https://doi.org/10.1007/978-3-031-57840-3_29
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-57839-7
Online ISBN: 978-3-031-57840-3
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)