Abstract
Safety is a critical component for human–robot cohabitation. The control barrier function (CBF) provides an effective tool to build up the constraint and ensure the safety of human–robot interaction. However, since the human and robot keep moving during human–robot interaction, the closest points between parts of them also change. Especially, the human trajectories are not known in prior, which may cause the above safety constraint to fail. In this paper, we construct the safe constraints based on discrete control barrier function (DCBF) by redefining the distance between each link of the robot and each part of the human body as the distance between two line segments in the space. In addition, the look-backward-and-forward strategy is applied to update the neural network model for predicting of human’s motion trajectory effectively. Meanwhile, the root mean square estimation error is included in the safe constraints as the metric of uncertainty to compensate the estimation error of the predicted trajectory. Combining the discrete-time control Lyapunov function, a comprehensive control method under human–robot-coexistence environment is formed. The trajectory of a human’s right arm collected by Qualisys capture system. The experiment are set up by integrating above testbed with a virtual KUKA iiwa model built by MATLAB. The results show that the robot can maintain a safe distance from the human when the DCBF-based constraints with prediction information are used, which verifies the effectiveness of the proposed method.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Agrawal, A., & Sreenath, K. (2017). Discrete control barrier functions for safety-critical control of discrete systems with application to bipedal robot navigation. In Robotics: Science and Systems (Vol. 13). Cambridge University Press.
Ajoudani, A., Zanchettin, A. M., Ivaldi, S., Albu-Schäffer, A., Kosuge, K., & Khatib, O. (2018). Progress and prospects of the human-robot collaboration. Autonomous Robots, 42(5), 957–975.
Ames, A. D., Galloway, K., Sreenath, K., & Grizzle, J. W. (2014a). Rapidly exponentially stabilizing control Lyapunov functions and hybrid zero dynamics. IEEE Transactions on Automatic Control, 59(4), 876–891.
Ames, A. D., Grizzle, J. W., & Tabuada, P. (2014b). Control barrier function based quadratic programs with application to adaptive cruise control. In 53rd IEEE Conference on Decision and Control (pp. 6271–6278). IEEE.
Ames, A. D., Xu, X., Grizzle, J. W., & Tabuada, P. (2016). Control barrier function based quadratic programs for safety critical systems. IEEE Transactions on Automatic Control, 62(8), 3861–3876.
Chen, S., Zhu, Y., Liu, Y., Zhang, C., Piao, Z., & Yang, G. (2022). A “look-backward-and-foward’’ strategy for assessing parameter estimation error of human motion prediction model. IEEE Robotics and Automation Letters, 7(2), 2629–2636.
Cheng, Y., Zhao, W., Liu, C., & Tomizuka, M. (2019). Human motion prediction using semi-adaptable neural networks. In 2019 American Control Conference (ACC) (pp. 4884–4890). IEEE.
Du, Y., Wang, W., & Wang, L. (2015). Hierarchical recurrent neural network for skeleton based action recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1110–1118).
Faccio, M., Granata, I., & Minto, R. (2023). Task allocation model for human-robot collaboration with variable cobot speed. Journal of Intelligent Manufacturing, 1–14.
Ferraguti, F., Bertuletti, M., Landi, C. T., Bonfè, M., Fantuzzi, C., & Secchi, C. (2020a). A control barrier function approach for maximizing performance while fulfilling to ISO/TS 15066 regulations. IEEE Robotics and Automation Letters, 5(4), 5921–5928.
Ferraguti, F., Landi, C. T., Costi, S., Bonfè, M., Farsoni, S., Secchi, C., & Fantuzzi, C. (2020b). Safety barrier functions and multi-camera tracking for human-robot shared environment. Robotics and Autonomous Systems, 124, 103388.
Fujii, S., & Pham, Q.-C. (2022). Realtime trajectory smoothing with neural nets. In 2022 International Conference on Robotics and Automation (ICRA) (pp. 7248–7254). IEEE.
Grizzle, J., & Kang, J.-M. (2001). Discrete-time control design with positive semi-definite Lyapunov functions. Systems & Control Letters, 43(4), 287–292.
Hegde, A., & Ghose, D. (2021). Multi-UAV collaborative transportation of payloads with obstacle avoidance. IEEE Control Systems Letters, 6, 926–931.
Hu, Y., Wang, Y., Hu, K., & Li, W. (2021). Adaptive obstacle avoidance in path planning of collaborative robots for dynamic manufacturing. Journal of Intelligent Manufacturing, 1–19.
Lacevic, B., Rocco, P., & Zanchettin, A. M. (2013). Safety assessment and control of robotic manipulators using danger field. IEEE Transactions on Robotics, 29(5), 1257–1270.
Landi, C. T., Ferraguti, F., Costi, S., Bonfè, M., & Secchi, C. (2019). Safety barrier functions for human-robot interaction with industrial manipulators. In 2019 18th European Control Conference (ECC) (pp. 2565–2570). IEEE.
Lehrmann, A. M., Gehler, P. V., & Nowozin, S. (2014). Efficient nonlinear Markov models for human motion. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1314–1321).
Li, M., Chen, S., Chen, X., Zhang, Y., Wang, Y., & Tian, Q. (2021). Symbiotic graph neural networks for 3D skeleton-based human action recognition and motion prediction. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(6), 3316–3333.
Liu, C., & Tomizuka, M. (2014). Control in a safe set: addressing safety in human-robot interactions. In Dynamic Systems and Control Conference (Vol. 46209, p. 003-42003). American Society of Mechanical Engineers
Liu, C., & Tomizuka, M. (2015). Safe exploration: Addressing various uncertainty levels in human robot interactions. In 2015 American Control Conference (ACC) (pp. 465–470). IEEE.
MathWorks: Documentation, Choosing the Algorithm. https://www.mathworks.com/help/optim/ug/choosing-the-algorithm.html.
Maurtua, I., Ibarguren, A., Kildal, J., Susperregi, L., & Sierra, B. (2017). Human-robot collaboration in industrial applications: Safety, interaction and trust. International Journal of Advanced Robotic Systems, 14(4), 1729881417716010.
Merkt, W., Ivan, V., & Vijayakumar, S. (2019). Continuous-time collision avoidance for trajectory optimization in dynamic environments. In 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (pp. 7248–7255). IEEE
Nascimento, H., Mujica, M., & Benoussaad, M. (2020). Collision avoidance interaction between human and a hidden robot based on kinect and robot data fusion. IEEE Robotics and Automation Letters, 6(1), 88–94.
Nguyen, Q., Hereid, A., Grizzle, J. W., Ames, A. D., & Sreenath, K. (2016). 3D dynamic walking on stepping stones with control barrier functions. In 2016 IEEE 55th Conference on Decision and Control (CDC) (pp. 827–834). IEEE.
Park, D.-H., Hoffmann, H., Pastor, P., & Schaal, S. (2008). Movement reproduction and obstacle avoidance with dynamic movement primitives and potential fields. In Humanoids 2008-8th IEEE-RAS international conference on humanoid robots (pp. 91–98). IEEE
Rauscher, M., Kimmel, M., & Hirche, S. (2016). Constrained robot control using control barrier functions. In 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (pp. 279–285). IEEE.
Siciliano, B. (1990). Kinematic control of redundant robot manipulators: A tutorial. Journal of Intelligent and Robotic Systems, 3(3), 201–212.
Singletary, A., Klingebiel, K., Bourne, J., Browning, A., Tokumaru, P., & Ames, A. (2020). Comparative analysis of control barrier functions and artificial potential fields for obstacle avoidance. In 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (pp. 8129–8136). IEEE.
Singletary, A., Kolathaya, S., & Ames, A. D. (2021). Safety-critical kinematic control of robotic systems. IEEE Control Systems Letters, 6, 139–144.
Tang, Y., Ma, L., Liu, W., & Zheng, W. (2018). Long-term human motion prediction by modeling motion context and enhancing motion dynamic. In 27th International Joint Conference on Artificial Intelligence (IJCAI’18) (pp. 935–941). ACM.
Tanimoto, J., Hagishima, A., & Tanaka, Y. (2010). Study of bottleneck effect at an emergency evacuation exit using cellular automata model, mean field approximation analysis, and game theory. Physica A: Statistical Mechanics and Its Applications, 389(24), 5611–5618.
Yoshida, E., Esteves, C., Belousov, I., Laumond, J.-P., Sakaguchi, T., & Yokoi, K. (2008). Planning 3-d collision-free dynamic robotic motion through iterative reshaping. IEEE Transactions on Robotics, 24(5), 1186–1198.
Acknowledgements
The authors would like to thank the funding support from the National Natural Science Foundation of China under Grants U20A20282, U1813223, 92048201, and U1913214, the Robotics Innovational Institute of Chinese Academy of Sciences under Grant C2021001, and Zhejiang Key R &D Plan under Grant 2021C01069.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Zhu, Y., Chen, S., Zhang, C. et al. Development of adaptive safety constraint by predicting trajectories of closest points between human and co-robot. J Intell Manuf 35, 1197–1206 (2024). https://doi.org/10.1007/s10845-023-02102-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10845-023-02102-7