Abstract
This paper presents a novel decentralized control approach for modular and reconfigurable robots (MRRs) with uncertain environment contact under a learning-based optimal compensation strategy. Unlike the known optimal control methods that are merely suitable for specific classes of robotic systems without implementing dynamic compensations, in this investigation, the dynamic model of the MRR system is described as a synthesis of interconnected subsystems, in which the obtainable local dynamic information is utilized effectively to construct the feedback controller, thus making the decentralized optimal control problem of the MRR system be formulated as an optimal compensation issue of the model uncertainty. A policy iteration algorithm is employed to solve the Hamilton-Jacobi-Bellman (HJB) equation with a modified cost function, which is approximated by constructing a critic neural network, and then the approximate optimal control policy can be derived. The asymptotic stability of the closed-loop MRR system is proved by using the Lyapunov theory. At last, simulations are performed to verify the effectiveness of the proposed decentralized optimal control approach.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Patchaikani, P., Behera, L., Prasad, G.: A single network adaptive critic-based redundancy resolution scheme for robot manipulators. IEEE Trans. Ind. Electron. 59, 3241–3253 (2012)
Tang, L., Liu, Y., Tong, S.: Adaptive neural control using reinforcement learning for a class of robot manipulator. Neural Comput. Appl. 25, 135–141 (2014)
Li, Y., Chen, L., Tee, K., Li, Q.: Reinforcement learning control for coordinated manipulation of multi-robots. Neurocomputing 170, 168–175 (2015)
Nageshrao, S., Lopes, G., Jeltsema, D., Babuska, R.: Passivity-based reinforcement learning control of a 2-DOF manipulator arm. Mechatronics 24, 1001–1007 (2014)
Liu, D., Wang, D., Li, H.: Decentralized stabilization for a class of continuous-time nonlinear interconnected systems using online learning optimal control approach. IEEE Trans. Neural Netw. Learn. Syst. 25, 418–428 (2014)
Wang, D., Liu, D., Mu, C., Ma, H.: Decentralized guaranteed cost control of interconnected systems with uncertainties: a learning-based optimal control strategy. Neurocomputing 214, 297–306 (2016)
Dong, B., Li, Y.: Decentralized integral nested sliding mode control for time varying constrained modular and reconfigurable robot. Adv. Mech. Eng. 7, 1–15 (2015)
Imura, J., Yokokohji, Y., Yoshikawa, T., Sugie, T.: Robust control of robot manipulators based on joint torque sensor information. Int. J. Robot. Res. 13, 434–442 (1994)
Zhang, H., Ahmad, S., Liu, G.: Torque estimation for robotic joint with harmonic drive transmission based on position measurements. IEEE Trans. Robot. 31, 322–330 (2015)
Zhao, B., Liu, D., Li, Y.: Online fault compensation control based on policy iteration algorithm for a class of affine non-linear systems with actuator failures. IET Control Theory Appl. 10, 1816–1823 (2016)
Dong, B., Li, Y.: Decentralized reinforcement learning robust optimal tracking control for time varying constrained reconfigurable modular robot based on ACI and Q-function. Math. Probl. Eng. 2013, 1–16 (2013)
Dong, B., Li, Y., Liu, K.: Decentralized control for harmonic drive–based modular and reconfigurable robots with uncertain environment contact. Adv. Mech. Eng. 9, 1–14 (2017)
Acknowledgments
This work is supported by the National Natural Science Foundation of China (Grant no. 61374051), the State Key Laboratory of Management and Control for Complex Systems (Grant no. 20150102), the Scientific Technological Development Plan Project in Jilin Province of China (Grant nos. 20160520013JH, 20160414033GH and 20150520112JH) and the Science and Technology project of Jilin Provincial Education Department of China during the 13th Five-Year Plan Period (JJKH20170569KJ).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Dong, B., Liu, K., Li, H., Li, Y. (2017). A Learning-Based Decentralized Optimal Control Method for Modular and Reconfigurable Robots with Uncertain Environment. In: Liu, D., Xie, S., Li, Y., Zhao, D., El-Alfy, ES. (eds) Neural Information Processing. ICONIP 2017. Lecture Notes in Computer Science(), vol 10639. Springer, Cham. https://doi.org/10.1007/978-3-319-70136-3_2
Download citation
DOI: https://doi.org/10.1007/978-3-319-70136-3_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-70135-6
Online ISBN: 978-3-319-70136-3
eBook Packages: Computer ScienceComputer Science (R0)