Skip to main content
SpringerLink
Log in

A Distributed Optimal Control Framework for Multi-Robot Cooperative Manipulation in Dynamic Environments

  • Regular paper
  • Published:
Journal of Intelligent & Robotic Systems Aims and scope Submit manuscript

Abstract

This article proposes a control framework for cooperative robot manipulation based on distributed optimisation. Besides transporting a jointly grasped rigid object, whole-body avoidance of dynamic obstacles for the entire multi-robot system in uncertain environments is also part of the task. Since the physical connection through grasping can significantly reduce the operation capability of the system, internal performance of individual robots should be optimised during task execution. For this purpose, a framework for the characterisation of robot joint-space constraints and their inclusion into a highly multi-goal optimisation problem for the aforementioned reactive manipulation is designed. A computationally and communicationally efficient distributed optimal control algorithm based on primal decomposition is then developed for the multi-robot system to reach the optimum without generating internal conflicting forces in spite of different fields of view. Experiments on a multi-arm platform are conducted for validation. Results not only show effective coordinated avoidance of moving obstacles, but also demonstrate the benefit of optimising internal performance during cooperation.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Darmanin, R.N., Bugeja, M.K.: A Review on Multi-Robot Systems Categorised by Application Domain. IEEE, Malta (2017)

    Book  Google Scholar 

  2. Jackson, B.E., Howell, T.A., Shah, K., Schwager, M., Manchester, Z.: Scalable cooperative transport of cable-suspended loads with UAVs using distributed trajectory optimization. IEEE Robot. Autom. Lett. 5(2), 3368–3374 (2020). https://doi.org/10.1109/lra.2020.2975956

    Article  Google Scholar 

  3. Culbertson, P., Slotine, J.-J., Schwager, M.: Decentralized adaptive control for collaborative manipulation of rigid bodies. IEEE Trans. Robot. 37(6), 1906–1920 (2021). https://doi.org/10.1109/tro.2021.3072021

    Article  Google Scholar 

  4. Koung, D., Kermorgant, O., Fantoni, I., Belouaer, L.: Cooperative multi-robot object transportation system based on hierarchical quadratic programming. IEEE Robot. Autom. Lett. 6(4), 6466–6472 (2021). https://doi.org/10.1109/lra.2021.3092305

    Article  Google Scholar 

  5. Bicchi, A., Prattichizzo, D.: Manipulability of cooperating robots with unactuated joints and closed-chain mechanisms. IEEE Trans. Robot. Autom. 16(4), 336–345 (2000). https://doi.org/10.1109/70.864226

    Article  Google Scholar 

  6. Liu, Q., Chen, C.-Y., Wang, C., Wang, W.: Common Workspace Analysis for a Dual-Arm Robot Based on Reachability. IEEE, China (2017)

    Book  Google Scholar 

  7. He, Y., Wu, M., Liu, S.: Decentralised Cooperative Mobile Manipulation with Adaptive Control Parameters. Denmark, IEEE (2018)

    Book  Google Scholar 

  8. Alonso-Mora, J., Baker, S., Rus, D.: Multi-robot formation control and object transport in dynamic environments via constrained optimization. Int. J. Robot. Res. 36(9), 1000–1021 (2017). https://doi.org/10.1177/0278364917719333

    Article  Google Scholar 

  9. Erhart, S., Hirche, S.: Internal force analysis and load distribution for cooperative multi-robot manipulation. IEEE Trans. Robot. 31(5), 1238–1243 (2015). https://doi.org/10.1109/tro.2015.2459412

    Article  Google Scholar 

  10. Wei, K., Ren, B.: A method on dynamic path planning for robotic manipulator autonomous obstacle avoidance based on an improved RRT algorithm. Sensors, 18(2), 571 (2018). https://doi.org/10.3390/s18020571

    Article  Google Scholar 

  11. Shahab, M.T., Elshafei, M.: Distributed optimization of multi-robot motion with time-energy criterion. In: Hamid, U.Z.A., Sezer, V., Li, B., Huang, Y., Zakaria, M.A. (eds.) Path Planning for Autonomous Vehicle Ch 8. IntechOpen, Rijeka (2019), https://doi.org/10.5772/intechopen.85668

  12. Luis, C.E., Vukosavljev, M., Schoellig, A.P.: Online trajectory generation with distributed model predictive control for multi-robot motion planning. IEEE Robot. Autom. Lett. 5(2), 604–611 (2020). https://doi.org/10.1109/lra.2020.2964159

    Article  Google Scholar 

  13. Aladele, V., Hutchinson, S.: Collision Reaction Through Internal Stress Loading in Cooperative Manipulation. IEEE, Piscataway (2020)

    Book  Google Scholar 

  14. Salehian, S.S.M., Figueroa, N., Billard, A.: A unified framework for coordinated multi-arm motion planning. Int. J. Robot. Res. 37(10), 1205–1232 (2018). https://doi.org/10.1177/0278364918765952

    Article  Google Scholar 

  15. Dehio, N., et al: Modeling and Control of Multi-Arm And Multi-Leg Robots: Compensating for Object Dynamics During Grasping. IEEE Brisbane QLD, Australia (2018)

    Google Scholar 

  16. Wang, Z., Schwager, M.: Multi-robot manipulation without communication. In: Chong, N.-Y., Cho, Y.-J. (eds.) Distributed Autonomous Robotic Systems, pp 135–149. Springer, Tokyo (2016)

  17. Xu, H, et al: Cooperative Manipulation in Unknown Environment with Distributed Control. IEEE, Piscataway (2021)

    Book  Google Scholar 

  18. Chiacchio, P., Chiaverini, S. (eds.): Chapter 3 Kinematic control of dual-arm systems. Springer, Berlin (1998)

  19. Erhart, S., Sieber, D., Hirche, S.: An Impedance-Based Control Architecture for Multi-Robot Cooperative Dual-Arm Mobile Manipulation. IEEE, Japan (2013)

    Book  Google Scholar 

  20. Hu, J., et al: Convergent multiagent formation control with collision avoidance. IEEE Trans. Robot. 36(6), 1805–1818 (2020). https://doi.org/10.1109/tro.2020.2998766

    Article  Google Scholar 

  21. Ren, Y., Sosnowski, S., Hirche, S.: Fully distributed cooperation for networked uncertain mobile manipulators. IEEE Trans. Robot. 36(4), 984–1003 (2020). https://doi.org/10.1109/tro.2020.2971416

    Article  Google Scholar 

  22. Gen. Dohmann, P.B., Hirche, S.: Distributed control for cooperative manipulation with event-triggered communication. IEEE Trans. Robot. 36(4), 1038–1052 (2020). https://doi.org/10.1109/tro.2020.2973096

    Article  Google Scholar 

  23. Ding, G., et al: Distributed reinforcement learning for cooperative multi-robot object manipulation. In: Proceedings of the 19th International Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2020. arXiv:2003.09540 [cs.RO] (2020)

  24. Dai, G.-B., Liu, Y.-C.: Distributed coordination and cooperation control for networked mobile manipulators. IEEE Trans. Ind. Electron. 64(6), 5065–5074 (2017). https://doi.org/10.1109/tie.2016.2642880

    Article  Google Scholar 

  25. Shorinwa, O., Schwager, M.: Scalable Collaborative Manipulation with Distributed Trajectory Planning. IEEE, Piscataway (2020)

    Book  Google Scholar 

  26. Tika, A., Bajcinca, N.: Synchronous Minimum-Time Cooperative Manipulation Using Distributed Model Predictive Control. IEEE, Piscataway (2020)

  27. Williams, D., Khatib, O.: The Virtual Linkage: a Model for Internal Forces in Multi-Grasp Manipulation, vol. 1, pp 1025–1030. IEEE Comput Soc Press, Atlanta (1993)

    Google Scholar 

  28. Ortenzi, D., Muthusamy, R., Freddi, A., Monteriú, A., Kyrki, V.: Dual-arm cooperative manipulation under joint limit constraints. Robot. Auton. Syst. 99, 110–120 (2018). https://doi.org/10.1016/j.robot.2017.10.005

    Article  Google Scholar 

  29. Markley, F.L., Cheng, Y., Crassidis, J.L., Oshman, Y.: Averaging quaternions. J. Guid. Control Dynam. 30(4), 1193–1197 (2007). https://doi.org/10.2514/1.28949

    Article  Google Scholar 

  30. Sadeghian, H., Villani, L., Keshmiri, M., Siciliano, B.: Dynamic multi-priority control in redundant robotic systems. Robotica 31(7), 1155–1167 (2013). https://doi.org/10.1017/s0263574713000416

    Article  Google Scholar 

  31. He, Y., Liu, S.: Analytical Inverse Kinematics for Franka Emika Panda – A Geometrical Solver for 7-DOF Manipulators With Unconventional Design. IEEE, Piscataway (2021)

    Book  Google Scholar 

Download references

Funding

This research received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors.

Author information

Authors and Affiliations

  1. Institute of Control Systems, University of Kaiserslautern, Erwin-Schrödinger-Straße 12, Kaiserslautern, 67663, Rheinland-Pfalz, Germany

    Yanhao He, Min Wu & Steven Liu

Authors
  1. Yanhao He
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Min Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Steven Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Yanhao He: Conceptualization, Methodology, Software, Validation, Investigation, Data Curation, Writing - Original Draft, Writing - Review & Editing, Visualization; Min Wu: Conceptualization, Resources, Writing - Review & Editing; Steven Liu: Conceptualization, Methodology, Resources, Writing - Original Draft, Writing - Review & Editing, Supervision, Funding acquisition.

Corresponding author

Correspondence to Yanhao He.

Ethics declarations

Ethics Approval

Not applicable (No human/animal participant)

Consent for Publication

Not applicable (No human/animal participant)

Conflict of Interests

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Additional information

Availability of Data and Material

The authors confirm that the data supporting the findings of this study are available within this article.

Consent To Participate

Not applicable (No human/animal participant)

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Min Wu and Steven Liu These authors contributed equally to this work.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

He, Y., Wu, M. & Liu, S. A Distributed Optimal Control Framework for Multi-Robot Cooperative Manipulation in Dynamic Environments. J Intell Robot Syst 105, 8 (2022). https://doi.org/10.1007/s10846-022-01621-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10846-022-01621-4

Keywords

Search

Navigation