Skip to main content
Log in

Distributed iterative learning control for multi-agent systems

Theoretic developments and application to formation flying

  • Published:
Autonomous Robots Aims and scope Submit manuscript

Abstract

The goal of this work is to enable a team of quadrotors to learn how to accurately track a desired trajectory while holding a given formation. We solve this problem in a distributed manner, where each vehicle has only access to the information of its neighbors. The desired trajectory is only available to one (or few) vehicle(s). We present a distributed iterative learning control (ILC) approach where each vehicle learns from the experience of its own and its neighbors’ previous task repetitions and adapts its feedforward input to improve performance. Existing algorithms are extended in theory to make them more applicable to real-world experiments. In particular, we prove convergence of the learning scheme for any linear, causal learning function with gains chosen according to a simple scalar condition. Previous proofs were restricted to a specific learning function, which only depends on the tracking error derivative (D-type ILC). This extension provides more degrees of freedom in the ILC design and, as a result, better performance can be achieved. We also show that stability is not affected by a linear dynamic coupling between neighbors. This allows the use of an additional consensus feedback controller to compensate for non-repetitive disturbances. Possible robustness extensions for the ILC algorithm are discussed, the so-called Q-filter and a Kalman filter for disturbance estimation. Finally, this is the first work to show distributed ILC in experiment. With a team of two quadrotors, the practical applicability of the proposed distributed multi-agent ILC approach is attested and the benefits of the theoretic extension are analyzed. In a second experimental setup with a team of four quadrotors, we evaluate the impact of different communication graph structures on the learning performance. The results indicate, that there is a trade-off between fast learning convergence and formation synchronicity, especially during the first iterations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23

Similar content being viewed by others

References

  1. Ren, W., Beard, R. W., & Atkins, E. M. (2005). A survey of consensus problems in multi-agent coordination. In Proceedings of the American control conference (ACC) (pp. 1859–1864).

  2. Olfati-Saber, R., & Murray, R. M. (2004). Consensus problems in networks of agents with switching topology and time-delays. IEEE Transactions on Automatic Control, 49(9), 1520–1533.

    Article  MathSciNet  Google Scholar 

  3. Ren, W., Beard, R. W., & Atkins, E. M. (2007). Information consensus in multivehicle cooperative control. IEEE Control Systems Magazine, 27(2), 71–82.

    Article  Google Scholar 

  4. Xie, G., & Wang, L. (2007). Consensus control for a class of networks of dynamic agents. International Journal of Robust and Nonlinear Control, 17(10–11), 941–959.

    Article  MathSciNet  Google Scholar 

  5. Arimoto, S., Kawamura, S., & Miyazaki, F. (1984). Bettering operation of robots by learning. Journal of Robotic Systems, 1(2), 123–140.

    Article  Google Scholar 

  6. Bristow, D. A., Tharayil, M., & Alleyne, A. G. (2006). A survey of iterative learning control. IEEE Control Systems, 26(3), 96–114.

    Article  Google Scholar 

  7. Schoellig, A. P., Mueller, F. L., & D’Andrea, R. (2012). Optimization-based iterative learning for precise quadrocopter trajectory tracking. Autonomous Robots, 33(1–2), 103–127.

    Article  Google Scholar 

  8. Hehn, M., & D’Andrea, R. (2014). A frequency domain iterative learning algorithm for high-performance, periodic quadrocopter maneuvers. Mechatronics, 24(8), 954–965.

    Article  Google Scholar 

  9. Barton, K. L., & Alleyne, A. G. (2008). A cross-coupled iterative learning control design for precision motion control. IEEE Transactions on Control Systems Technology, 16(6), 1218–1231.

    Article  Google Scholar 

  10. Ahn, H.-S., & Chen, Y. (2009). Iterative learning control for multi-agent formation. In Proceedings of ICROS-SICE international joint conference (pp. 3111–3116).

  11. Yang, S., Xu, J.-X., & Huang, D. (2012). Iterative learning control for multi-agent systems consensus tracking. In Proceedings of the IEEE conference on decision and control (CDC) (pp. 4672–4677).

  12. Meng, D., Jia, Y., Du, J., & Yu, F. (2012). Tracking control over a finite interval for multi-agent systems with a time-varying reference trajectory. Systems & Control Letters, 61(7), 807–818.

    Article  MathSciNet  Google Scholar 

  13. Liu, Y., & Jia, Y. (2012). An iterative learning approach to formation control of multi-agent systems. Systems & Control Letters, 61(1), 148–154.

    Article  MathSciNet  Google Scholar 

  14. Li, J., & Li, J. (2014). Adaptive iterative learning control for coordination of second-order multi-agent systems. International Journal of Robust and Nonlinear Control, 24, 3282–3299.

    Article  MathSciNet  Google Scholar 

  15. Liu, Y., & Jia, Y. (2015). Robust formation control of discrete-time multi-agent systems by iterative learning approach. International Journal of Systems Science, 46(4), 625–633.

    Article  MathSciNet  Google Scholar 

  16. Meng, D., Jia, Y., & Du, J. (2015). Robust iterative learning protocols for finite-time consensus of multi-agent systems with interval uncertain topologies. International Journal of Systems Science, 46(5), 857–871.

    Article  MathSciNet  Google Scholar 

  17. Yang, S., Xu, J.-X., Huang, D., & Tan, Y. (2014). Optimal iterative learning control design for multi-agent systems consensus tracking. Systems & Control Letters, 69, 80–89.

    Article  MathSciNet  Google Scholar 

  18. Ahn, H.-S., Moore, K. L., & Chen, Y. (2010). Trajectory-keeping in satellite formation flying via robust periodic learning control. International Journal of Robust and Nonlinear Control, 20(14), 1655–1666.

    Article  MathSciNet  Google Scholar 

  19. Hock, A., & Schoellig, A. P. (2016). Distributed iterative learning control for a team of quadrotors. In Proceedings of the IEEE conference on decision and control (CDC). arXiv:1603.05933.

  20. Mesbahi, M., & Egerstedt, M. (2010). Graph theoretic methods in multiagent networks. Princeton: Princeton University Press.

    Book  Google Scholar 

  21. Bauer, F. (2012). Normalized graph Laplacians for directed graphs. Linear Algebra and its Applications, 436(11), 4193–4222.

    Article  MathSciNet  Google Scholar 

  22. Ren, W., & Beard, R. W. (2008). Distributed consensus in multi-vehicle cooperative control. Berlin: Springer.

    Book  Google Scholar 

  23. Fax, J., & Murray, R. (2004). Information flow and cooperative control of vehicle formations. IEEE Transactions on Automatic Control, 49(9), 1465–1476.

    Article  MathSciNet  Google Scholar 

  24. Norrlöf, M., & Gunnarsson, S. (2002). Time and frequency domain convergence properties in iterative learning control. International Journal of Control, 75(14), 1114–1126.

    Article  MathSciNet  Google Scholar 

  25. Longman, R. W. (2010). Iterative learning control and repetitive control for engineering practice. International Journal of Control, 73(10), 930–954.

    Article  MathSciNet  Google Scholar 

  26. Bristow, D. A., & Alleyne, A. G. (2003). A manufacturing system for microscale robotic deposition. In Proceedings of the American control conference (ACC) (pp. 2620–2625).

  27. Elci, H., Longman, R. W., Juang, J.-N., Ugoletti, R., Phan, M., Juang, J.-N., & Ugoletti, R. (1994). Discrete frequency based learning control for precision motion control. In: Proceedings of the IEEE international conference on systems, man, and cybernetics (pp. 2767–2773).

  28. de Roover, D. (1996). Synthesis of a robust iterative learning controller using an \(H_\infty \) approach. In: Proceedings of the IEEE conference on decision and control (CDC) (pp. 3044–3049).

  29. Mueller, F. L., Schoellig, A. P., & D’Andrea, R. (2012) Iterative learning of feed-forward corrections for high-performance tracking. In Proceedings of the IEEE international conference on intelligent robots and systems (pp. 3276–3281).

  30. Degen, N., & Schoellig, A. P. (2014) Design of norm-optimal iterative learning controllers: The effect of an iteration-domain Kalman filter for disturbance estimation. In Proceedings of the IEEE conference on decision and control (CDC) (pp. 3590–3596).

  31. Zhou, Q. L., Zhang, Y., Rabbath, C. A., & Theilliol, D. (2010). Design of feedback linearization control and reconfigurable control allocation with application to a quadrotor UAV. In: Proceedings of the IEEE conference on control and fault tolerant systems (pp. 371–376).

  32. Michael, N., Mellinger, D., Lindsey, Q., & Kumar, V. (2010). The GRASP multiple micro-UAV testbed. IEEE Robotics and Automation Magazine, 17(3), 56–65.

    Article  Google Scholar 

  33. Schoellig, A. P., Hehn, M., Lupashin, S., & D’Andrea, R. (2011). Feasiblity of motion primitives for choreographed quadrocopter flight. In: Proceedings of the American control conference (ACC) (pp. 3843–3849).

  34. Chen, Y., & Moore, K. L. (2002). An optimal design of PD-type iterative learning control with monotonic convergence. In: Proceedings of the IEEE international symposium on intelligent control (pp. 55–60).

  35. Münz, U., Papachristodoulou, A., & Allgöwer, F. (2008). Delay-dependent rendezvous and flocking of large scale multi-agent systems with communication delays. In: Proceedings of the IEEE conference on decision and control (CDC) (pp. 2038–2043).

  36. Hu, J., & Lin, Y. (2010). Consensus control for multi-agent systems with double-integrator dynamics and time delays. IET Control Theory & Applications, 4(1), 109–118.

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Andreas Hock.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This research was supported in part by NSERC Grant RGPIN-2014-04634, the Connaught New Researcher Award and the Baden-Württemberg-STIPENDIUM.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (mp4 123687 KB)

Supplementary material 2 (mp4 117782 KB)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hock, A., Schoellig, A.P. Distributed iterative learning control for multi-agent systems. Auton Robot 43, 1989–2010 (2019). https://doi.org/10.1007/s10514-019-09845-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10514-019-09845-4

Keywords

Navigation