Skip to main content
Log in

Iterative Learning Control of a Multiagent System under Random Perturbations

  • Topical Issue
  • Published:
Automation and Remote Control Aims and scope Submit manuscript

Abstract

A multiagent system in which each of the agents is described by a linear discrete-time model with random perturbations (external random disturbances affecting the plant and measurement noises) is considered. Networked modifications of iterative learning control laws based on minimizing the deviations from a reference model and also based on the theory of stochastic stability of repetitive processes using the divergent method of vector Lyapunov functions are proposed. These modifications are compared with each other by an illustrative example of iterative learning control for a group of gantry robots.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Garden, M., US Patent 3 555 252, 1971.

  2. Uchiyama, M., Formulation of High-Speed Motion Pattern of a Mechanical Arm by Trial, Trans. SICE (Soc. Instrum. Contr. Eng.), 1978, vol. 14, no. 6, pp. 706–712 (in Japanese).

    Google Scholar 

  3. Arimoto, S., Kawamura, S., and Miyazaki, F., Bettering Operation of Dynamic Systems by Learning: A New Control Theory for Servomechanism or Mechatronic Systems, Proc. 23rd Conf. Decision Control, 1984, pp. 1064–1069.

  4. Arimoto, S., Kawamura, S., and Miyazaki, F., Bettering Operation of Robots by Learning, J. Robot. Syst., 1984, vol. 1, no. 2, pp. 123–140.

    Article  Google Scholar 

  5. Craig, J.J., Adaptive Control of Manipulators through Repeated Trials, Proc. Am. Control Conf., 1984, pp. 1566–1573.

  6. Bristow, D.A., Tharayil, M., and Alleyne, A.G., A Survey of Iterative Learning Control, IEEE Control Syst. Mag., 2006, vol. 23, no. 3, pp. 96–114.

    Google Scholar 

  7. Ahn, H.-S., Chen, Y.Q., and Moore, K.L., Iterative Learning Control: Brief Survey and Categorization, IEEE Trans. Syst., Man, Cybernet., Part C: Appl. Rev., 2007, vol. 37, no. 6, pp. 1099–1121.

    Article  Google Scholar 

  8. Wang, Y., Gao, F., and Doyle, F.J., III, Survey on Iterative Learning Control, Repetitive Control and Run-to-Run Control, J. Process Control, 2009, vol. 19, no. 10, pp. 1589–1600.

    Article  Google Scholar 

  9. Ahn, H.-S., Moore, K.L., and Chen, Y.Q., Iterative Learning Control. Robustness and Monotonic Convergence for Interval Systems, London: Springer-Verlag, 2007.

    MATH  Google Scholar 

  10. Hoelzle, D.J., Alleyne, A.G., and Johnson, A.J.W., Iterative Learning Control for Robotic Deposition using Machine Vision, Am. Control Conf., Washington, USA, 2008, pp. 4541–4547.

  11. Hladowski, L., Galkowski, K., Cai, Z., Rogers, E., Freeman, C., and Lewin, P., Experimentally Supported 2D Systems Based Iterative Learning Control Law Design for Error Convergence and Performance, Control Eng. Pract., 2010, vol. 18, pp. 339–348.

    Article  Google Scholar 

  12. Freeman, C.T., Rogers, E., Hughes, A-M., Burridge, J.H., and Meadmore, K.L., Iterative Learning Control in Health Care. Electrical Stimulation and Robotic-Assisted Upper-Limb Stroke Rehabilitation, IEEE Control Syst. Magaz., 2012, vol. 32, no. 2, pp. 18–43.

    Article  MathSciNet  Google Scholar 

  13. Sammons, P.M., Gegel, M.L., Bristow, D.A., and Landers, R.G., Repetitive Process Control of Additive Manufacturing with Application to Laser Metal Deposition, IEEE Transact. Control Syst. Technol., 2019, vol. 27, no. 2, pp. 566–575.

    Article  Google Scholar 

  14. Shen, D. and Wang, Y., Survey on Stochastic Iterative Learning Control, J. Process Control, 2014, vol. 24, pp. 64–77.

    Article  Google Scholar 

  15. Shen, D., A Technical Overview of Recent Progresses on Stochastic Iterative Learning Control, Unmanned Syst., 2018, vol. 6, no. 3, pp. 147–164.

    Article  Google Scholar 

  16. Saab, S.S., A Discrete-Time Stochastic Learning Control Algorithm, IEEE Trans. Autom. Control, 2001, vol. 46, pp. 877–887.

    Article  MathSciNet  Google Scholar 

  17. Saab, S.S., On a Discrete-Time Stochastic Learning Control Algorithm, IEEE Trans. Autom. Control, 2001, vol. 46, no. 8, pp. 1333–1336.

    Article  MathSciNet  Google Scholar 

  18. Saab, S.S., Stochastic P-type/D-type Iterative Learning Control Algorithms, Int. J. Control, 2003, vol. 76, no. 2, pp. 139–148.

    Article  MathSciNet  Google Scholar 

  19. Saab, S.S., A Stochastic Iterative Learning Control Algorithm with Application to an Induction Motor, Int. J. Control, 2004, vol. 77, no. 2, pp. 144–163.

    Article  MathSciNet  Google Scholar 

  20. Saab, S.S., Optimal Selection of the Forgetting Matrix into an Iterative Learning Control Algorithm, IEEE Trans. Autom. Control, 2005, vol. 50, no. 12, pp. 2039–2043.

    Article  MathSciNet  Google Scholar 

  21. Saab, S.S., Optimality of First-Order ILC among Higher Order ILC, IEEE Trans. Autom. Control, 2006, vol. 51, no. 8, pp. 1332–1336.

    Article  MathSciNet  Google Scholar 

  22. Oh, S.-K. and Lee, J.M., Stochastic Iterative Learning Control for Discrete Linear Time-Invariant System with Batch-Varying Reference Trajectories, J. Proc. Control, 2015, vol. 36, pp. 64–78.

    Article  Google Scholar 

  23. Pakshin, P., Emelianova, J., Galkowski, K., and Rogers, E., Iterative Learning Control Design for Discrete Stochastic Linear Systems, Proc. 2019 Eur. Control Conf., June 25–28, 2019, Napoli, Italy, pp. 3776–3771.

  24. Ahn, H.-S. and Chen, Y.-Q., Iterative Learning Control for Multi-Agent Formation, Proc. ICROS-SICE Int. Joint Conf., Fukuoka Int. Congr. Center, Japan, 2009, pp. 3111–3116.

    Google Scholar 

  25. Liu, Q. and Bristow, D.A., An Iteration-Domain Filter for Controlling Transient Growth in Iterative Learning Control, Proc. 2010 Am. Control Conf., Baltimore, MD, 2010, pp. 2039–2044.

  26. Liu, Y. and Jia, Y., An Iterative Learning Approach to Formation Control of Multi-agent Systems, Syst. Control Lett., 2012, vol. 61, pp. 148–154.

    Article  MathSciNet  Google Scholar 

  27. Yang, S., Xu, J.-X., and Huang, D., Iterative Learning Control for Multi-Agent Systems Consensus Tracking, Proc. 51st IEEE Conf. Decision Control, Maui, Hawaii, 2012, pp. 4672–4677.

  28. Yang, S., Xu, J.-X., and Miao, Y., An Iterative Learning Control Approach for Synchronization of Multi-agent Systems under Iteration-varying Graph, Proc. 52nd IEEE Conf. Decision Control, Florence, Italy, 2013, pp. 6682–6687.

  29. Meng, D., Jia, Y., Du, J., and Zhang, J., On Iterative Learning Algorithms for the Formation Control of Nonlinear Multi-agent Systems, Automatica, 2014, vol. 50, pp. 291–295.

    Article  MathSciNet  Google Scholar 

  30. Pakshin, P.V., Emelianova, J.P., and Emelianov, M.A., Iterative Learning Control Design for Multiagent Systems Based on 2D Models, Autom. Remote Control, 2018, vol. 79, no. 6, pp. 1040–1056.

    Article  MathSciNet  Google Scholar 

  31. Shen, D. and Wang, Y., ILC for Networked Nonlinear Systems with Unknown Control Direction through Random Lossy Channel, Syst. Control Lett., 2015, vol. 77, pp. 30–39.

    Article  MathSciNet  Google Scholar 

  32. Shen, D. and Wang, Y., Iterative Learning Control for Networked Stochastic Systems with Random Packet Losses, Int. J. Control, 2015, vol. 88, no. 5, pp. 959–968.

    MathSciNet  MATH  Google Scholar 

  33. Xuhui, B., Zhongsheng, H., Shangtai, J., and Ronghu, C., An Iterative Learning Control Design Approach for Networked Control Systems with Data Dropouts, Int. J. Robust Nonlin. Control, 2016, vol. 26, no. 1, pp. 91–109.

    Article  MathSciNet  Google Scholar 

  34. Liu, J. and Ruan, X., Networked Iterative Learning Control Design for Discrete-Time Systems with Stochastic Communication delay in Input and Output Channels, Int. J. Syst. Sci., 2017, vol. 48, no. 9, pp. 1844–1855.

    Article  MathSciNet  Google Scholar 

  35. Liu, J. and Ruan, X., Networked Iterative Learning Control Design for Nonlinear Systems with Stochastic Output Packet Dropouts, Asian J. Control, 2018, vol. 20, no. 3, pp. 1077–1087.

    Article  MathSciNet  Google Scholar 

  36. Mesbahi, M. and Egerstedt, M., Graph Theoretic Methods in Multiagent Networks, Princeton: Princeton Univ. Press, 2010.

    Book  Google Scholar 

  37. Rogers, E., Galkowski, K., and Owens, D.H., Control Systems Theory and Applications for Linear Repetitive Processes, Lect. Notes Control Inform. Sci., vol. 349, Berlin: Springer-Verlag, 2007.

    MATH  Google Scholar 

  38. Goldsmith, P.B., On the Equivalence of Causal LTI Iterative Learning Control and Feedback Control, Automatica, 2002, vol. 38, no. 4, pp. 703–708.

    Article  MathSciNet  Google Scholar 

  39. Goldsmith, P.B., Author’s reply to “On the Equivalence of Causal LTI Iterative Learning Control and Feedback Control,” Automatica, 2004, vol. 40, no. 5, pp. 899–900.

    Article  MathSciNet  Google Scholar 

  40. Owens, D.H. and Rogers, E., Comments on “On the Equivalence of Causal LTI Iterative Learning Control and Feedback Control,” Automatica, 2004, vol. 40, no. 5, pp. 895–898.

    Article  MathSciNet  Google Scholar 

  41. Apkarian, J., Karam, P., and Levis, M., Workbook on Flexible Link Experiment for Matlab/Simulink Users, Markham: Quanser, 2011.

    Google Scholar 

Download references

Funding

This work was supported by the Russian Foundation for Basic Research, project no. 19-08-00528_a.

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to P. V. Pakshin, A. S. Koposov or J. P. Emelianova.

Additional information

This paper was recommended for publication by E.Ya. Rubinovich, a member of the Editorial Board

Russian Text © The Author(s), 2020, published in Avtomatika i Telemekhanika, 2020, No. 3, pp. 132–156.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Pakshin, P.V., Koposov, A.S. & Emelianova, J.P. Iterative Learning Control of a Multiagent System under Random Perturbations. Autom Remote Control 81, 483–502 (2020). https://doi.org/10.1134/S0005117920030078

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1134/S0005117920030078

Keywords

Navigation