Skip to main content
SpringerLink
Log in

Neurodynamic algorithms for constrained distributed convex optimization over fixed or switching topology with time-varying communication delay

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Based on the distributed optimization operation mechanism of multi-agent systems, this paper considers how to solve the distributed convex optimization problem with linear inequality constraints when agents in the system have time-varying delays in information interaction. Neurodynamic algorithms which can counteract the negative effect of communication delay on the system are proposed and analyzed, respectively, over fixed or switched topology. In addition, sufficient conditions of linear matrix inequality form are given by the Lyapunov theory. Finally, the convergences and effectiveness of the proposed neurodynamic algorithms over fixed topology and switched topology are verified by numerical examples and a practical application.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Ge X, Han Q, Ding D, Zhang X, Ning B (2018) A survey on recent advances in distributed sampled-data cooperative control of multi-agent systems. Neurocomputing 275:1684–1701

    Article  Google Scholar 

  2. Li Z, Chen MZQ, Ding Z (2016) Distributed adaptive controllers for cooperative output regulation of heterogeneous agents over directed graphs. Automatica 68:179–183

    Article  MathSciNet  MATH  Google Scholar 

  3. Gravina R, Alinia P, Ghasemzadeh H, Fortino G (2016) Multi-sensor fusion in body sensor networks: state-of-the-art and research challenges. Inf Fusion 35:68–80

    Article  Google Scholar 

  4. Chen B, Zhang WA, Yu L (2014) Distributed fusion estimation with missing measurements, random transmission delays and packet dropouts. IEEE Trans Autom Control 59(7):1961–1967

    Article  MathSciNet  MATH  Google Scholar 

  5. Kar S, Moura J, Ramanan K (2012) Distributed parameter estimation in sensor networks: nonlinear observation models and imperfect communication. IEEE Trans Inf Theory 58(6):3575–3605

    Article  MathSciNet  MATH  Google Scholar 

  6. Ram SS, Veeravalli VV, Nedić A (2010) Distributed and recursive parameter estimation in parametrized linear state-space models. IEEE Trans Autom Control 55(2):488–492

    Article  MathSciNet  MATH  Google Scholar 

  7. Zhang Z, Ying X, Chow MY (2011) Decentralizing the economic dispatch problem using a two-level incremental cost consensus algorithm in a smart grid environment. In: 2011 North American power symposium, pp 1–7

  8. He W, Qian F, Lam J, Chen G, Han QL, Kurths J (2015) Quasi-synchronization of heterogeneous dynamic networks via distributed impulsive control: error estimation, optimization and design. Automatica 62:249–262

    Article  MathSciNet  MATH  Google Scholar 

  9. Zhu R, Guo Y, Wang F (2020) Quasi-synchronization of heterogeneous neural networks with distributed and proportional delays via impulsive control. Chaos Solit Fract 141(1):110322

    Article  MathSciNet  MATH  Google Scholar 

  10. Deng Z, Liang S, Hong Y (2018) Distributed continuous-time algorithms for resource allocation problems over weight-balanced digraphs. IEEE Trans Cybern 48(11):3116–3125

    Article  Google Scholar 

  11. Tsitsiklis JN (1984) Problems in decentralized decision making and computation. Master’s thesis, Massachusetts Institute of technology, Cambridge

  12. Tsitsiklis JN, Bertsekas DP, Athans M (1986) Gradient optimization algorithms. IEEE Trans Autom Control 31(9):803–812

    Article  MATH  Google Scholar 

  13. Nedić A, Ozdaglar A (2009) Distributed subgradient methods for multi-agent optimization. IEEE Trans Autom Control 54(1):48–61

    Article  MathSciNet  MATH  Google Scholar 

  14. Wang J, Elia N (2010) Control approach to distributed optimization. In: Allerton conference on communication, control, and computing, pp. 557–561

  15. Lu J, Tang CY (2012) Zero-gradient-sum algorithms for distributed convex optimization: the continuous-time case. IEEE Trans Autom Control 57(9):2348–2354

    Article  MathSciNet  MATH  Google Scholar 

  16. Song Y, Chen W (2016) Finite-time convergent distributed consensus optimisation over networks. Iet Control Theory Appl 10(11):1314–1318

    Article  MathSciNet  Google Scholar 

  17. Chen W, Ren W (2016) Event-triggered zero-gradient-sum distributed consensus optimization over directed networks. Automatica 65:90–97

    Article  MathSciNet  MATH  Google Scholar 

  18. Wang X, Wang G, Li S (2020) A distributed fixed-time optimization algorithm for multi-agent systems. Automatica 122:109289

    Article  MathSciNet  MATH  Google Scholar 

  19. Liu J, Chen W, Dai H (2017) Distributed zero-gradient-sum (ZGS) consensus optimisation over networks with time-varying topologies. Int J Syst Sci 48(9):1836–1843

    Article  MathSciNet  MATH  Google Scholar 

  20. Li Y, Zhang H, Huang B, Han J (2020) A distributed Newton-Raphson-based coordination algorithm for multi-agent optimization with discrete-time communication. Neural Comput Appl 32:4649–4663

    Article  Google Scholar 

  21. Wen X, Wang Y, Qin S (2021) A nonautonomous-differential-inclusion neurodynamic approach for nonsmooth distributed optimization on multi-agent systems. Neural Comput Appl 33(20):13909–13920

    Article  Google Scholar 

  22. Guo Z, Chen G (2018) Distributed zero-gradient-sum algorithm for convex optimization with time-varying communication delays and switching networks. Int J Robust Nonliear Control 28:4900–4915

    Article  MathSciNet  MATH  Google Scholar 

  23. Li W, Zeng X, Liang S, Hong Y (2022) Exponentially convergent algorithm design for constrained distributed optimization via nonsmooth approach. IEEE Trans Autom Control 67(2):934–940

    Article  MathSciNet  MATH  Google Scholar 

  24. Wen X, Luan L, Qin S (2021) A continuous-time neurodynamic approach and its discretization for distributed convex optimization over multi-agent systems. Neural Netw 143:52–65

    Article  Google Scholar 

  25. Yang S, Liu Q, Wang J (2017) Distributed optimization based on a multiagent system in the presence of communication delays. IEEE Trans Syst Man Cybern Syst 47(5):717–728

    Article  Google Scholar 

  26. Tran NT, Wang Y, Liu X, Xiao J (2017) Distributed optimisation of second-order multi-agent systems by control algorithm using position-only interaction with time-varying delay. Iet Control Theory Appl 11(15):2549–2558

    Article  MathSciNet  Google Scholar 

  27. Gharesifard B, Corts J (2014) Distributed continuous-time convex optimization on weight-balanced digraphs. IEEE Trans Autom Control 59(3):781–786

    Article  MathSciNet  MATH  Google Scholar 

  28. Kia SS, Cortés J, Martínez S (2015) Distributed convex optimization via continuous-time coordination algorithms with discrete-time communication. Automatica 55:254–264

    Article  MathSciNet  MATH  Google Scholar 

  29. Wang D, Wang Z, Chen M, Wang W (2018) Distributed optimization for multi-agent systems with constraints set and communication time-delay over a directed graph. Inf Sci 438:1–14

    Article  MathSciNet  MATH  Google Scholar 

  30. Zhao Y, Liu Q (2020) A consensus algorithm based on collective neurodynamic system for distributed optimization with linear and bound constraints. Neural Netw 122:144–151

    Article  MATH  Google Scholar 

  31. Liu Q, Yang S, Wang J (2017) A collective neurodynamic approach to distributed constrained optimization. IEEE Trans Neural Netw Learn Syst 28(8):1747–1758

    Article  MathSciNet  Google Scholar 

  32. Jiang X, Qin S, Xue X (2020) A penalty-like neurodynamic approach to constrained nonsmooth distributed convex optimization. Neurocomputing 377:225–233

    Article  Google Scholar 

  33. Dion JM (1999) Linear time-delay systems. Pergamon, London, UK

    Google Scholar 

  34. Xu J, Chung KW (2003) Effects of time delayed position feedback on a van der polcduffing oscillator. Physica D 180:17–39

    Article  MathSciNet  MATH  Google Scholar 

  35. Nedić A, Ozdaglar A (2009) On the rate of convergence of distributed subgradient methods for multi-agent optimization. Proc the IEEE Conf Decis Control 54(1):4711–4716

    MATH  Google Scholar 

  36. Peng L, Jia Y (2011) Multi-agent consensus with diverse time-delays and jointly-connected topologies. Automatica 47(4):848–856

    Article  MathSciNet  MATH  Google Scholar 

  37. Clarke FH (1983) Optimization and nonsmooth analysis. Wiley, New York, USA

    MATH  Google Scholar 

  38. Nesterov Y (2004) Introductory lectures on convex optimization: a basic course. Springer, US

    Book  MATH  Google Scholar 

  39. Gu K, Kharitonov VL, Chen J (2003) Stability of time-delay systems. Birkhauser, Basel

    Book  MATH  Google Scholar 

  40. Park P, Ko JW, Jeong C (2011) Reciprocally convex approach to stability of systems with time-varying delays. Automatica 47(1):235–238

    Article  MathSciNet  MATH  Google Scholar 

  41. Carlson D, Haynsworth E, Markham T (1974) A generalization of the schur complement by means of the moore-penrose inverse. SIAM J Appl Math 26(1):169–175

    Article  MathSciNet  MATH  Google Scholar 

  42. Boyd S, El-Ghaoui L, Feron E, Balakrishnan V (1994) Linear matrix inequalities in system and control theory, vol 15. SIAM, Philadelphia, PA, USA

    Book  MATH  Google Scholar 

  43. Bazaraa MS, Sherali HD, Shetty CM (1993) Nonlinear programming: theory and algorithms, 2nd edn. Wiley, New York, USA

    MATH  Google Scholar 

  44. Chen K, Wang J, Zhang Y, Liu Z (2014) Second-order consensus of nonlinear multi-agent systems with restricted switching topology and time delay. Nonlinear Dyn 78(2):881–887

    Article  MathSciNet  MATH  Google Scholar 

  45. Yan J, Cao J, Cao Y (2021) Distributed continuous-time algorithm for economic dispatch problem over switching communication topology. IEEE Trans Circuits Syst II Exp Briefs 68(6):2002–2006

    Google Scholar 

  46. Yang T, Lu J, Wu D, Wu J, Shi G, Meng Z, Johansson KH (2017) A distributed algorithm for economic dispatch over time-varying directed networks with delays. IEEE Trans Industr Electron 64(6):5095–5106

    Article  Google Scholar 

  47. Nedić A, Olshevsky A (2014) Distributed optimization over time-varying directed graphs. IEEE Trans Autom Control 60(3):601–615

    Article  MathSciNet  MATH  Google Scholar 

  48. Tran N, Wang Y, Liu X, Xiao J (2017) Distributed optimisation of second-order multi-agent systems by control algorithm using position-only interaction with time-varying delay. IET Control Theory Appl 11(15):2549–2558

    Article  MathSciNet  Google Scholar 

  49. Rabbat MG, Nowak RD (2005) Quantized incremental algorithms for distributed optimization. IEEE Trans Syst Man Cybern Syst 23(4):798–808

    Google Scholar 

Download references

Acknowledgements

This research is supported by the National Natural Science Foundation of China (62176073, 11871178).

Author information

Authors and Affiliations

  1. Department of Mathematics, Harbin Institute of Technology, Weihai, 264209, China

    Linhua Luan & Sitian Qin

Authors
  1. Linhua Luan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sitian Qin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sitian Qin.

Ethics declarations

Conflict of interest

We declare that we have no financial and personal relationships with other people or organizations that can inappropriately influence our work, and there is no professional or other personal interest of any nature or kind in any product, service and/or company that could be construed as influencing the position presented in, or the review of, the manuscript entitled “Neurodynamic Algorithms for Constrained Distributed Convex Optimization over Fixed or Switching Topology with Time Delay.”

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Luan, L., Qin, S. Neurodynamic algorithms for constrained distributed convex optimization over fixed or switching topology with time-varying communication delay. Neural Comput & Applic 34, 17761–17781 (2022). https://doi.org/10.1007/s00521-022-07399-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-022-07399-8

Keywords

Search

Navigation