Skip to main content
SpringerLink
Log in

A proportional-integral iterative algorithm for time-variant equality-constrained quadratic programming problem with applications

  • Published:
Artificial Intelligence Review Aims and scope Submit manuscript

Abstract

Solving the time-variant equality-constrained quadratic programming (TVECQP) problem extensively occurs in diverse applications, and thus many novel schemes have been developed, e.g., numerical algorithms and zeroing neural networks. However, few existing works consider the perturbations in a computing system which may cause inaccurate solution. To suppress the effect of perturbations, we try to employ the integral feedback control to design a new algorithm. Firstly, the control system model of the traditional algorithm, i.e., the Newton algorithm is presented. Hence, the correlation between the control system and algorithm has been established. Then, the integral control feedback is added to the system to construct the proportional-integral iterative (PII) algorithm. The PII algorithm is thus endowed with robustness against various perturbations that are proved in theory. Moreover, numerical simulations among the Newton algorithms, the zeroing neural network, and the proposed PII algorithm are performed for comparison, which verify the theoretical analyses and demonstrate the superior robustness of the PII algorithm. Finally, two applications are provided to illustrate the feasibility of the PII algorithm, where one investigating the distribution of surface water from satellite images and the other is about robotic manipulator control.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  • Åström KJ, Murray RM (2010) Feedback systems. In: Feedback Systems. Princeton University Press, Princeton

  • Baklanov S, Stefanova M, Lupuleac S (2020) Newton projection method as applied to assembly simulation. Optim Methods Softw. https://doi.org/10.1080/10556788.2020.1818079

    Article  MATH  Google Scholar 

  • Calvo-Zaragoza J, Toselli AH, Vidal E (2019) Handwritten music recognition for mensural notation with convolutional recurrent neural networks. Pattern Recogn Lett 128:115–121

    Article  Google Scholar 

  • Chen SY, Lin C, Tai CH, Chuang SJ (2018) Adaptive window-based constrained energy minimization for detection of newly grown tree leaves. Remote Sens 10(1):96

    Article  Google Scholar 

  • Cohen J (1960) A coefficient of agreement for nominal scales. Educ Psychol Meas 20(1):37–46

    Article  Google Scholar 

  • Crisci S, Ruggiero V, Zanni L (2019) Steplength selection in gradient projection methods for box-constrained quadratic programs. Appl Math Comput 356:312–327

    Article  MathSciNet  MATH  Google Scholar 

  • Gondzio J, Sobral F (2019) Quasi-Newton approaches to interior point methods for quadratic problems. Comput Optim Appl 74(1):93–120

    Article  MathSciNet  MATH  Google Scholar 

  • Guo D, Yan L, Nie Z (2017) Design, analysis, and representation of novel five-step DTZD algorithm for time-varying nonlinear optimization. IEEE Trans Neural Networks Learn Syst 29(9):4248–4260

    Article  Google Scholar 

  • Hong S, Kang H, Kim J, Cho K (2020) Low voltage time-based matrix multiplier-and-accumulator for neural computing system. Electronics 9(12):2138

    Article  Google Scholar 

  • Hu T, Liao S (2020) On the risks of using double precision in numerical simulations of spatio-temporal chaos. J Comput Phys 418(109):629

    MathSciNet  MATH  Google Scholar 

  • Hu Z, Xiao L, Dai J, Xu Y, Zuo Q, Liu C (2020) A unified predefined-time convergent and robust ZNN model for constrained quadratic programming. IEEE Trans Ind Inf 17(3):1998–2010

    Article  Google Scholar 

  • Hunger R (2005) Floating point operations in matrix-vector calculus. Munich University of Technology, Inst. for Circuit Theory and Signal Processing

  • Jin L, Li S (2017) Nonconvex function activated zeroing neural network models for dynamic quadratic programming subject to equality and inequality constraints. Neurocomputing 267:107–113

    Article  Google Scholar 

  • Jin L, Zhang Y, Li S, Zhang Y (2016) Modified ZNN for time-varying quadratic programming with inherent tolerance to noises and its application to kinematic redundancy resolution of robot manipulators. IEEE Trans Ind Electron 63(11):6978–6988

    Article  Google Scholar 

  • Jin L, Zhang J, Luo X, Liu M, Li S, Xiao L, Yang Z (2020) Perturbed manipulability optimization in a distributed network of redundant robots. IEEE Trans Ind Electron 68(8):7209–7220

    Article  Google Scholar 

  • Jin L, Wei L, Li S (2022) Gradient-based differential neural-solution to time-dependent nonlinear optimization. In: IEEE Transactions on Automatic Control

  • Jurcevic P, Javadi-Abhari A, Bishop LS, Lauer I, Bogorin DF, Brink M, Capelluto L, Günlük O, Itoko T, Kanazawa N et al (2021) Demonstration of quantum volume 64 on a superconducting quantum computing system. Quant Sci Technol 6(2):025020

    Article  Google Scholar 

  • Li Y, Ang KH, Chong GC (2006) PID control system analysis and design. IEEE Control Syst 26(1):32–41

    Article  Google Scholar 

  • Li W, Ma X, Luo J, Jin L (2019) A strictly predefined-time convergent neural solution to equality- and inequality-constrained time-variant quadratic programming. IEEE Trans Syst Man Cybern Syst 51(7):4028–4039

    Article  Google Scholar 

  • Li X, Han L, Liu H, Wang W, Xiang C (2019) Real-time optimal energy management strategy for a dual-mode power-split hybrid electric vehicle based on an explicit model predictive control algorithm. Energy 172:1161–1178

    Article  Google Scholar 

  • Liao S, Liu J, Xiao X, Fu D, Wang G, Jin L (2020) Modified gradient neural networks for solving the time-varying Sylvester equation with adaptive coefficients and elimination of matrix inversion. Neurocomputing 379:1–11

    Article  Google Scholar 

  • Liao-McPherson D, Huang M, Kolmanovsky I (2019) A regularized and smoothed Fischer-Burmeister method for quadratic programming with applications to model predictive control. IEEE Trans Autom Control 64(7):2937–2944

    Article  MathSciNet  MATH  Google Scholar 

  • Liu M, Chen L, Du X, Jin L, Shang M (2021) Activated gradients for deep neural networks. In: IEEE Transactions on Neural Networks and Learning Systems

  • Lu H, Jin L, Zhang J, Sun Z, Li S, Zhang Z (2019) New joint-drift-free scheme aided with projected ZNN for motion generation of redundant robot manipulators perturbed by disturbances. IEEE Trans Syst Man Cybern Syst 51(9):5639–5651

    Article  Google Scholar 

  • Ma R, Zhang B, Zhou Y, Li Z, Lei F (2021) Pid controller-guided attention neural network learning for fast and effective real photographs denoising. IEEE Transactions on Neural Networks and Learning Systems

  • Qi Y, Jin L, Li H, Li Y, Liu M (2020) Discrete computational neural dynamics models for solving time-dependent Sylvester equations with applications to robotics and MIMO systems. IEEE Trans Ind Inf 16(10):6231–6241

    Article  Google Scholar 

  • Qiu B, Zhang Y, Yang Z (2018) New discrete-time ZNN models for least-squares solution of dynamic linear equation system with time-varying rank-deficient coefficient. IEEE Trans Neural Networks Learn Syst 29(11):5767–5776

    Article  MathSciNet  Google Scholar 

  • Qiu B, Guo J, Li X, Zhang Z, Zhang Y (2020) Discrete-time advanced zeroing neurodynamic algorithm applied to future equality-constrained nonlinear optimization with various noises. In: IEEE Transactions on Cybernetics pp 1–14. https://doi.org/10.1109/TCYB.2020.3009110

  • Shi Y, Jin L, Li S, Qiang J (2020) Proposing, developing and verification of a novel discrete-time zeroing neural network for solving future augmented Sylvester matrix equation. J Franklin Inst 357(6):3636–3655

    Article  MathSciNet  MATH  Google Scholar 

  • Sun Z, Tian Y, Li H, Wang J (2016) A superlinear convergence feasible sequential quadratic programming algorithm for bipedal dynamic walking robot via discrete mechanics and optimal control. Optim Control Appl. Methods 37(6):1139–1161

    Article  MathSciNet  MATH  Google Scholar 

  • Sun Z, Shi T, Wei L, Sun Y, Liu K, Jin L (2020) Noise-suppressing zeroing neural network for online solving time-varying nonlinear optimization problem: a control-based approach. Neural Comput Appl 32:11505–11520

    Article  Google Scholar 

  • Wang H, Luo Y, An W, Sun Q, Xu J, Zhang L (2020) PID controller-based stochastic optimization acceleration for deep neural networks. IEEE Transactions on Neural Networks and Learning Systems 31(12):5079–5091

    Article  Google Scholar 

  • Wang G, Hao Z, Zhang B, Jin L (2022) Convergence and robustness of bounded recurrent neural networks for solving dynamic lyapunov equations. Inf Sci 588:106–123

    Article  Google Scholar 

  • Weingarten H, Steinberg Y, Shamai SS (2006) The capacity region of the gaussian multiple-input multiple-output broadcast channel. IEEE Trans Inf Theory 52(9):3936–3964

    Article  MathSciNet  MATH  Google Scholar 

  • Xiao L, Lu X, Xu T, Wan X, Ji W, Zhang Y (2020) Reinforcement learning-based mobile offloading for edge computing against jamming and interference. IEEE Trans Commun 68(10):6114–6126

    Article  Google Scholar 

  • Xiao X, Fu D, Wang G, Liao S, Qi Y, Huang H, Jin L (2020) Two neural dynamics approaches for computing system of time-varying nonlinear equations. Neurocomputing 394:84–94

    Article  Google Scholar 

  • Yang M, Zhang Y, Hu H, Qiu B (2019) General 7-instant DCZNN model solving future different-level system of nonlinear inequality and linear equation. IEEE Trans Neural Networks Learn Syst 9:3204–3214

    MathSciNet  Google Scholar 

  • Zhang Y, Zhang Z (2014) Repetitive motion planning and control of redundant robot manipulators. Springer, New York

    MATH  Google Scholar 

  • Zhang Y, Ma W, Cai B (2008) From Zhang neural network to Newton iteration for matrix inversion. IEEE Trans Circ Syst I 56(7):1405–1415

    MathSciNet  MATH  Google Scholar 

  • Zhang Y, Mu B, Zheng H (2013) Link between and comparison and combination of zhang neural network and quasi-newton bfgs method for time-varying quadratic minimization. IEEE Trans Cybern 43(2):490–503

    Article  Google Scholar 

  • Zhang Z, Lu Y, Zheng L, Li S, Yu Z, Li Y (2018) A new varying-parameter convergent-differential neural-network for solving time-varying convex QP problem constrained by linear-equality. IEEE Trans Autom Control 63(12):4110–4125

    Article  MathSciNet  MATH  Google Scholar 

  • Zhang Y, Gong H, Yang M, Li J, Yang X (2018) Stepsize range and optimal value for Taylor-Zhang discretization formula applied to zeroing neurodynamics illustrated via future equality-constrained quadratic programming. IEEE Trans Neural Networks Learn Syst 30(3):959–966

    Article  MathSciNet  Google Scholar 

  • Zhao R, Shi Z, Zou Z, Zhang Z (2019) Ensemble-based cascaded constrained energy minimization for hyperspectral target detection. Remote Sens 11(11):1310

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. PAMI Research Group, Department of Computer and Information Science, University of Macau, Taipa, Macau, 999078, China

    Guancheng Wang, Zhihao Hao & Bob Zhang

  2. College of Electronic and Information Engineering, Guangdong Ocean University, Zhanjiang, 524088, China

    Haoen Huang

  3. Beijing Key Laboratory of Big Data Technology for Food Safety, Beijing Technology and Business University, Beijing, China

    Bob Zhang

Authors
  1. Guancheng Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zhihao Hao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Haoen Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Bob Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Bob Zhang.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, G., Hao, Z., Huang, H. et al. A proportional-integral iterative algorithm for time-variant equality-constrained quadratic programming problem with applications. Artif Intell Rev 56, 4535–4556 (2023). https://doi.org/10.1007/s10462-022-10284-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10462-022-10284-4

Keywords

Search

Navigation