A trust region algorithm for nonlinear bilevel programming
Section snippets
A trust region approach to bilevel programming
In this paper we consider bilevel programs (or MPECs, i.e., mathematical programs with equilibrium constraints, see [5]) of the formwhere the mapping F is strongly monotone with respect to the lower level variable y and where the sets X and are polyhedral. We propose for its solution a trust region approach where the model is itself a bilevel program of a combinatorial nature that can be solved for a global optimum.
This approach,
Local behavior of y(x) and
Theorem 1 The functions y(x) and are Lipschitz continuous on their common domain of definition .
Proof Under local Lipschitz and strong monotonicity assumptions on the mapping F, Dafermos [2] has shown that the reaction function y(x) is Lipschitz continuous, provided that the projection operator pz(x)=projY(x)(z) is also Lipschitz continuous, for fixed z. By definition, we have thator equivalently, pz(x) satisfies the generalized equationwhere δ
Approximation results
In this section we prove that, applied to an iterate sufficiently close to a point which is not a strong stationary point, i.e., a point where at least one feasible descent direction exists, algorithm BlTrust will generate a new iterate with an objective value strictly less than that of the current iterate. The proof of this result is based on three approximation lemmas, which make use of the notation described in Table 1.
Lemma 1 and .
Proof By definition of y(xε) and
Convergence analysis
We say that a feasible point x is strongly stationary for a function g if there do not exist a positive number α and a sequence {xi}i∈I converging to x such thatNote that the set of strong stationary points may be a strict subset of points that are stationary in the Clarke sense, i.e., points for which the zero vector belongs to the generalized subdifferential. Whenever the function g is directionally differentiable over its domain, the set of strong stationary points
Conclusion
Although algorithm BlTrust is only guaranteed to generate B-stationary limit points, it has the capability to move away from nonglobal stationary points. In this respect, it is unlikely to get trapped into “weak” local solutions and holds the potential of solving to global optimality generalized bilevel programs involving mildly nonlinear functions f and F. For that reason we refer to BlTrust as a “semi-global” method.
Future work on BlTrust will focus on its implementation and on relaxing some
References (10)
Optimization and Nonsmooth Analysis
(1990)Sensitivity analysis in variational inequalities
Math. Oper. Res.
(1988)- M. Fukushima, P. Tseng, An implementable active-set algorithm for computing a B-stationary point of the mathematical...
- et al.
New branch-and-bound rules for linear bilevel programming
SIAM J. Sci. Statist. Comput.
(1992) - et al.
Mathematical Programs with Equilibrium Constraints
(1996)
Cited by (35)
A Stackelberg Game-based planning approach for integrated community energy system considering multiple participants
2022, EnergyCitation Excerpt :It is assumed that the ES and the EC have already reached such an agreement to bring these constraints into effect [51]. In general, the solutions of bi-level problem can be summarized as following categories: 1) optimality conditions transformation method, which uses the KKT conditions [58,59] or primal-dual constraints [60], i.e., primal constraints, dual constraints and the strong duality equality, to transform the original bi-level problem into a readily solvable single-level problem; 2) distributed iterative solution based on an analytical method [54]; 3) metaheuristic method [61,62]; 4) trust region algorithm [63], etc. The first approach is adopted in this study to solve the established bi-level planning model.
Using Karush-Kuhn-Tucker proximity measure for solving bilevel optimization problems
2019, Swarm and Evolutionary ComputationCitation Excerpt :The approximation region is then either expanded or contracted based on the approximation region being good or bad. Some of the studies that utilize trust-regions are [18,33,34]. Interestingly, in Ref. [18] the authors attempt to approximate the original bilevel program at a point with another bilevel program.
Solving discretely constrained, mixed linear complementarity problems with applications in energy
2013, Computers and Operations ResearchCitation Excerpt :From a compromise perspective, the MILP that relaxes both of these conditions is somewhat related to the notion of bounded rationality in equilibrium systems as discussed in [22]. This focus on integer variables (and/or related techniques) and one [8] or two-level equilibria, e.g., mathematical programs with equilibrium constraints [21] has seen some research efforts over the years in both modeling and methods (e.g., [5,20,1,23,24,15,13,3]) and joins two important fields of operations research. This work also has relevance to both energy market modeling [25] and network optimization [17].
A Linear Programming Enhanced Genetic Algorithm for Hyperparameter Tuning in Machine Learning
2023, 2023 IEEE Congress on Evolutionary Computation, CEC 2023Linearly Constrained Bilevel Optimization: A Smoothed Implicit Gradient Approach
2023, Proceedings of Machine Learning Research