Continuous Optimization
A two-phase algorithm for the multiparametric linear complementarity problem

https://doi.org/10.1016/j.ejor.2016.04.043Get rights and content

Highlights

  • A new solution method is given for multiparametric linear complementarity problems.

  • The method provides an initial feasible solution or determines that none exists.

  • The method has a better worstcase complexity than previously proposed methods.

Abstract

A new two-phase method for solving the multi-parametric linear complementarity problem (mpLCP) with sufficient matrices is presented. In the first phase an initial feasible solution to mpLCP which satisfies certain criteria is determined. In the second phase the set of feasible parameters is partitioned into polyhedral regions such that the solution of the mpLCP, as a function of the parameters, is invariant over each region. The worst-case complexity of the presented algorithms matches that of current methods for nondegenerate problems and is lower than that of current methods for degenerate problems.

Introduction

We consider a parametric form of the Linear Complementarity Problem (LCP) in which the right hand side vector is dependent on a vector of parameters θSθRk, where Sθ is a bounded convex polytope defining the set of “attainable” values for θ. This problem, referred to as the multiparametric Linear Complementarity Problem (mpLCP), is as follows:

Given MRh×h,qRh and QRh×k (kh), for each θSθ find vectors w(θ) and z(θ) in Rh that satisfy the following system: wMz=q+Qθwz=0w,z0

If such a solution exists for a given θSθ, mpLCP is said to be feasible at θ, otherwise it is infeasible at θ. Similarly, mpLCP is said to be feasible if there exists a θ^Sθ at which mpLCP is feasible, otherwise mpLCP is infeasible. As finding a solution to (1) for each θSθ individually is intractable, the goal of mpLCP is to partition the space Sθ into regions such that the representation of the solution vectors w and z as functions of θ is invariant over each region. In the literature these regions have been given a variety of names, such as invariancy regions, critical regions, and validity sets. We refer to them as invariancy regions and discuss them in more detail in the next section.

LCP, and by extension mpLCP, has numerous applications in the fields of engineering and economics. For an extensive list we suggest (Cottle, Pang, Stone, 2009, Murty, Yu, 1997). It is well known that Linear Programs (LPs) Quadratic Programs (QPs) with convex objective functions and linear constraints can be reformulated as LCPs. Thus, mpLCP encompasses multiparametric LPs (mpLPs) and multiparametric QPs (mpQPs) containing parameters in the linear term of the objective function and in the right hand sides of the constraints. Recently mpQPs of this form have received much attention in the literature for their application to model predictive control (Baotić, 2002, Bemporad, Morari, Dua, Pistikopoulos, 2000, Grancharova, Johansen, 2012, Gupta, Bhartiya, Nataraj, 2011, Patrinos, Sarimveis, 2010, Pistikopoulos, Dua, Bozinis, Bemporad, Morari, 2002, Spjøtvold, Kerrigan, Jones, Tøndel, Johansen, 2006, Spjøtvold, Tøndel, Johansen, 2007, Tøndel, Johansen, Bemporad, 2003a, Tøndel, Johansen, Bemporad, 2003b).

Another important class of problems that has received considerable attention in recent years and can also be formulated as a mpQP is multiobjective optimization problems with a single psuedoconvex objective and any number of linear objectives. These types of problems are particularly relevant in the areas of economics and finance. Examples of works considering these types of problems include Hirschberger, Qi, Steuer, 2010, Ponsich, Jaimes, Coello, 2013, Smimou, 2014, Yu, Lee, 2011, Zopounidis, Galariotis, Doumpos, Sarri, Andriosopoulos, 2015 and the references therein.

In general LCP is NP-hard, though polynomial time algorithms exist for certain classes of the matrix M. Thus, much work has been done in order to identify various classes of matrices M which impact one’s ability to solve an instance of LCP. Solution techniques for LCP are often designed for specific classes of M. For a concise list of important matrix classes see Cottle (2010). For a detailed discussion on these classes and their impact on LCP see Cottle et al. (2009); Murty and Yu (1997). We will refer to many of the matrix classes discussed in these works throughout this paper. As the method we proposed requires that M be a sufficient matrix, we provide the following definition, as found in Cottle et al. (2009).

Definition 1.1

A matrix MRh×h is column sufficient if the following implication is satisfied: {xi(Mx)i0foralli}{xi(Mx)i=0foralli}M is said to be row sufficient if M is column sufficient. If M is both column and row sufficient, it is then called sufficient.

Parametric LCP with a single parameter (i.e., k=1) has been studied quite extensively. Some of the works considering this problem include Cottle (1972), Danao (1997), Pang (1980) and Pang, Kaneko, and Hallman, (1979). Columbano, Fukuda, and Jones (2009), Gailly, Installe, and Smeers (2001), Jones and Morari (2006) and Li and Ierapetritou (2010) consider mpLCP as in (1) (i.e., k > 1). The method of Gailly et al. (2001) is designed for the case in which M is copositive-plus. The method is theoretically sound but lacks a practical discussion as to how the theory should be implemented. Jones and Morari (2006) propose a method for the case in which M is positive semi-definite. Their method is an extension of techniques that are used for solving single parametric LCP, but depends on a lexicographic ϵ-perturbation in order to handle degeneracy. Columbano et al. (2009) developed a technique for instances in which M is a sufficient matrix. When certain conditions are not satisfied, however, their method depends on an ϵ-perturbation technique in which an auxiliary multiobjective program must be solved. The method of Li and Ierapetritou (2010) works for general M, but is computationally expensive since it requires reformulating the mpLCP as a multiparametric bilinear mixed integer program. Recently, Herceg, Jones, Kvasnica, and Morari (2015) proposed a technique designed for general M which extends the enumerative approach of Gupta et al. (2011) for solving mpQP to the context of mpLCP.

Significant improvements can still be made on solution techniques for mpLCP. In this paper we propose a two-phase technique for solving instances of mpLCP in which M is sufficient. Phase 1 is used for initialization and only terminates when: (i) an instance of mpLCP has been shown to be infeasible, or (ii) an initial feasible solution and the corresponding invariancy region have been discovered. In the latter case, Phase 2 is then used to partition Sθ. Phase 2 is inspired by the work of Columbano et al. (2009), but does not rely on an ϵ-perturbation technique and therefore has an improved worst-case complexity. We point out that in our consideration of Phase 1 we answer a very important question that no other work we are aware of has considered, the question of how one can determine an initial feasible solution for a (multi)parametric LCP problem. In all works we know of, it is simply assumed that such a solution is available.

As mentioned, the method for solving mpLCP which we present in this work is a two-phase method. We will show that the problem solved in the first phase of this method is a special case of the problem solved during the second phase. For this reason we discuss Phase 2 prior to Phase 1. Hence, the remainder of this work is organized as follows. Background information on LCP problems and their geometrical structure is contained in Section 2. The theory and methodology for Phase 2 of the proposed method for solving mpLCP are presented in Section 3. In Section 4 we present the theory and methodology for Phase 1. We discuss the complexity of each algorithm and present numerical results for applying the proposed two-phase method to a collection of mpQP instances in Section 5. In Section 6 we provide concluding remarks and a discussion on proposed future work. In Appendix A we offer an illustrative example, showing explicitly how the Phase 1 and 2 algorithms are used to solve an instance of mpLCP. Appendix B contains detailed results from our computational experiments as well as a couple of supporting images.

Section snippets

Background on mpLCP

This section is divided into two subsections. In the first we present preliminary notations and definitions and in the second we provide a discussion on the geometry of mpLCP and provide some preliminary results.

Phase 2: partitioning the parameter space

In this section we introduce the theory necessary for developing an algorithm that can be used to partition Sθ, given an initial basis B0 such that dim(IRB0)k1. We present the algorithm for partitioning Sθ in Section 5.

To solve an instance of mpLCP we first need a method so that given a complementary feasible basis B, we can determine a complementary feasible basis B which is adjacent to B. Observe the following proposition.

Proposition 3.1

(Columbano et al., 2009) IfMRh×h is column sufficient and two bases

Phase 1: determining an initial feasible solution

In this section we develop a method for determining an initial feasible solution to the mpLCP (1) which provides a good starting point for our task of partitioning the parameter space Sθ. Thus, we seek a basis B0 such that dim(IRB0)k1. We present the algorithm for finding B0 in Section 5.

We now discuss the techniques which we use to obtain an initial basis B0 such that dim(IRB0)k1. We assume throughout this discussion that 0Sθ. Recognize that this assumption is not restrictive because it

The algorithms and their performance

This section consists of two subsections. In the first, we present Algorithms 1 and 2 which are designed for partitioning the parameter space Sθ and obtaining an initial feasible basis B0 such that dim(IRB0)k1, respectively. In the second subsection we discuss the complexity and performance of Algorithms 1 and 2.

Conclusion

In this work we have introduced a new two-phase method for solving mpLCP (1) in which M is a sufficient matrix. Phase 1 answers the previously unanswered question of how one can determine an initial full dimensional invariancy region which can be used as a starting point in the process of partitioning the parameter space Sθ. The partition of Sθ is carried out in Phase 2, which is inspired by the method introduced by Columbano et al. (2009). The worst-case complexity of the proposed two-phase

Acknowledgment

We thank the anonymous referees for their many helpful comments which aided us in considerably improving the presentation of this paper.

References (31)

  • C. Zopounidis et al.

    Multiple criteria decision aiding for finance: an updated bibliographic survey

    European Journal of Operational Research

    (2015)
  • M. Baotić

    An efficient algorithm for multi-parametric quadratic programming

    Report AUT02-05, Institut für Automatik, ETH Zürich

    (2002)
  • M.S. Bazaraa et al.

    Nonlinear programming: theory and algorithms

    (2006)
  • A. Bemporad et al.

    The explicit solution of model predictive control via multiparametric quadratic programming

    Proceedings of the 2000 american control conference

    (2000)
  • S. Columbano et al.

    An output-sensitive algorithm for multi-parametric LCPs with sufficient matrices

    Polyhedral Computation

    (2009)
  • Cited by (8)

    • An RLT approach for solving the binary-constrained mixed linear complementarity problem

      2019, Computers and Operations Research
      Citation Excerpt :

      As opposed to the DC-MLCP, the linear complementarity problem (LCP) has attracted a lot of interest due to its wide range of applications (Anitescu and Potra, 1997; Cottle and Dantzig, 1968; Cottle et al., 1992; Ferris and Pang, 1997; Wilmott, 2006). Several solution techniques have been proposed in the literature for the LCP (Adelgren and Wiecek, 2016; Andreani et al., 2016; Ferris et al., 2007; Illés and Nagy, 2007; Kocvara and Zowe, 1997; Kostreva and Yang, 2004; Morales et al., 2008). Most of these techniques (Lemke’s algorithm, Projected Gauss Seidel, etc.) are iterative algorithms and they make use of linear algebra to solve or approximately solve the LCP, see Lemke (1965, 1968), Billups and Murty (2000), Stewart and Trinkle (1996), Stewart and Trinkle (1997), Morales et al. (2008).

    • On multi-parametric programming and its applications in process systems engineering

      2016, Chemical Engineering Research and Design
      Citation Excerpt :

      Additional approaches consider the use of a moving-front algorithm (Hale, 2005) or the special case of multi-parametric dynamic optimization (mp-DO) (Sakizlis et al., 2005; Sun et al., 2016). Similarly to mp-LP and mp-QP problems, most solution approaches for mp-LCP problems can be subdivided into two categories: geometrical (Jones and Morari, 2006; Columbano et al., 2009; Adelgren and Wiecek, 2016) and combinatorial (Herceg et al., 2015) approaches. In Jones and Morari (2006), given the basis of a full dimensional region CR, the set of bases which are adjacent to CR are calculated, similarly to Tøndel et al. (2003b).

    View all citing articles on Scopus
    View full text