Abstract
We present a theoretical result on a path-following algorithm for convex programs. The algorithm employs a nonsmooth Newton subroutine. It starts from a near center of a restricted constraint set, performs a partial nonsmooth Newton step in each iteration, and converges to a point whose cost is withinε accuracy of the optimal cost in\(O(\sqrt m \left| {\ln \varepsilon } \right|)\) iterations, wherem is the number of constraints in the problem. Unlike other interior point methods, the analyzed algorithm only requires a first-order Lipschitzian condition and a generalized Hessian similarity condition on the objective and constraint functions. Therefore, our result indicates the theoretical feasibility of applying interior point methods to certainC 1-optimization problems instead ofC 2-problems. Since the complexity bound is unchanged compared with similar algorithms forC 2-convex programming, the result shows that the smoothness of functions may not be a factor affecting the complexity of interior point methods.
Similar content being viewed by others
References
F.H. Clarke,Optimization and Nonsmooth Analysis (Wiley, New York, 1983).
J.E. Dennis and R.B. Schnabel,Numerical Methods for Unconstrained Optimization and Nonlinear Equations (Prentice-Hall, Englewood Cliffs, NJ, 1983).
D. Goldfarb and S. Liu, “An O(n 3 L) primal interior point method for convex quadratic programming,”Mathematical Programming 49 (1991) 325–340.
D.D. Hertog, C. Roos and T. Terlaky, “A large-step analytic center method for a class of smooth convex programming problems,” Report 90-14, Faculty of Technical Mathematics and Informatics, Delft University of Technology (Delft, Netherlands, 1990).
D.D. Hertog, C. Roos and T. Terlaky, “A potential reduction method for a class of smooth convex programming problems,” Report 90-91, Faculty of Technical Mathematics and Informatics, Delft University of Technology (Delft, Netherlands, 1990).
P. Huard, “Resolution of mathematical programming with nonlinear constraints by the method of centers,” in: J. Abadie, ed.,Nonlinear Programming (North-Holland, Amsterdam, 1967) pp. 207–219.
F. Jarre, “On the convergence of the method of analytic centers when applied to convex quadratic programs,”Mathematical Programming 49 (1990/91) 341–358.
F. Jarre, “On the method of analytic centers for solving smooth convex programs,” in: S. Dolecki, ed.,Optimization. Lecture Notes in Mathematics No. 1405 (Springer, Berlin, 1989) pp. 69–85.
F. Jarre, G. Sonnevend and J. Stoer, “An implementation of the method of analytic centers,” in: A. Benoussan and J.L. Lions, eds.,Lecture Notes in Control And Information Sciences No. 111 (Springer, Berlin, 1988) pp. 297–307.
M. Kojima, S. Mizuno and T. Noma, “A new continuation method for complementary problems with uniform P-functions,”Mathematical Programming 43 (1989) 107–113.
K.O. Kortanek, F. Potra and Y. Ye, “On some efficient interior point methods for nonlinear convex programming,” Preprint 89-24, College of Business Administration, The University of Iowa (Iowa City, IA, 1989).
K.O. Kortanek and J. Zhu, “A polynomial algorithm for convex programming problems satisfying a scaled Lipschitz condition,” Preprint 90-17, College of Business administration, The University of Iowa (Iowa City, IA, 1990).
S. Mehrotra and J. Sun, “An algorithm for convex quadratic programming that requires O(n 3.5 L)arithmetic operations,”Mathematics of Operations Research 15 (1990) 342–363.
S. Mehrotra and J. Sun, “A method of analytic centers for quadratically constrained convex quadratic programs,”SIAM Journal on Numerical Analysis 28 (1991) 529–544.
S. Mehrotra and J. Sun, “An interior point algorithm for solving smooth convex programs based on Newton's method,” in: J. Lagarias and M. Todd, eds.,Contemporary Mathematics, Vol. 114 (AMS, Providence, RI, 1990) pp. 265–284.
S. Mehrotra and J. Sun, “On computing the center of a convex quadratically constrained set,”Mathematical Programming 51 (1991) 81–89.
R.C. Monteiro and I. Adler, “An extension of Karmarkar type algorithm to a class of convex separable programming problems with global linear rate of convergence,”Mathematics of Operations Research 15 (1990) 408–422.
R.C. Monteiro, I. Adler and M.G.C. Resende, “A polynomial-time primal—dual affine scaling algorithm for linear and convex quadratic programming and its power series extension,”Mathematics of Operations Research 15 (1990) 191–214.
J.E. Nesterov and A.S. Nemirovsky, “A general approach to polynomial-time algorithms design for convex programming,” Report, Central Economical and Mathematical Institute, USSR Academy of Science (Moscow, 1988).
L. Qi and J. Sun, “A nonsmooth version of Newton's method,” Technical Report 90-01, Department of Industrial Engineering and Management Sciences, Northwestern University (Evanston, IL, 1990), to appear in:Mathematical Programming.
J. Renegar, “A polynomial-time algorithm, based on Newton's method for linear programming,”Mathematical Programming 40 (1988) 59–93.
R.T. Rockafellar,Convex Analysis (Princeton University Press, Princeton, NJ, 1970).
R.T. Rockafellar, “Large-scale extended linear-quadratic programming and multistage optimization,” in: S. Gomez et al., eds.,Advances in Numerical Partial Differential Equations and Optimization (SIAM, Philadelphia, PA, 1991) pp. 247–261.
R.T. Rockafellar and R.-J.B. Wets, “Generalized linear-quadratic problems of deterministic and stochastic optimal control in discrete time,”SIAM Journal on Control and Optimization 28 (1990) 810–822.
G. Sonnevend, “An analytical centre for polyhedrons and new class of global algorithms for linear (smooth, convex) programming,” in:Lecture Notes in Control and Information Sciences No. 84 (Springer, Berlin, 1985) pp. 866–876.
G. Sonnevend and J. Stoer, “Global ellipsoidal approximation and homotopy methods for solving convex analytic programs,”Applied Mathematics and Optimization 21 (1990) 139–165.
J. Sun, “An affine-scaling method for linearly constrained convex programs,” Technical Report, Department of Industrial Engineering and Management Sciences, Northwestern University (Evanston, IL, 1990).
P.M. Vaidya, “A new algorithm for minimizing convex functions over convex sets,” Preprint, AT&T Bell Laboratories (Murray Hill, NJ, 1990).
Y. Ye and E. Tse, “An extension of Karmarkar's projective algorithm for convex quadratic programming,”Mathematical Programming 44 (1989) 157–180.
J. Zhu, “A path following algorithm for a class of convex programming problems,” Preprint 90-14, College of Business Administration, The University of Iowa (Iowa City, IA, 1990).
Author information
Authors and Affiliations
Additional information
This author's work is supported in part by the National Science Foundation of the USA under grant DDM-8721709.
This author's work is supported in part by the Australian Research Council.
Rights and permissions
About this article
Cite this article
Sun, J., Qi, L. An interior point algorithm of\(O(\sqrt m \left| {\ln \varepsilon } \right|)\) iterations forC 1-convex programming. Mathematical Programming 57, 239–257 (1992). https://doi.org/10.1007/BF01581083
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF01581083