Abstract
The complementarity problem is theoretically and practically useful, and has been used to study and formulate various equilibrium problems arising in economics and engineerings. Recently, for solving complementarity problems, various equivalent equation formulations have been proposed and seem attractive. However, such formulations have the difficulty that the equation arising from complementarity problems is typically nonsmooth. In this paper, we propose a new smoothing Newton method for nonsmooth equations. In our method, we use an approximation function that is smooth when the approximation parameter is positive, and which coincides with original nonsmooth function when the parameter takes zero. Then, we apply Newton's method for the equation that is equivalent to the original nonsmooth equation and that includes an approximation parameter as a variable. The proposed method has the advantage that it has only to deal with a smooth function at any iteration and that it never requires a procedure to decrease an approximation parameter. We show that the sequence generated by the proposed method is globally convergent to a solution, and that, under semismooth assumption, its convergence rate is superlinear. Moreover, we apply the method to nonlinear complementarity problems. Numerical results show that the proposed method is practically efficient.
Similar content being viewed by others
References
H.Z. Aashtiani, “The multi-modal traffic assignment problem,” Ph.D. thesis, Sloan School of Management, Massachusetts Institute of Technology, Cambridge, MA, 1979.
D.P. Bertsekas, Constrained Optimization and Lagrange Multiplier Methods, Academic Press: San Diego, CA, 1982.
D.P. Bertsekas and E.M. Gafni, “Projection methods for variational inequalities with application to the traffic assignment problem,” Mathematical Programming Study, vol. 17, pp. 139–159, 1982.
C. Chen and O.L. Mangasarian, “A class of smoothing functions for nonlinear and mixed complementarity problems,” Computational Optimization and Applications, vol. 5, pp. 97–138, 1996.
X. Chen, L. Qi, and D. Sun, “Global and superlinear convergence of the smoothing Newton method and its application to general box constrained variational inequalities,” Mathematics of Computations, vol. 67, pp. 519–540, 1998.
F.H. Clarke, Optimization and Nonsmooth Analysis, Wiley: New York, 1983.
T. De Luca, F. Facchinei, and C. Kanzow, “A semismooth equation approach to the solution of nonlinear complementarity problems,” Mathematical Programming, vol. 75, pp. 407–439, 1996.
T. De Luca, F. Facchinei, and C. Kanzow, “A theoretical and numerical comparison of some semismooth algorithms for complementarity problems,” Computational Optimization and Applications, vol. 16, pp. 173–205, 2000.
F. Facchinei and J. Soares, “A new merit function for nonlinear complementarity problems and a related algorithm,” SIAM Journal on Optimization, vol. 7, pp. 225–247, 1997.
Y. Fathi, “Computational complexity of LCPs associated with positive definite symmetric matrices,” Mathematical Programming, vol. 17, pp. 335–344, 1979.
A. Fischer, “An NCP-function and its use for the solution of complementarity problems,” in Recent Advances in Nonsmooth Optimization. D.-Z. Du, L. Qi, and R.S. Womersley (Eds.), World Scientific: Singapore, 1995, pp. 88–105.
M. Fukushima, “Equivalent differentiable optimization problems and descent methods for asymmetric variational inequality problems,” Mathematical Programming, vol. 53, pp. 99–110, 1992.
S.A. Gabriel and J.J. Moré, “Smoothing of mixed complementarity problems,” in Complementarity and Variational Problems: State of the Art. M.C. Ferris and J.S. Pang (Eds.), SIAM, Philadelphia, PA, 1997, pp. 105–116.
S.A. Gabriel and J.S. Pang, “An inexact NE/SQP method for solving the nonlinear complementarity problem,” Computational Optimization and Applications, vol. 1, pp. 67–91, 1992.
P.T. Harker, “Accelerating the convergence of the diagonalization and projection algorithms for finitedimensional variational inequalities,” Mathematical Programming, vol. 41, pp. 29–59, 1988.
P.T. Harker and J.S. Pang, “Finite-dimensional variational inequality and nonlinear complementarity problems: A survey of theory, algorithms and applications,” Mathematical Programming, vol. 48, pp. 161–220, 1990.
P.T. Harker and B. Xiao, “Newton's method for the complementarity problem: A B-differentiable equation approach,” Mathematical Programming, vol. 48, pp. 339–357, 1990.
H. Jiang, “Smoothed Fischer-Burmeister equation methods for the complementarity problem,” Department of Mathematics, The University of Melbourne, Australia, June 1997.
N.H. Josephy, “Newton's method for generalized equations,” Technical Report No. 1965, Mathematics Research Center, University of Wisconsin, Madison, WI, 1979.
M. Kojima, S. Mizuno, and T. Noma, “A new continuation method for complementarity problems with uniform P-functions,” Mathematical Programming, vol. 43, pp. 107–113, 1989.
M. Kojima and S. Shindo, “Extension of Newton and quasi-Newton methods to systems of PC1 equations,” Journal of Operations Research Society of Japan, vol. 29, pp. 352–375, 1986.
R. Mifflin, “Semismooth and semiconvex functions in constrained optimization,” SIAM Journal on Control and Optimization, vol. 15, pp. 959–972, 1977.
M. Miyamoto, “Aglobally convergentNewton method for nonsmooth equations and its application to nonlinear complementarity problems,” NAIST-IS-MT9651108, Master Thesis, Department of Information Sciences, Graduate School of Information Sciences, Nara Institute of Science and Technology, Japan, Feb. 13, 1998.
K.G. Murty, “Computational complexity of complementary pivot methods,” Mathematical Programming Study, vol. 7, pp. 61–73, 1978.
J.S. Pang, “A B-differentiable equation based, globally and locally quadratically convergent algorithm for nonlinear programs, complementarity, and variational inequality problems,” Mathematical Programming, vol. 51, pp. 101–131, 1991.
J.S. Pang and S.A. Gabriel, “NE/SQP: A robust algorithm for the nonlinear complementarity problem,” Mathematical Programming, vol. 60, pp. 295–337, 1993.
J.S. Pang and L. Qi, “Nonsmooth equations: Motivation and algorithms,” SIAM Journal on Optimization, vol. 3, pp. 443–465, 1993.
H.D. Qi and L.Z. Liao, “A smoothing Newton method for general nonlinear complementarity problems,” Computational Optimization and Applications, vol. 17, pp. 231–253, 2000.
L. Qi, “Convergence analysis of some algorithms for solving nonsmooth equations,” Mathematics of Operations Research, vol. 18, pp. 227–244, 1993.
L. Qi and J. Sun, “A nonsmooth version of Newton's method,” Mathematical Programming, vol. 58, pp. 353–367, 1993.
L. Qi and D. Sun, “Smoothing functions and a smoothing Newton method for complementarity and variational inequality problems,” Working paper, School of Mathematics, The University of New SouthWales, Australia, Oct. 26, 1998.
L. Qi, D. Sun, and G. Zhou, “A new look at smoothing Newton methods for nonlinear complementarity problems and box constrained variational inequalities,” Mathematical Programming, vol. 87, pp. 1–35, 2000.
K. Taji and M. Fukushima, “Optimization based globally convergent methods for the nonlinear complementarity problem,” Journal of Operations Research Society of Japan, vol. 37, pp. 310–331, 1994.
K. Taji, M. Miyamoto, and Y. Takahashi, “A smoothing Newton method for nonsmooth equations and its application to complementarity problems,” Optimization: Modeling and Algorithms 12, The Institute of Statistical Mathematics Cooperative Research Report 113, The Institute of Statistical Mathematics, Tokyo, Japan, Nov. 1998, pp. 191–208 (in Japanese).
R.L. Tobin, “A variable dimension solution approach for the general spatial price equilibrium problem,” Mathematical Programming, vol. 40, pp. 33–51, 1988.
L.T. Watson, “Solving the nonlinear complementarity problem by a homotopy method,” SIAM Journal on Control and Optimization, vol. 17, pp. 36–46, 1979.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Taji, K., Miyamoto, M. A Globally Convergent Smoothing Newton Method for Nonsmooth Equations and Its Application to Complementarity Problems. Computational Optimization and Applications 22, 81–101 (2002). https://doi.org/10.1023/A:1014886302772
Issue Date:
DOI: https://doi.org/10.1023/A:1014886302772