Abstract
This paper presents an extended version of the separation plane algorithm for subgradient-based finite-dimensional nondifferentiable convex optimization. The extension introduces additional cuts for epigraph of the conjugate of objective function which improve the convergence of the algorithm. The case of affine cuts is considered in more details and it is shown that it requires solution of an auxiliary convex subproblem the dimensionality of which depends on the number of additional cuts and can be kept arbitrary low. Therefore algorithm can make use of the efficient algorithms of low-dimensional nondifferentiable convex optimization which overcome known computational complexity bounds for the general case.
E. Nurminski—This work is supported by RFBR grant 13-07-1210.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Shor, N.Z.: Primenenije metoda gradientnogo spuska dlya reshenija setevoj transportnoj zadachi. Materialy nauchn. seminara po teor. i prikl. vopr. kibernetiki i issledovanija operacij, pp. 9–17 (1962)
Polyak, B.T.: Minimization of unsmooth functionals. USSR Comput. Math. Math. Phys. 9, 14–29 (1969)
Kelley, J.E.: The cutting-plane method for solving convex programs. J. Soc. Ind. Appl. Math. 8(4), 703–712 (1960)
Wolfe, P.: A method of conjugate subgradients for minimizing nondifferentiable functions. Math. Programm. Study 3, 145–173 (1975)
Shor, N.Z.: Utilization of the operation of space dilatation in the minimization of convex functions. Cybernetics 6, 7–15 (1970)
Shor, N.Z., Zhurbenko, N.G.: The minimization method using space dilatation in direction of difference of two sequential gradients. Kibernetika 7(3), 51–59 (1971)
Shor, N.Z., Zhurbenko, N.G., Likhovid, A.P., Stetsyuk, P.I.: Algorithms of nondifferentiable optimization: development and application. Cybern. Syst. Anal. 39(4), 537–548 (2003)
Kiwiel, K.C.: An algorithm for nonsmooth convex minimization with errors. Math. Comput. 45(171), 173–180 (1985)
Rzhevskiy, S.V.: \(\epsilon \)-subgradient method for the solution of a convex programming problem. USSR Comput. Math. Math. Phys. 21(5), 51–57 (1981)
Mifflin, R., Sagastizábal, C.A.: A VU-algorithm for convex minimization. Math. Program. 104, 583–606 (2005)
Levin, A.Yu.: Ob odnom algoritme miniminzacii vypuklykh funkcij. DAN SSSR 160(6), 1244–1247 (1965)
Newman, D.J.: Location of the maximum on unimodal surfaces. J. Assoc. Comput. Mach. 12(3), 395–398 (1965)
Lemarechal, C.: An extension of Davidon methods to non-differentiable problems. Math. Program. Study 3, 95–109 (1975)
Nurminski, E.A.: Separating plane algorithms for convex optimization. Math. Program. 76, 375–391 (1997)
Vorontsova, E.A.: A projective separating plane method with additional clipping for non-smooth optimization. WSEAS Trans. Math. 13, 115–121 (2014)
Vorontsova, E.A., Nurminski, E.A.: Synthesis of cutting and separating planes in a nonsmooth optimization method. Cybern. Syst. Anal. 51(4), 619–631 (2015)
Vorontsova, E.A.: Extended separating plane algorithm and NSO-solutions of PageRank problem. In: Kochetov, Y., Khachay, M., Beresnev, V., Nurminski, E., Pardalos, P. (eds.) DOOR 2016. LNCS vol. 9869, pp. 547–560. Springer, Heidelberg (2016)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Nurminski, E. (2016). Multiple Cuts in Separating Plane Algorithms. In: Kochetov, Y., Khachay, M., Beresnev, V., Nurminski, E., Pardalos, P. (eds) Discrete Optimization and Operations Research. DOOR 2016. Lecture Notes in Computer Science(), vol 9869. Springer, Cham. https://doi.org/10.1007/978-3-319-44914-2_34
Download citation
DOI: https://doi.org/10.1007/978-3-319-44914-2_34
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-44913-5
Online ISBN: 978-3-319-44914-2
eBook Packages: Computer ScienceComputer Science (R0)