Skip to main content

Multiple Cuts in Separating Plane Algorithms

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 9869))

Abstract

This paper presents an extended version of the separation plane algorithm for subgradient-based finite-dimensional nondifferentiable convex optimization. The extension introduces additional cuts for epigraph of the conjugate of objective function which improve the convergence of the algorithm. The case of affine cuts is considered in more details and it is shown that it requires solution of an auxiliary convex subproblem the dimensionality of which depends on the number of additional cuts and can be kept arbitrary low. Therefore algorithm can make use of the efficient algorithms of low-dimensional nondifferentiable convex optimization which overcome known computational complexity bounds for the general case.

E. Nurminski—This work is supported by RFBR grant 13-07-1210.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Shor, N.Z.: Primenenije metoda gradientnogo spuska dlya reshenija setevoj transportnoj zadachi. Materialy nauchn. seminara po teor. i prikl. vopr. kibernetiki i issledovanija operacij, pp. 9–17 (1962)

    Google Scholar 

  2. Polyak, B.T.: Minimization of unsmooth functionals. USSR Comput. Math. Math. Phys. 9, 14–29 (1969)

    Article  MATH  Google Scholar 

  3. Kelley, J.E.: The cutting-plane method for solving convex programs. J. Soc. Ind. Appl. Math. 8(4), 703–712 (1960)

    Article  MathSciNet  MATH  Google Scholar 

  4. Wolfe, P.: A method of conjugate subgradients for minimizing nondifferentiable functions. Math. Programm. Study 3, 145–173 (1975)

    Article  MathSciNet  MATH  Google Scholar 

  5. Shor, N.Z.: Utilization of the operation of space dilatation in the minimization of convex functions. Cybernetics 6, 7–15 (1970)

    Article  Google Scholar 

  6. Shor, N.Z., Zhurbenko, N.G.: The minimization method using space dilatation in direction of difference of two sequential gradients. Kibernetika 7(3), 51–59 (1971)

    MATH  Google Scholar 

  7. Shor, N.Z., Zhurbenko, N.G., Likhovid, A.P., Stetsyuk, P.I.: Algorithms of nondifferentiable optimization: development and application. Cybern. Syst. Anal. 39(4), 537–548 (2003)

    Article  MathSciNet  MATH  Google Scholar 

  8. Kiwiel, K.C.: An algorithm for nonsmooth convex minimization with errors. Math. Comput. 45(171), 173–180 (1985)

    Article  MathSciNet  MATH  Google Scholar 

  9. Rzhevskiy, S.V.: \(\epsilon \)-subgradient method for the solution of a convex programming problem. USSR Comput. Math. Math. Phys. 21(5), 51–57 (1981)

    Article  Google Scholar 

  10. Mifflin, R., Sagastizábal, C.A.: A VU-algorithm for convex minimization. Math. Program. 104, 583–606 (2005)

    Article  MathSciNet  MATH  Google Scholar 

  11. Levin, A.Yu.: Ob odnom algoritme miniminzacii vypuklykh funkcij. DAN SSSR 160(6), 1244–1247 (1965)

    Google Scholar 

  12. Newman, D.J.: Location of the maximum on unimodal surfaces. J. Assoc. Comput. Mach. 12(3), 395–398 (1965)

    Article  MathSciNet  MATH  Google Scholar 

  13. Lemarechal, C.: An extension of Davidon methods to non-differentiable problems. Math. Program. Study 3, 95–109 (1975)

    Article  MathSciNet  MATH  Google Scholar 

  14. Nurminski, E.A.: Separating plane algorithms for convex optimization. Math. Program. 76, 375–391 (1997)

    MathSciNet  MATH  Google Scholar 

  15. Vorontsova, E.A.: A projective separating plane method with additional clipping for non-smooth optimization. WSEAS Trans. Math. 13, 115–121 (2014)

    Google Scholar 

  16. Vorontsova, E.A., Nurminski, E.A.: Synthesis of cutting and separating planes in a nonsmooth optimization method. Cybern. Syst. Anal. 51(4), 619–631 (2015)

    Article  MathSciNet  MATH  Google Scholar 

  17. Vorontsova, E.A.: Extended separating plane algorithm and NSO-solutions of PageRank problem. In: Kochetov, Y., Khachay, M., Beresnev, V., Nurminski, E., Pardalos, P. (eds.) DOOR 2016. LNCS vol. 9869, pp. 547–560. Springer, Heidelberg (2016)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Evgeni Nurminski .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Nurminski, E. (2016). Multiple Cuts in Separating Plane Algorithms. In: Kochetov, Y., Khachay, M., Beresnev, V., Nurminski, E., Pardalos, P. (eds) Discrete Optimization and Operations Research. DOOR 2016. Lecture Notes in Computer Science(), vol 9869. Springer, Cham. https://doi.org/10.1007/978-3-319-44914-2_34

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-44914-2_34

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-44913-5

  • Online ISBN: 978-3-319-44914-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics