Skip to main content
SpringerLink
Log in

Fast Iterative Solution of Saddle Point Problems in Optimal Control Based on Wavelets

  • Published:
Computational Optimization and Applications Aims and scope Submit manuscript

Abstract

In this paper, wavelet techniques are employed for the fast numerical solution of a control problem governed by an elliptic boundary value problem with boundary control. A quadratic cost functional involving natural norms of the state and the control is to be minimized. Firstly the constraint, the elliptic boundary value problem, is formulated in an appropriate weak form that allows to handle varying boundary conditions explicitly: the boundary conditions are treated by Lagrange multipliers, leading to a saddle point problem. This is combined with a fictitious domain approach in order to cover also more complicated boundaries.

Deviating from standard approaches, we then use (biorthogonal) wavelets to derive an equivalent infinite discretized control problem which involves only ℓ2-norms and -operators. Classical methods from optimization yield the corresponding optimality conditions in terms of two weakly coupled (still infinite) saddle point problems for which a unique solution exists. For deriving finite-dimensional systems which are uniformly invertible, stability of the discretizations has to be ensured. This together with the ℓ2-setting circumvents the problem of preconditioning: all operators have uniformly bounded condition numbers independent of the discretization.

In order to numerically solve the resulting (finite-dimensional) linear system of the weakly coupled saddle point problems, a fully iterative method is proposed which can be viewed as an inexact gradient scheme. It consists of a gradient algorithm as an outer iteration which alternatingly picks the two saddle point problems, and an inner iteration to solve each of the saddle point problems, exemplified in terms of the Uzawa algorithm. It is proved here that this strategy converges, provided that the inner systems are solved sufficiently well. Moreover, since the system matrix is well-conditioned, it is shown that in combination with a nested iteration strategy this iteration is asymptotically optimal in the sense that it provides the solution on discretization level J with an overall amount of arithmetic operations that is proportional to the number of unknows N J on that level.

Finally, numerical results are provided.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. V. Arnăutu and P. Neittaanmäki, “Discretization estimates for an elliptic control problem,” Numer. Funct. Anal. Optim., vol. 19, pp. 431–464, 1998.

    Google Scholar 

  2. G.P. Astrakantsev, “Methods of fictitious domains for a second order elliptic equation with natural boundary conditions,” U.S.S.R. Comput. Math. Math. Phys., vol. 18, pp. 114–121, 1978.

    Google Scholar 

  3. I. Babuška, “The finite element method with Lagrange multipliers,” Numer. Math., vol. 20, pp. 179–192, 1973.

    Google Scholar 

  4. R.E. Bank, B.D. Welfert, and H. Yserentant, “A class of iterative methods for solving saddle point problems,” Numer. Math., vol. 56, pp. 645–666, 1990.

    Google Scholar 

  5. A. Barinka, T. Barsch, Ph. Charton, A. Cohen, S. Dahlke, W. Dahmen, and K. Urban, “Adaptive wavelet schemes for elliptic problems-Implementation and numerical experiments,” SIAM J. Sci. Comp., vol. 23, pp. 910–939, 2001.

    Google Scholar 

  6. T. Barsch, “Adaptive Multiskalenverfahren f¨ur elliptische partielle Differentialgleichungen-Realisierung, Umsetzung und numerische Ergebnisse” IGPM, RWTH Aachen, Ph.D. Thesis, 2001 (in German).

  7. R. Becker, H. Kapp, and R. Rannacher, “Adaptive finite element methods for optimal control of partial differential equations: Basic concept,” SIAM J. Contr. Optim., vol. 39, pp. 113–132, 2000.

    Google Scholar 

  8. S. Bertoluzza, “A posteriori error estimates for the wavelet Galerkin method,” Appl. Math. Lett., vol. 8, pp. 1–6, 1995.

    Google Scholar 

  9. D.P. Bertsekas, Nonlinear Programming, 2nd edn., Athena Scientific: Belmont, 1999.

    Google Scholar 

  10. P.B. Bochev, “Least-squares methods for optimal control,” Nonlin. Anal. Theory Methods Appl., vol. 30, pp. 1875–1885, 1997.

    Google Scholar 

  11. D. Braess, Finite Elements: Theory, Fast Solvers and Applications in Solid Mechanics, 2nd edn., Cambridge University Press: Cambridge, UK, 2001.

    Google Scholar 

  12. J.H. Bramble and J. Pasciak, “A preconditioning technique for indefinite systems resulting from mixed approximations for elliptic problems,” Math. Comp., vol. 50, pp. 1–17, 1988.

    Google Scholar 

  13. J.H. Bramble, J. Pasciak, and A.T. Vassilev, “Analysis of the inexact Uzawa algorithm for saddle point problems,” SIAM J. Num. Anal., vol. 34, pp. 1072–1092, 1997.

    Google Scholar 

  14. F. Brezzi and M. Fortin, Mixed and Hybrid Finite Element Methods, Springer: Berlin, 1991.

    Google Scholar 

  15. C. Canuto, A. Tabacco, and K. Urban, “The wavelet element method, Part I: Construction and analysis,” Appl. Comput. Harm. Anal., vol. 6, pp. 1–52, 1999.

    Google Scholar 

  16. P. Ciarlet, Introduction to Numerical Linear Algebra and Optimization, Cambridge: Cambridge, UK, 1989.

    Google Scholar 

  17. A. Cohen, “Numerical analysis of wavelet methods,” in Handbook of Numerical Analysis II, P.G. Ciarlet and J.L. Lions (Eds.), vol. 8, Elsevier Science Publishers: London, 1998.

    Google Scholar 

  18. A. Cohen, W. Dahmen, and R. DeVore, “Adaptive wavelet methods II-Beyond the elliptic case,” IGPMPreprint No. 199, RWTH Aachen, Nov. 2000. Also in J. Foundations of Computational Mathematics, to appear.

  19. A. Cohen, W. Dahmen, and R. DeVore, “Adaptive wavelet methods for elliptic operator equations- Convergence rates,” Math. Comp., vol. 70, pp. 27–75, 2001.

    Google Scholar 

  20. S. Dahlke, W. Dahmen, R. Hochmuth, and R. Schneider, “Stable multiscale bases and local error estimation for elliptic problems,” Appl. Numer. Maths., vol. 8, pp. 21–47, 1997.

    Google Scholar 

  21. S. Dahlke, W. Dahmen, and K. Urban, “Adaptive wavelet methods for saddle point problems-Convergence rates,” IGPM-Preprint No. 204, RWTH Aachen, July 2001.

  22. S. Dahlke, R. Hochmuth, and K. Urban, “Adaptive wavelet methods for saddle point problems,” M2AN, vol. 34, pp. 1003–1022, 2000.

    Google Scholar 

  23. W. Dahmen, “Stability of multiscale transformations,” J. Four. Anal. Appl., vol. 2, pp. 341–361, 1996.

    Google Scholar 

  24. W. Dahmen, “Wavelet and multiscale methods for operator equations,” Acta Numerica, pp. 55–228, 1997.

  25. W. Dahmen, “Wavelet methods for PDEs-Some recent developments,” J. Comput. Appl. Maths., vol. 128, pp. 133–185, 2001.

    Google Scholar 

  26. W. Dahmen and A. Kunoth, “Appending boundary conditions by Lagrange multipliers: Analysis of the LBB condition,” Numer. Math., vol. 88, pp. 9–42, 2001.

    Google Scholar 

  27. W. Dahmen and A. Kunoth, “Adaptive wavelet methods for linear-quadratic elliptic control problems,” in preparation.

  28. W. Dahmen, A. Kunoth, and R. Schneider, “Wavelet least square methods for boundary value problems,” IGPM-Preprint No.175, RWTH Aachen, Sept. 1999. Also in SIAM J. Numer. Anal., to appear.

  29. W. Dahmen, A. Kunoth, and K. Urban, “Wavelets in numerical analysis and their quantitative properties,” in Surface Fitting and Multiresolution Methods, A. Le Méhauté et al. (Eds.), Vanderbilt University Press: Nashville, TN, 1997, pp. 93–130.

    Google Scholar 

  30. W. Dahmen, A. Kunoth, and K. Urban, “Biorthogonal spline-wavelets on the interval-Stability and moment conditions,” Appl. Comput. Harm. Anal., vol. 6, pp. 132–196, 1999.

    Google Scholar 

  31. W. Dahmen and R. Schneider, “Composite wavelet bases for operator equations,” Math. Comp., vol. 68, pp. 1533–1567, 1999.

    Google Scholar 

  32. W. Dahmen and R. Schneider, “Wavelets on manifolds I: Construction and domain decomposition,” SIAM J. Math. Anal., vol. 31, pp. 184–230, 1999.

    Google Scholar 

  33. W. Dahmen, R. Schneider, and Y. Xu, “Nonlinear functionals ofwavelet expansions-Adaptive reconstruction and fast evaluation,” Numer. Math., vol. 86, pp. 49–101, 2000.

    Google Scholar 

  34. J. Dankova and R. Haslinger, “Fictitious domain approach used in shape optimization: Neumann boundary condition,” in Control of Partial Differential Equations and Applications, Casas Eduardo (Ed.), Lect. Notes Pure Appl. Math., vol. 174, New York, Dekker, pp. 43–49, 1996.

  35. Ph.E. Gill, L.O. Jay, M.W. Leonard, L.R. Petzold, and V. Sharma, “An SQP method for the optimal control of large-scale dynamical systems,” J. Comput. Appl. Math., vol. 120, pp. 197–213, 2000.

    Google Scholar 

  36. Ph.E. Gill, W. Murray, D.B. Ponecon, and M. Saunders, “Preconditioners for indefinite systems arising in optimization,” SIAM J. Matrix Anal. Appl., vol. 13, pp. 292–311, 1992.

    Google Scholar 

  37. V. Girault and P.-A. Raviart, Finite Element Methods for Navier-Stokes Equations, Springer: Berlin, 1986.

    Google Scholar 

  38. R. Glowinski, “Finite element methods for the numerical simulation of incompressible viscous flow. Introduction to the control of the Navier-Stokes equations,” Lect. Appl. Math., vol. 28, pp. 219–301, 1991.

    Google Scholar 

  39. R. Glowinski, T.W. Pan, and J. Periaux, “A fictitious domain method for Dirichlet problem and application,” Comp. Meth. Appl. Mechs. Eng., vol. 111, pp. 282–303, 1994.

    Google Scholar 

  40. G.H. Golub and Q. Ye, “Inexact preconditioned conjugate gradient method with inner-outer iteration,” SIAM J. Sci. Comput., vol. 21, pp. 1305–1320, 1999.

    Google Scholar 

  41. M. Griebel, A. Kunoth, and K. Scherer, private communication.

  42. P. Grisvard, Elliptic Problems in Nonsmooth Domains, Pitman, 1985.

  43. M.D. Gunzburger (Ed.), Flow Control, The IMA Volumes in Mathematics and its Applications, vol. 68, Springer: Berlin, 1995.

    Google Scholar 

  44. M.D. Gunzburger, L.S. Hou, and Th.P. Svobodny, “Analysis and finite element approximation of optimal control problems for the stationary Navier-Stokes equations with Dirichlet controls,”M2AN, vol. 25, pp. 711–748, 1991.

    Google Scholar 

  45. M.D. Gunzburger, L.S. Hou, and Th.P. Svobodny, “Analysis and finite element approximation of optimal control problems for the stationary Navier-Stokes equations with distributed and Neumann controls,” Math. Comp., vol. 57, pp. 123–151, 1991.

    Google Scholar 

  46. M.D. Gunzburger and H.C. Lee, “Analysis, approximation, and computation of a coupled solid/fluid temperature control problem,” Comp. Meth. Appl. Mech. Engrg., vol. 118, pp. 133–152, 1994.

    Google Scholar 

  47. M.D. Gunzburger and H.C. Lee, “Analysis and approximation of optimal control problems for first-order elliptic systems in three dimensions,” Appl. Math. Comput., vol. 100, pp. 49–70, 1999.

    Google Scholar 

  48. W. Hackbusch, “Fast solution of elliptic control problems,” J. Optim. Theory Appl., vol. 31, pp. 565–581, 1980.

    Google Scholar 

  49. W. Hackbusch, Iterative Solution of Large Sparse Systems of Equations, Springer: New York, 1994.

    Google Scholar 

  50. J. Haslinger, “Fictitious domain approaches in shape optimization,” in Computational Methods for Optimal Design and Control, J. Borggard et al. (Eds.), Prog. Syst. Control Theory, vol. 24, Birkhaeuser, pp. 237–248, 1998.

  51. J. Haslinger, K.-H. Hoffmann, and M. Kočvara, “Control fictitious domain method for solving optimal shape design problems,” RAIRO, Modelisation Math. Anal. Numer., vol. 27, pp. 157–182, 1993.

    Google Scholar 

  52. M. Heinkenschloss, “The numerical solution of a control problem governed by a phase field model,” Optim. Methods Softw., vol. 7, pp. 211–263, 1997.

    Google Scholar 

  53. M. Heinkenschloss, “Formulation and analysis of a sequential quadratic programming method for the optimal Dirichlet boundary control of Navier-Stokes flow,” in Optimal Control: Theory, Algorithms, and Applications, H. W. Hager et al. (Eds.), Appl. Optim., vol. 15, Kluwer: Norwell, MA, 1998, pp. 178–203.

    Google Scholar 

  54. M. Hinze and K. Kunisch, “On suboptimal control strategies for the Navier-Stokes equations,” ESAIM, Proc., vol. 4, pp. 181–198, 1998.

    Google Scholar 

  55. M. Hinze and K. Kunisch, “Newton's method for tracking type control of the instationary Navier-Stokes equations,” in ENUMATH 99. Numerical Mathematics and Advanced Applications, P. Neittaanmäki et al. (Eds.), Singapore: World Scientific, 2000, pp. 534–541.

    Google Scholar 

  56. K. Ito and K. Kunisch, “Augmented Lagrangian-SQP methods for nonlinear optimal control problems of tracking type,” SIAM J. Contr. Optim., vol. 34, pp. 874–891, 1996.

    Google Scholar 

  57. S. Kaczmarz, “Angen¨aherteAufl¨osung von Systemen linearer Gleichungen,” Bulletin de l'Academie Polonaise des Sciences et Letters, vol. A35, pp. 355–357, 1937.

    Google Scholar 

  58. A. Kauffmann, “Optimal control of the solid fuel ignition model,” Ph.D. Thesis, TU Berlin, 1998.

  59. K. Kunisch and G. Peichl, “Shape optimization for mixed boundary value problems based on an embedding domain method,” Dyn. Contin. Discrete Impulsive Syst., vol. 4, pp. 439–478, 1998.

    Google Scholar 

  60. A. Kunoth, “Multilevel preconditioning-Appending boundary conditions by Lagrange multipliers,” Adv. Comp. Maths., vol. 4, pp. 145–170, 1995.

    Google Scholar 

  61. A. Kunoth, “Wavelet methods-Elliptic boundary value problems and control problems,” Advances in Numerical Mathematics, Teubner, 2001.

  62. A. Kunoth, “Wavelet techniques for the fictitious domain-Lagrange multiplier approach,” Numerical Algorithms, vol. 27, pp. 291–316, 2001.

    Google Scholar 

  63. A. Kunoth et al., “An inexact conjugate gradient algorithm for optimal control problems in wavelet representation,” in preparation.

  64. A. Kunoth, “Iterative solution of linear-quadratic elliptic control problems in wavelet discretization,” in preparation.

  65. A. Kunoth and A. Kurdila, “Wavelet techniques for saddle point problems in optimal control,” ISC-01-04 MATH, Preprint, Texas A&M University, June 2001.

  66. J.L. Lions, Optimal Control of Systems Governed by Partial Differential Equations, Springer: Berlin, 1971.

    Google Scholar 

  67. H. Maurer and H.D. Mittelmann, “Optimization techniques for solving elliptic control problems with control and state constraints: Part 1. Boundary Control,” Comput. Optim. Appl., vol. 16, pp. 29–55, 2000.

    Google Scholar 

  68. P. Neittaanmäki and J. Haslinger, Finite Element Approximation for Optimal Shape, Material and Topology Design, 2nd edn., Wiley: New York, 1996.

    Google Scholar 

  69. P. Neittaanmäki and D. Tiba, “An embedding of domains approach in free boundary problems and optimal design,” SIAM J. Contr. Optim., vol. 33, pp. 1587–1602, 1995.

    Google Scholar 

  70. L. Petzold, J.B. Rosen, Ph. E. Gill, L.O. Jay, and K. Park, “Numerical optimal control of parabolic PDEs using DASOPT,” Large-Scale Optimization with Applications, Part 2: Optimal Design and Control, L.T. Biegler et al. (Eds.), IMA Vol. Math. Appl., vol. 93, Springer: Berlin, pp. 271–299, 1997.

    Google Scholar 

  71. J. Pitkäranta, “Boundary subspaces for the finite element method with Lagrange multipliers,” Numer. Math., vol. 33, pp. 273–289, 1979.

    Google Scholar 

  72. A. Rieder, “A domain embedding method for Dirichlet problems in arbitrary space dimensions,” RAIRO, Modelisation Math. Anal. Numer., vol. 32, pp. 405–431, 1998.

    Google Scholar 

  73. J. Toivanen, “Ficititious domain method applied to shape optimization,” Ph.D. Thesis, University of Jyväskylä, 1997.

  74. F. Tröltzsch, “On the Lagrange-Newton-SQP method for the optimal control of semilinear parabolic equations,” SIAM J. Cont. Optim., vol. 38, pp. 294–312, 1999.

    Google Scholar 

  75. E. Zeidler, Nonlinear Functional Analysis and its Applications; III: Variational Methods and Optimization, Springer: Berlin, 1985.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institut für Angewandte Mathematik, Universität Bonn, Wegelerstr. 6, 53115, Bonn, Germany

    Angela Kunoth

Authors
  1. Angela Kunoth
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kunoth, A. Fast Iterative Solution of Saddle Point Problems in Optimal Control Based on Wavelets. Computational Optimization and Applications 22, 225–259 (2002). https://doi.org/10.1023/A:1015441724875

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1015441724875

Search

Navigation