Abstract
We investigate the solution of linear systems of equations that arise when singularly perturbed reaction–diffusion partial differential equations are solved using a standard finite difference method on layer adapted grids. It is known that there are difficulties in solving such systems by direct methods when the perturbation parameter, \(\varepsilon \), is small (MacLachlan and Madden in SIAM J Sci Comput 35(5):A2225–A2254, 2013). Therefore, iterative methods are natural choices. However, we show that, in two dimensions, the condition number of the coefficient matrix grows unboundedly when \(\varepsilon \) tends to zero, and so unpreconditioned iterative schemes, such as the conjugate gradient algorithm, perform poorly with respect to \(\varepsilon \). We provide a careful analysis of diagonal and incomplete Cholesky preconditioning methods, and show that the condition number of the preconditioned linear system is independent of the perturbation parameter. We demonstrate numerically the surprising fact that these schemes are more efficient when \(\varepsilon \) is small, than when \(\varepsilon \) is \(\mathcal {O}(1)\). Furthermore, our analysis shows that when the singularly perturbed problem features no corner layers, an incomplete Cholesky preconditioner performs extremely well when \(\varepsilon \ll 1\). We provide numerical evidence that our findings extend to three-dimensional problems.




Similar content being viewed by others
References
Ansari, A.R., Hegarty, A.F.: A note on iterative methods for solving singularly perturbed problems using non-monotone methods on Shishkin meshes. Comput. Methods Appl. Mech. Eng. 192(33–34), 3673–3687 (2003). https://doi.org/10.1016/S0045-7825(03)00369-4
Bakhvalov, N.: Towards optimization of methods for solving boundary value problems in the presence of boundary layers. Zh. Vzchisl. Mat. i Mat fiz. 9, 841–859 (1969)
Chadha, N.M., Kopteva, N.: Maximum norm a posteriori error estimate for a 3d singularly perturbed semilinear reaction-diffusion problem. Adv. Comput. Math. 35(1), 33–55 (2011). https://doi.org/10.1007/s10444-010-9163-2
Clavero, C., Gracia, J., O’Riordan, E.: A parameter robust numerical method for a two dimensional reaction–diffusion problem. Math. Comput. 74(252), 1743–1758 (2005). https://doi.org/10.1090/S0025-5718-05-01762-X
Farrell, P.A., Hegarty, A.F., Miller, J.J.H., O’Riordan, E., Shishkin, G.I.: Robust Computational Techniques for Boundary Layers. Applied Mathematics (Boca Raton), vol. 16. Chapman & Hall/CRC, Boca Raton (2000)
Farrell, P.A., Shishkin, G.I.: On the convergence of iterative methods for linear systems arising from singularly perturbed equations. In: Proceedings of the Copper Mountain Conference on Iterative Methods, Lecture Notes in Comput. Sci., pp. 1–7 (1998)
Gaspar, F.J., Clavero, C., Lisbona, F.: Some numerical experiments with multigrid methods on Shishkin meshes. J. Comput. Appl. Math. 138(1), 21–35 (2002). https://doi.org/10.1016/S0377-0427(01)00365-X
Gaspar, F.J., Lisbona, F., Clavero, C.: Multigrid methods and finite difference schemes for 2D singularly perturbed problems. In: Numerical analysis and its applications (Rousse, 2000), Lecture Notes in Comput. Sci., vol. 1988, pp. 316–324. Springer, Berlin (2001)
Gracia, J.L., Madden, N., Nhan, T.A.: Applying a patched mesh method to efficiently solve a singularly perturbed reaction–diffusion problem. In: Bock, H.G., Phu, H.X., Rannacher, R., Schlöder, J.P. (eds.) Modeling, Simulation and Optimization of Complex Processes HPSC 2015, pp. 41–53. Springer International Publishing, Cham (2017)
Greenbaum, A.: Iterative methods for solving linear systems. In: Frontiers in Applied Mathematics, vol. 17. Society for Industrial and Applied Mathematics (SIAM), Philadelphia, PA (1997). https://doi.org/10.1137/1.9781611970937
Gustafsson, I.: A class of first order factorization methods. BIT 18(2), 142–156 (1978). https://doi.org/10.1007/BF01931691
Kellogg, R., Madden, N., Stynes, M.: A parameter-robust numerical method for a system of reaction–diffusion equations in two dimensions. Numer. Methods Partial Differ. Equ. 24(1), 312–334 (2008). https://doi.org/10.1002/num.20265
Kellogg, R.B., Linss, T., Stynes, M.: A finite difference method on layer-adapted meshes for an elliptic reaction–diffusion system in two dimensions. Math. Comput. 77(264), 2085–2096 (2008). https://doi.org/10.1090/S0025-5718-08-02125-X
Kopteva, N., Pickett, M.: A second-order overlapping Schwarz method for a 2D singularly perturbed semilinear reaction–diffusion problem. Math. Comp. 81(277), 81–105 (2012). https://doi.org/10.1090/S0025-5718-2011-02521-4
Linß, T.: Layer-adapted meshes for reaction–convection–diffusion problems, Lecture Notes in Mathematics, vol. 1985. Springer, Berlin (2010)
MacLachlan, S., Madden, N.: Robust solution of singularly perturbed problems using multigrid methods; analysis and numerical results in one and two dimensions. Tech. rep., NUI Galway (2012)
MacLachlan, S., Madden, N.: Robust solution of singularly perturbed problems using multigrid methods. SIAM J. Sci. Comput. 35(5), A2225–A2254 (2013). https://doi.org/10.1137/120889770
Meijerink, J.A., van der Vorst, H.A.: An iterative solution method for linear systems of which the coefficient matrix is a symmetric \(M\)-matrix. Math. Comp. 31(137), 148–162 (1977)
Miller, J.J.H., O’Riordan, E., Shishkin, G.I.: Fitted numerical methods for singular perturbation problems, revised edn. World Scientific Publishing Co. Pte. Ltd., Hackensack, NJ (2012). https://doi.org/10.1142/9789814390743
Nhan, A.T.: Preconditioning techniques for singularly perturbed differential equations. Ph.D. thesis, National University of Ireland Galway (2015). http://hdl.handle.net/10379/5262
Nhan, T.A., MacLachlan, S., Madden, N.: Boundary layer preconditioners for finite-element discretizations of singularly perturbed reaction–diffusion problems. Numer. Algorithms 79(1), 281–310 (2018). https://doi.org/10.1007/s11075-017-0437-3
Nhan, T.A., Madden, N.: Cholesky factorization of linear systems coming from finite difference approximations of singularly perturbed problems. In: BAIL 2014—boundary and interior layers, Lect. Notes Comput. Sci. Eng. Vol. 108, pp. 209–220. Springer, Berlin (2015)
Roos, H.G., Stynes, M., Tobiska, L.: Robust numerical methods for singularly perturbed differential equations. Convection–diffusion–reaction and flow problems. Springer Series in Computational Mathematics, vol. 24, second edn. Springer-Verlag, Berlin (2008)
Russell, S., Madden, N.: Analysis of a Galerkin finite element method applied to a singularly perturbed reaction–diffusion problem in three dimensions. Int. J. Numer. Anal. Model. (to appear) 1–17 (2020)
Shishkin, G.I., Shishkina, L.P.: Difference Methods for Singular Perturbation Problems, Chapman & Hall/CRC Monographs and Surveys in Pure and Applied Mathematics, vol. 140. CRC Press, Boca Raton (2009)
Varah, J.M.: A lower bound for the smallest singular value of a matrix. Linear Algebra and Appl. 11, 3–5 (1975)
Acknowledgements
Parts of this article are related the Ph.D. thesis of the first author [20, Chap. 4] which is available at NUI Galway’s repository website and can be accessed on http://hdl.handle.net/10379/5262. This article is not published nor is under review for publication elsewhere. The authors wish to thank Scott MacLachlan for valuable discussions during the preparation of this manuscript. We also wish to acknowledge the DJEI/DES/SFI/HEA Irish Centre for High-End Computing (ICHEC) for the provision of computational facilities and support.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This work was supported by the Irish Research Council under Grant No. RS/2011/179.
Rights and permissions
About this article
Cite this article
Nhan, T.A., Madden, N. An analysis of diagonal and incomplete Cholesky preconditioners for singularly perturbed problems on layer-adapted meshes. J. Appl. Math. Comput. 65, 245–272 (2021). https://doi.org/10.1007/s12190-020-01390-z
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12190-020-01390-z