SIAM Journal on Matrix Analysis and Applications


Convergence of Inner-Iteration GMRES Methods for Rank-Deficient Least Squares Problems

Related Databases

Web of Science

You must be logged in with an active subscription to view this.

Article Data

History

Submitted: 20 November 2013
Accepted: 05 January 2015
Published online: 04 March 2015

Publication Data

ISSN (print): 0895-4798
ISSN (online): 1095-7162
CODEN: sjmael

We develop a general convergence theory for the generalized minimal residual method preconditioned by inner iterations for solving least squares problems. The inner iterations are performed by stationary iterative methods. We also present theoretical justifications for using specific inner iterations such as the Jacobi and SOR-type methods. The theory improves previous work [K. Morikuni and K. Hayami, SIAM J. Matrix Anal. Appl., 34 (2013), pp. 1--22], particularly in the rank-deficient case. We also characterize the spectrum of the preconditioned coefficient matrix by the spectral radius of the iteration matrix for the inner iterations and give a convergence bound for the proposed methods. Finally, numerical experiments show that the proposed methods are more robust and efficient compared to previous methods for some rank-deficient problems.

© 2015, Society for Industrial and Applied Mathematics

Cited by

(2020) Right preconditioned MINRES for singular systems . Numerical Linear Algebra with Applications 12, e2277. Crossref
(2019) Implementation of interior-point methods for LP based on Krylov subspace iterative solvers with inner-iteration preconditioning. Computational Optimization and Applications 74:1, 143-176. Crossref
(2019) Research on parallel solution of GRAPES Helmholtz equation. Concurrency and Computation: Practice and Experience 31:12. Crossref
and . (2019) Flexible Krylov Methods for $\ell_p$ Regularization. SIAM Journal on Scientific Computing 41:5, S149-S171. Abstract | PDF (1038 KB) 
(2018) Two-stage iterations based on composite splittings for rectangular linear systems. Computers & Mathematics with Applications 75:8, 2746-2756. Crossref
and . (2018) On GMRES for Singular EP and GP Systems. SIAM Journal on Matrix Analysis and Applications 39:2, 1033-1048. Abstract | PDF (962 KB) 
(2017) On the computation of a truncated SVD of a large linear discrete ill-posed problem. Numerical Algorithms 75:2, 359-380. Crossref
(2017) Multistep matrix splitting iteration preconditioning for singular linear systems. Numerical Algorithms 75:2, 457-475. Crossref
(2017) The State-of-the-Art of Preconditioners for Sparse Linear Least-Squares Problems. ACM Transactions on Mathematical Software 43:4, 1-35. Crossref
. (2017) On Using Cholesky-Based Factorizations and Regularization for Solving Rank-Deficient Sparse Linear Least-Squares Problems. SIAM Journal on Scientific Computing 39:4, C319-C339. Abstract | PDF (350 KB) 
(2016) Jacobian-Free Implicit Inner-Iteration Preconditioner for Nonlinear Least Squares Problems. Journal of Scientific Computing 68:3, 1055-1081. Crossref
(2016) Preconditioning of Nonlinear Mixed Effects Models for Stabilisation of Variance-Covariance Matrix Computations. The AAPS Journal 18:2, 505-518. Crossref