ParILUT---A New Parallel Threshold ILU Factorization
Abstract
We propose a parallel algorithm for computing a threshold incomplete LU (ILU) factorization. The main idea is to interleave a parallel fixed-point iteration that approximates an incomplete factorization for a given sparsity pattern with a procedure that adjusts the pattern. We describe and test a strategy for identifying nonzeros to be added and nonzeros to be removed from the sparsity pattern. The resulting pattern may be different and more effective than that of existing threshold ILU algorithms. Also in contrast to other parallel threshold ILU algorithms, much of the new algorithm has fine-grained parallelism.
Keywords
MSC codes
Get full access to this article
View all available purchase options and get full access to this article.
References
1.
H. Anzt, E. Chow, J. Saak, and J. Dongarra, Updating incomplete factorization preconditioners for model order reduction, Numer. Algorithms, 73 (2016), pp. 611--630.
2.
H. Anzt, M. Gates, J. Dongarra, M. Kreutzer, G. Wellein, and M. Köhler, Preconditioned Krylov solvers on GPUs, Parallel Comput., 68 (2017), pp. 32--44.
3.
A. Basermann, Parallel block ILUT/ILDLT preconditioning for sparse eigenproblems and sparse linear systems, Numer. Linear Algebra Appl., 7 (2000), pp. 635--648.
4.
M. Benzi, W. Joubert, and G. Mateescu, Numerical experiments with parallel orderings for ILU preconditioners, Electron. Trans. Numer. Anal., 8 (1999), pp. 88--114.
5.
M. Blum, R. W. Floyd, V. Pratt, R. L. Rivest, and R. E. Tarjan, Time bounds for selection, J. Comput. System Sci., 7 (1973), pp. 448--461.
6.
E. Chow, H. Anzt, and J. Dongarra, Asynchronous iterative algorithm for computing incomplete factorizations on GPUs, in Proceedings of 30th International Conference, ISC High Performance 2015, Lecture Notes in Comput. Sci. 9137, J. Kunkel and T. Ludwig, eds., Springer, New York, 2015, pp. 1--16.
7.
E. Chow and A. Patel, Fine-grained parallel incomplete LU factorization, SIAM J. Sci. Comput., 37 (2015), pp. C169--C193.
8.
E. Chow and Y. Saad, Experimental study of ILU preconditioners for indefinite matrices, J. Comput. Appl. Math., 85 (1997), pp. 387--414.
9.
E. Chow and Y. Saad, ILUS: An incomplete LU preconditioner in sparse skyline format, Internat. J. Numer. Methods Fluids, 25 (1997), pp. 739--748.
10.
T. A. Davis and Y. Hu, The University of Florida sparse matrix collection, ACM Trans. Math. Software, 38 (2011), pp. 1:1--1:25.
11.
S. Doi, On parallelism and convergence of incomplete LU factorizations, Appl. Numer. Math., 7 (1991), pp. 417--436.
12.
I. S. Duff and G. A. Meurant, The effect of ordering on preconditioned conjugate gradients, BIT, 29 (1989), pp. 635--657.
13.
D. Hysom and A. Pothen, A scalable parallel algorithm for incomplete factor preconditioning, SIAM J. Sci. Comput., 22 (2001), pp. 2194--2215.
14.
M. T. Jones and P. E. Plassmann, An improved incomplete Cholesky factorization, ACM Trans. Math. Softw., 21 (1995), pp. 5--17.
15.
G. Karypis and V. Kumar, Parallel threshold-based ILU factorization, in Proceedings of the ACM/IEEE Conference on Supercomputing, 1997, pp. 1--24.
16.
N. Li, Y. Saad, and E. Chow, Crout versions of $ILU$ for general sparse matrices, SIAM J. Sci. Comput., 25 (2003), pp. 716--728.
17.
X. S. Li and M. Shao, A supernodal approach to incomplete LU factorization with partial pivoting, ACM Trans. Math. Softw., 37 (2011), pp. 43:1--43:20.
18.
D. Lukarski, Parallel Sparse Linear Algebra for Multi-Core and Many-Core Platforms---Parallel Solvers and Preconditioners, Ph.D. thesis, Karlsruhe Institute of Technology, Germany, 2012.
19.
N. Munksgaard, Solving sparse symmetric sets of linear equations by preconditioned conjugate gradients, ACM Trans. Math. Softw., 6 (1980), pp. 206--219.
21.
E. L. Poole and J. M. Ortega, Multicolor ICCG methods for vector computers, SIAM J. Numer. Anal., 24 (1987), pp. 1394--1417.
22.
Y. Saad, ILUT: A dual threshold incomplete LU factorization, Numer. Linear Algebra Appl., 1 (1994), pp. 387--402.
23.
Y. Saad, Iterative Methods for Sparse Linear Systems, 2nd ed., SIAM, Philadelphia, 2003.
24.
S. Wang, E. de Sturler, and G. H. Paulino, Large-scale topology optimization using preconditioned Krylov subspace methods with recycling, Internat. J. Numer. Methods Engrg., 69 (2007), pp. 2441--2468.
Information & Authors
Information
Published In
SIAM Journal on Scientific Computing
Pages: C503 - C519
DOI: 10.1137/16M1079506
ISSN (online): 1095-7197
Copyright
© 2018, Society for Industrial and Applied Mathematics.
History
Submitted: 13 June 2016
Accepted: 7 May 2018
Published online: 12 July 2018
Keywords
MSC codes
Authors
Funding Information
Office of Science https://doi.org/10.13039/100006132 : DE-SC0016513
Helmholtz Association https://doi.org/10.13039/501100009318 : VH-NG-1241
Metrics & Citations
Metrics
Citations
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
Cited By
- AIR multigrid with GMRES polynomials (AIRG) and additive preconditioners for Boltzmann transportJournal of Computational Physics, Vol. 518 | 1 Dec 2024
- A Matrix-Free ILU Realization Based on SurrogatesSIAM Journal on Scientific Computing, Vol. 45, No. 6 | 4 December 2023
- Achieving high performance and portable parallel GMRES algorithm for compressible flow simulations on unstructured gridsThe Journal of Supercomputing, Vol. 79, No. 17 | 9 June 2023
- Providing performance portable numerics for Intel GPUsConcurrency and Computation: Practice and Experience, Vol. 35, No. 20 | 26 October 2022
- On the GPU-accelerated Preconditioners for Pressure Poisson EquationAIAA AVIATION 2023 Forum | 8 June 2023
- TileSpTRSV: a tiled algorithm for parallel sparse triangular solve on GPUsCCF Transactions on High Performance Computing, Vol. 5, No. 2 | 12 June 2023
- An Adaptive Coloring Scheme for Graphics Processing Unit PreconditionersDay 1 Tue, March 28, 2023 | 21 March 2023
- A novel ILU preconditioning method with a block structure suitable for SIMD vectorizationJournal of Computational and Applied Mathematics, Vol. 419 | 1 Feb 2023
- Incomplete FactorizationsAlgorithms for Sparse Linear Systems | 11 January 2023
- Solving large linear least squares problems with linear equality constraintsBIT Numerical Mathematics, Vol. 62, No. 4 | 5 July 2022
- Linear Solvers for Reservoir Simulation Problems: An Overview and Recent DevelopmentsArchives of Computational Methods in Engineering, Vol. 29, No. 6 | 11 April 2022
- parGeMSLR: A parallel multilevel Schur complement low-rank preconditioning and solution package for general sparse matricesParallel Computing, Vol. 113 | 1 Oct 2022
- Ginkgo : A Modern Linear Operator Algebra Framework for High Performance ComputingACM Transactions on Mathematical Software, Vol. 48, No. 1 | 16 February 2022
- An Asynchronous Incomplete Block LU Preconditioner for Computational Fluid Dynamics on Unstructured GridsSIAM Journal on Scientific Computing, Vol. 43, No. 1 | 12 January 2021
- RCHOL: Randomized Cholesky Factorization for Solving SDD Linear SystemsSIAM Journal on Scientific Computing, Vol. 43, No. 6 | 21 December 2021
- Efficient Block Algorithms for Parallel Sparse Triangular Solve49th International Conference on Parallel Processing - ICPP | 17 August 2020
- Preparing sparse solvers for exascale computingPhilosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 378, No. 2166 | 20 January 2020
- Parallel selection on GPUsParallel Computing, Vol. 91 | 1 Mar 2020
- Stretching Jacobi: Two-Stage Pivoting in Block-Based Factorization2019 IEEE/ACM 9th Workshop on Irregular Applications: Architectures and Algorithms (IA3) | 1 Nov 2019
- ParILUT - A Parallel Threshold ILU for GPUs2019 IEEE International Parallel and Distributed Processing Symposium (IPDPS) | 1 May 2019
View Options
- Access via your Institution
- Questions about how to access this content? Contact SIAM at [email protected].