PARAOPT: A Parareal Algorithm for Optimality Systems

M. D. Al-Khaleel, M. J. Gander, and A. E. Ruehli, Optimization of transmission conditions in waveform relaxation techniques for RC circuits, SIAM J. Numer. Anal., 52 (2014), pp. 1076--1101.

A. Bellen and M. Zennaro, Parallel algorithms for initial-value problems for difference and differential equations, J. Comput. Appl. Math., 25 (1989), pp. 341--350.

H. Bock and K. Plitt, A multiple shooting algorithm for direct solution of optimal control problems, IFAC Proc. Vol., 17 (1984), pp. 1603--1608, https://doi.org/10.1016/S1474-6670(17)61205-9.

V. Dobrev, T. Kolev, N. A. Petersson, and J. B. Schroder, Two-level convergence theory for multigrid reduction in time (MGRIT), SIAM J. Sci. Comput., 39 (2017), pp. S501--S527.

J. Dongarra, P. Beckman, T. Moore, P. Aerts, G. Aloisio, J.-C. Andre, D. Barkai, J.-Y. Berthou, T. Boku, B. Braunschweig, F. Cappello, B. Chapman, X. Chi, A. Choudhary, S. Dosanjh, T. Dunning, S. Fiore, A. Geist, B. Gropp, R. Harrison, M. Hereld, M. Heroux, A. Hoisie, K. Hotta, Z. Jin, Y. Ishikawa, F. Johnson, S. Kale, R. Kenway, D. Keyes, B. Kramer, J. Labarta, A. Lichnewsky, T. Lippert, B. Lucas, B. Maccabe, S. Matsuoka, P. Messina, P. Michielse, B. Mohr, M. S. Mueller, W. E. Nagel, H. Nakashima, M. E. Papka, D. Reed, M. Sato, E. Seidel, J. Shalf, D. Skinner, M. Snir, T. Sterling, R. Stevens, F. Streitz, B. Sugar, S. Sumimoto, W. Tang, J. Taylor, R. Thakur, A. Trefethen, M. Valero, A. van der Steen, J. Vetter, P. Williams, R. Wisniewski, and K. Yelick, The international exascale software project roadmap, Internat. J. High Performance Comput. Appl., 25 (2011), pp. 3--60.

M. Emmett and M. L. Minion, Toward an efficient parallel in time method for partial differential equations, Commun. Appl. Math. Comput. Sci., 7 (2012), pp. 105--132.

R. Falgout, S. Friedhoff, T. V. Kolev, S. MacLachlan, and J. B. Schroder, Parallel time integration with multigrid, SIAM J. Sci. Comput., 36 (2014), pp. C635--C661.

M. J. Gander, Overlapping Schwarz for linear and nonlinear parabolic problems, in Proceedings of the 9th International Conference on Domain Decomposition, 1996, pp. 97--104, ddm.org.

M. J. Gander, 50 years of time parallel time integration, in Multiple Shooting and Time Domain Decomposition Methods, Springer, New York, 2015, pp. 69--113.

M. J. Gander and S. Güttel, PARAEXP: A parallel integrator for linear initial-value problems, SIAM J. Sci. Comput., 35 (2013), pp. C123--C142.

M. J. Gander and E. Hairer, Nonlinear convergence analysis for the parareal algorithm, in Domain Decomposition Methods in Science and Engineering XVII, O. B. Widlund and D. E. Keyes, eds., Lect. Notes Comput. Sci. Eng. 60, Springer, New York, 2008, pp. 45--56.

M. J. Gander and E. Hairer, Analysis for parareal algorithms applied to Hamiltonian differential equations, J. Comput. Appl. Math., 259 (2014), pp. 2--13.

M. J. Gander and L. Halpern, Absorbing boundary conditions for the wave equation and parallel computing, Math. Comp., 74 (2004), pp. 153--176.

M. J. Gander and L. Halpern, Optimized Schwarz waveform relaxation methods for advection reaction diffusion problems, SIAM J. Numer. Anal., 45 (2007), pp. 666--697.

M. J. Gander, F. Kwok, and B. Mandal, Dirichlet-Neumann and Neumann-Neumann waveform relaxation algorithms for parabolic problems, Electron. Trans. Numer. Anal., 45 (2016), pp. 424--456.

M. J. Gander, F. Kwok, and G. Wanner, Constrained optimization: From Lagrangian mechanics to optimal control and PDE constraints, in Optimization with PDE Constraints, Springer, New York, 2014, pp. 151--202.

M. J. Gander and M. Neumüller, Analysis of a new space-time parallel multigrid algorithm for parabolic problems, SIAM J. Sci. Comput., 38 (2016), pp. A2173--A2208.

M. J. Gander and M. Petcu, Analysis of a Krylov subspace enhanced parareal algorithm for linear problems, in ESAIM: Proceedings, ESAIM Proc. 25, EDP Sciences, Les Ulis, 2008, pp. 114--129.

M. J. Gander and A. M. Stuart, Space-time continuous analysis of waveform relaxation for the heat equation, SIAM J. Sci. Comput., 19 (1998), pp. 2014--2031.

M. J. Gander and S. Vandewalle, Analysis of the parareal time-parallel time-integration method, SIAM J. Sci. Comput., 29 (2007), pp. 556--578.

E. Giladi and H. B. Keller, Space time domain decomposition for parabolic problems, Numer. Math., 93 (2002), pp. 279--313.

R. Glowinski and J. Lions, Exact and approximate controllability for distributed parameter systems, Acta Numer., 3 (1994), pp. 269--378.

S. Götschel and M. L. Minion, Parallel-in-time for parabolic optimal control problems using PFASST, in Domain Decomposition Methods in Science and Engineering XXIV, Springer, New York, 2018, pp. 363--371.

S. Götschel and M. L. Minion, An efficient parallel-in-time method for optimization with parabolic PDEs, SIAM J. Sci. Comput., 41 (2019), pp. C603--C626.

S. Günther, N. R. Gauger, and J. B. Schroder, A non-intrusive parallel-in-time adjoint solver with the XBraid library, Comput. Vis. Sci., 19 (2018), pp. 85--95.

S. Günther, N. R. Gauger, and J. B. Schroder, A non-intrusive parallel-in-time approach for simultaneous optimization with unsteady PDEs, Optim. Methods Softw., 34 (2019), pp. 1306--1321.

W. Hackbusch, Parabolic multi-grid methods, in Computing Methods in Applied Sciences and Engineering, VI, R. Glowinski and J.-L. Lions, eds., North-Holland, Amsterdam, 1984, pp. 189--197.

G. Horton and S. Vandewalle, A space-time multigrid method for parabolic partial differential equations, SIAM J. Sci. Comput., 16 (1995), pp. 848--864.

K. Ito and K. Kunisch, Lagrange Multiplier Approach to Variational Problems and Applications, Adv. Des. Control 15, SIAM, Philadelphia, 2008.

M. Kiehl, Parallel multiple shooting for the solution of initial value problems, Parallel Comp., 20 (1994), pp. 275--295.

F. Kwok, Neumann--Neumann waveform relaxation for the time-dependent heat equation, in Domain Decomposition Methods in Science and Engineering XXI, Lect. Notes Comput, Sci. Eng. 98, Springer, New York, 2014, pp. 189--198.

E. Lelarasmee, A. E. Ruehli, and A. L. Sangiovanni-Vincentelli, The waveform relaxation method for time-domain analysis of large scale integrated circuits, IEEE Trans. Computer-Aided Des., Integrated circuits Syst., 1 (1982), pp. 131--145.

J.-L. Lions, Y. Maday, and G. Turinici, Résolution d'edp par un schéma en temps `pararéel', C. R. Acad. Sci. Ser. I Math., 332 (2001), pp. 661--668.

C. Lubich and A. Ostermann, Multi-grid dynamic iteration for parabolic equations, BIT, 27 (1987), pp. 216--234.

Y. Maday and E. M. Rønquist, Parallelization in time through tensor-product space--time solvers, C. R. Math., 346 (2008), pp. 113--118.

Y. Maday, J. Salomon, and G. Turinici, Monotonic parareal control for quantum systems, SIAM J. Numer. Anal., 45 (2007), pp. 2468--2482, https://doi.org/10.1137/050647086.

Y. Maday and G. Turinici, A parareal in time procedure for the control of partial differential equations, C. R. Math., 335 (2002), pp. 387--392, https://doi.org/10.1016/S1631-073X(02)02467-6.

Y. Maday and G. Turinici, Parallel in time algorithms for quantum control: Parareal time discretization scheme, Internat. J. Quantum Chemistry, 93 (2003), pp. 223--228, https://doi.org/10.1002/qua.10554.

B. Mandal, A time-dependent Dirichlet-Neumann method for the heat equation, in Domain Decomposition Methods in Science and Engineering XXI, Lect. Notes Comput. Sci. Eng. 98, Springer, New york, 2014, pp. 467--475.

M. L. Minion, A hybrid parareal spectral deferred corrections method, Comm. Appl. Math. Comput. Sci., 5 (2010), pp. 265--301.

M. L. Minion, R. Speck, M. Bolten, M. Emmett, and D. Ruprecht, Interweaving PFASST and parallel multigrid, SIAM J. Sci. Comput., 37 (2015), pp. S244--S263.

W. L. Miranker and W. Liniger, Parallel methods for the numerical integration of ordinary differential equations, Math. Comp., 91 (1967), pp. 303--320.

D. D. Morrison, J. D. Riley, and J. F. Zancanaro, Multiple shooting method for two-point boundary value problems, Comm. ACM, 5 (1962), pp. 613--614, https://doi.org/10.1145/355580.369128.

A. S. Nielsen, Feasibility Study of the Parareal Algorithm, Master's thesis, Technical Universityof Denmark, Kongens Lyngby, 2012.

J. Nievergelt, Parallel methods for integrating ordinary differential equations, Comm. ACM, 7 (1964), pp. 731--733.

B. W. Ong and J. B. Schroder, Applications of time parallelization, Comput. Vis. Sci., to appear.

J. W. Pearson, M. Stoll, and A. J. Wathen, Regularization-robust preconditioners for time-dependent PDE-constrained optimization problems, SIAM J. Matrix Anal. Appl., 33 (2012), pp. 1126--1152.

M. K. Riahi, J. Salomon, S. J. Glaser, and D. Sugny, Fully efficient time-parallelized quantum optimal control algorithm, Phys. Rev A, 93 (2016), https://doi.org/10.1103/PhysRevA.93.043410.

D. Sheen, I. H. Sloan, and V. Thomée, A parallel method for time discretization of parabolic equations based on Laplace transformation and quadrature, IMA J. Numer. Anal., 23 (2003), pp. 269--299.

V. Thomée, A high order parallel method for time discretization of parabolic type equations based on Laplace transformation and quadrature, Int. J. Numer. Anal. Model., 2 (2005), pp. 121--139.

F. Tröltzsch, Optimal Control of Partial Differential Equations: Theory Methods Appl. 112, AMS Providence, RI, 2010.

S. Ulbrich, Preconditioners based on “Parareal” time-domain decomposition for time-dependent PDE-constrained Optimization, in Multiple Shooting and Time Domain Decomposition Methods, Springer, New York, 2015, pp. 203--232.

S. Vandewalle and E. Van de Velde, Space-time concurrent multigrid waveform relaxation, Ann. Numer. Math, 1 (1994), pp. 347--363.