Abstract.

This is the second paper in a series in which we develop machine learning (ML) moment closure models for the radiative transfer equation (RTE). In our previous work [J. Huang, Y. Cheng, A. J. Christlieb, and L. F. Roberts, J. Comput. Phys., 453 (2022), 110941], we proposed an approach to directly learn the spatial gradient of the unclosed high-order moment, which performs much better than learning the moment itself and the conventional \(P_N\) closure. However, the ML moment closure model in [J. Huang, Y. Cheng, A. J. Christlieb, and L. F. Roberts, J. Comput. Phys., 453 (2022), 110941] is not able to guarantee hyperbolicity and long time stability. We propose in this paper a method to enforce the global hyperbolicity of the ML closure model. The main idea is to seek a symmetrizer (a symmetric positive definite matrix) for the closure system and derive constraints such that the system is globally symmetrizable hyperbolic. It is shown that the new ML closure system inherits the dissipativeness of the RTE and preserves the correct diffusion limit as the Knudsen number goes to zero. Several benchmark tests including the Gaussian source problem and the two-material problem show the good accuracy, long time stability, and generalizability of our globally hyperbolic ML closure model.

Keywords

  1. radiative transfer equation
  2. moment closure
  3. machine learning
  4. neural network
  5. hyperbolicity
  6. long time stability

MSC codes

  1. 78A35
  2. 82C70

Get full access to this article

View all available purchase options and get full access to this article.

Acknowledgments.

We thank Michael M. Crockatt from Sandia National Laboratories for providing a numerical solver for the RTEs. We also would like to acknowledge the High Performance Computing Center at Michigan State University for providing computational resources that have contributed to the research results reported within this paper. We thank two anonymous reviewers for providing helpful comments on an earlier draft of the manuscript.

References

1.
G. W. Alldredge, C. D. Hauck, D. P. OLeary, and A. L. Tits, Adaptive change of basis in entropy-based moment closures for linear kinetic equations, J. Comput. Phys., 258 (2014), pp. 489–508.
2.
G. W. Alldredge, C. D. Hauck, and A. L. Tits, High-order entropy-based closures for linear transport in slab geometry II: A computational study of the optimization problem, SIAM J. Sci. Comput., 34 (2012), pp. B361–B391.
3.
G. W. Alldredge, R. Li, and W. Li, Approximating the \({M}_2\) method by the extended quadrature method of moments for radiative transfer in slab geometry, Kinet. Relat. Models, 9 (2016), pp. 237–249.
4.
L. Bois, E. Franck, L. Navoret, and V. Vigon, A neural network closure for the Euler-Poisson system based on kinetic simulations, Kinet. Relat. Models, 15 (2022), pp. 49–89.
5.
S. L. Brunton, J. L. Proctor, and J. N. Kutz, Discovering governing equations from data by sparse identification of nonlinear dynamical systems, Proc. Natl. Acad. Sci. USA, 113 (2016), pp. 3932–3937.
6.
Z. Cai, Y. Fan, and R. Li, Globally hyperbolic regularization of Grad’s moment system in one-dimensional space, Commun. Math. Sci., 11 (2013), pp. 547–571.
7.
Z. Cai, Y. Fan, and R. Li, Globally hyperbolic regularization of Grad’s moment system, Comm. Pure Appl. Math., 67 (2014), pp. 464–518.
8.
Z. Cai, Y. Fan, and R. Li, On hyperbolicity of 13-moment system, Kinet. Relat. Models, 7 (2014), pp. 415–432.
9.
S. Chandrasekhar, On the radiative equilibrium of a stellar atmosphere, Astrophys. J., 99 (1944), pp. 180–190.
10.
M. M. Crockatt, A. J. Christlieb, C. K. Garrett, and C. D. Hauck, An arbitrary-order, fully implicit, hybrid kinetic solver for linear radiative transport using integral deferred correction, J. Comput. Phys., 346 (2017), pp. 212–241.
11.
M. M. Crockatt, A. J. Christlieb, C. K. Garrett, and C. D. Hauck, Hybrid methods for radiation transport using diagonally implicit Runge-Kutta and space-time discontinuous galerkin time integration, J. Comput. Phys., 376 (2019), pp. 455–477.
12.
Y. Di, Y. Fan, R. Li, and L. Zheng, Linear stability of hyperbolic moment models for Boltzmann equation, Numer. Math. Theory Methods Appl., 10 (2017), pp. 255–277.
13.
Y. Fan, R. Li, and L. Zheng, A nonlinear hyperbolic model for radiative transfer equation in slab geometry, SIAM J. Appl. Math., 80 (2020), pp. 2388–2419.
14.
Y. Fan, R. Li, and L. Zheng, A nonlinear moment model for radiative transfer equation in slab geometry, J. Comput. Phys., 404 (2020), 109128.
15.
M. Frank, C. D. Hauck, and E. Olbrant, Perturbed, entropy-based closure for radiative transfer, Kinet. Relat. Models, 6 (2013), pp. 557–587.
16.
H. Grad, On the kinetic theory of rarefied gases, Comm. Pure Appl. Math., 2 (1949), pp. 331–407.
17.
J. Han, A. Jentzen, and E. W., Solving high-dimensional partial differential equations using deep learning, Proc. Natl. Acad. Sci. USA, 115 (2018), pp. 8505–8510.
18.
J. Han, C. Ma, Z. Ma, and E. W., Uniformly accurate machine learning-based hydrodynamic models for kinetic equations, Proc. Natl. Acad. Sci. USA, 116 (2019), pp. 21983–21991.
19.
C. Hauck and R. McClarren, Positive \(P_N\) closures, SIAM J. Sci. Comput., 32 (2010), pp. 2603–2626.
20.
C. D. Hauck, High-order entropy-based closures for linear transport in slab geometry, Commun. Math. Sci., 9 (2011), pp. 187–205.
21.
J. Huang, Y. Cheng, A. J. Christlieb, and L. F. Roberts, Machine learning moment closure models for the radiative transfer equation III: Enforcing hyperbolicity and physical characteristic speeds, J. Sci. Comput., 94 (2023).
22.
J. Huang, Y. Cheng, A. J. Christlieb, and L. F. Roberts, Machine learning moment closure models for the radiative transfer equation I: Directly learning a gradient based closure, J. Comput. Phys., 453 (2022), 110941.
23.
J. Huang, Z. Ma, Y. Zhou, and W.-A. Yong, Learning thermodynamically stable and Galilean invariant partial differential equations for non-equilibrium flows, J. Non-Equil. Thermodyn., 46 (2021), pp. 355–370.
24.
G.-S. Jiang and C.-W. Shu, Efficient implementation of weighted ENO schemes, J. Comput. Phys., 126 (1996), pp. 202–228.
25.
A. D. Klose, U. Netz, J. Beuthan, and A. H. Hielscher, Optical tomography using the time-independent equation of radiative transfer—part 1: Forward model, J. Quant. Spectrosc. Radiat. Transfer, 72 (2002), pp. 691–713.
26.
R. Koch and R. Becker, Evaluation of quadrature schemes for the discrete ordinates method, J. Quant. Spectrosc. Radiat. Transfer, 84 (2004), pp. 423–435.
27.
V. M. Laboure, R. G. McClarren, and C. D. Hauck, Implicit filtered \({P}_{N}\) for high-energy density thermal radiation transport using discontinuous Galerkin finite elements, J. Comput. Phys., 321 (2016), pp. 624–643.
28.
E. Larsen and J. Morel, Asymptotic solutions of numerical transport problems in optically thick, diffusive regimes II, J. Comput. Phys., 83 (1989), pp. 283–324.
29.
C. Lattanzio and W.-A. Yong, Hyperbolic-parabolic singular limits for first-order nonlinear systems, Comm. Partial Differential Equations, 26 (2001), pp. 939–964.
30.
C. Levermore, Relating eddington factors to flux limiters, J. Quant. Spectrosc. Radiat. Transfer, 31 (1984), pp. 149–160.
31.
R. Li, W. Li, and L. Zheng, Direct flux gradient approximation to moment closure of kinetic equations, SIAM J. Appl. Math., 81 (2021), pp. 2153–2179.
32.
C. Ma, B. Zhu, X.-Q. Xu, and W. Wang, Machine learning surrogate models for Landau fluid closure, Phys. Plasmas, 27 (2020), 042502.
33.
R. Maulik, N. A. Garland, J. W. Burby, X.-Z. Tang, and P. Balaprakash, Neural network representability of fully ionized plasma fluid model closures, Phys. Plasmas, 27 (2020), 072106.
34.
R. G. McClarren and C. D. Hauck, Robust and accurate filtered spherical harmonics expansions for radiative transfer, J. Comput. Phys., 229 (2010), pp. 5597–5614.
35.
E. Murchikova, E. Abdikamalov, and T. Urbatsch, Analytic closures for M1 neutrino transport, Monthly Not. R. Astronom. Soc., 469 (2017), pp. 1725–1737.
36.
Y.-J. Peng and V. Wasiolek, Uniform global existence and parabolic limit for partially dissipative hyperbolic systems, J. Differential Equations, 260 (2016), pp. 7059–7092.
37.
G. C. Pomraning, The Equations of Radiation Hydrodynamics, Pergamon Press, Oxford, 1973.
38.
M. Raissi, P. Perdikaris, and G. E. Karniadakis, Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations, J. Comput. Phys., 378 (2019), pp. 686–707.
39.
J. B. Scoggins, J. Han, and M. Massot, Machine learning moment closures for accurate and efficient simulation of polydisperse evaporating sprays, in Proceedings of the AIAA Scitech 2021 Forum, 2021, AIAA 2021–1786.
40.
D. Serre, Systems of Conservation Laws 1: Hyperbolicity, Entropies, Shock Waves, Cambridge University Press, Cambridge, UK, 1999.
41.
C.-W. Shu and S. Osher, Efficient implementation of essentially non-oscillatory shock-capturing schemes, J. Comput. Phys., 77 (1988), pp. 439–471.
42.
L. Wang, X. Xu, B. Zhu, C. Ma, and Y.-A. Lei, Deep learning surrogate model for kinetic Landau-fluid closure with collision, AIP Adv., 10 (2020), 075108.
43.
W.-A. Yong, Singular perturbations of first-order hyperbolic systems with stiff source terms, J. Differential Equations, 155 (1999), pp. 89–132.
44.
W.-A. Yong, An interesting class of partial differential equations, J. Math. Phys., 49 (2008), 033503.
45.
Y. Zhu, L. Hong, Z. Yang, and W.-A. Yong, Conservation-dissipation form alism of irreversible thermodynamics, J. Non-Equil. Thermodyn., 40 (2015), pp. 67–74.

Information & Authors

Information

Published In

cover image Multiscale Modeling & Simulation
Multiscale Modeling & Simulation
Pages: 489 - 512
ISSN (online): 1540-3467

History

Submitted: 1 June 2021
Accepted: 16 November 2022
Published online: 25 April 2023

Keywords

  1. radiative transfer equation
  2. moment closure
  3. machine learning
  4. neural network
  5. hyperbolicity
  6. long time stability

MSC codes

  1. 78A35
  2. 82C70

Authors

Affiliations

Department of Mathematics, Michigan State University, East Lansing, MI 48824 USA.
Yingda Cheng
Department of Mathematics, Department of Computational Mathematics, Science, and Engineering, Michigan State University, East Lansing, MI 48824 USA.
Andrew J. Christlieb
Department of Computational Mathematics, Science, and Engineering, Michigan State University, East Lansing, MI 48824 USA.
Luke F. Roberts
National Superconducting Cyclotron Laboratory and Department of Physics and Astronomy, Michigan State University, East Lansing, MI 48824 USA.
Department of Mathematical Sciences, Tsinghua University, Beijing 100084, China; and Yanqi Lake Beijing Institute of Mathematical Sciences and Applications, Beijing 101408, China.

Funding Information

Air Force Office of Scientific Research (AFOSR): FA9550-19-1-0281, FA9550-17-1-0394
National Key Research and Development Program of China: 2021YFA0719200
Funding: The second author was supported by NSF grants DMS-2011838 and AST-2008004. The third author was supported by AFOSR grants FA9550-19-1-0281 and FA9550-17-1-0394 and by NSF grants DMS-1912183. The fifth author was supported by National Natural Science Foundation of China (grant 12071246) and National Key Research and Development Program of China (grant 2021YFA0719200). The second, third, and fourth authors were supported by NSF grant AST-2008004. The third and fourth authors were supported by DoE grant DE-SC0017955.

Metrics & Citations

Metrics

Citations

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

View Options

View options

PDF

View PDF

Full Text

View Full Text

Figures

Tables

Media

Share

Share

Copy the content Link

Share with email

Email a colleague

Share on social media