Search
Search
Quick Search in Journals
Quick Search anywhere
Quick Search anywhere
Quick Search anywhere
Quick Search anywhere
Advanced Search
Skip main navigation
Previous article
Next article

Transition Path Theory for Markov Jump Processes

https://doi.org/10.1137/070699500

Abstract

The framework of transition path theory (TPT) is developed in the context of continuous-time Markov chains on discrete state-spaces. Under assumption of ergodicity, TPT singles out any two subsets in the state-space and analyzes the statistical properties of the associated reactive trajectories, i.e., those trajectories by which the random walker transits from one subset to another. TPT gives properties such as the probability distribution of the reactive trajectories, their probability current and flux, and their rate of occurrence and the dominant reaction pathways. In this paper the framework of TPT for Markov chains is developed in detail, and the relation of the theory to electric resistor network theory and data analysis tools such as Laplacian eigenmaps and diffusion maps is discussed as well. Various algorithms for the numerical calculation of the various objects in TPT are also introduced. Finally, the theory and the algorithms are illustrated in several examples.

  • [1]  Google Scholar

  • [2]  R. Albert and  and A.-L. Barabási, Statistical mechanics of complex networks, Rev. Modern Phys., 74 (2002), pp. 48–97. RMPHAT 0034-6861 CrossrefGoogle Scholar

  • [3]  M. Belkin and  and P. Niyogi, Laplacian eigenmaps for dimensionality reduction and data representation, Neural Comput., 6 (2003), pp. 1373–1396. NEUCEB 0899-7667 CrossrefISIGoogle Scholar

  • [4]  G. Ben Arous, , A. Bovier and , and V. Gayrard, Aging in the random energy model under Glauber dynamics, Phys. Rev. Lett., 88 (2002), 087201. PRLTAO 0031-9007 CrossrefISIGoogle Scholar

  • [5]  H. J. C. Berendsen, , D. van der Spoel and , and R. van Drunen, GROMACS: A message-passing parallel molecular dynamics implementation, Comput. Phys. Comm., 91 (1995), pp. 43–56. CPHCBZ 0010-4655 CrossrefISIGoogle Scholar

  • [6]  M. Bladt and  and M. Sörensen, Statistical inference for discretely observed Markov jump processes, J. R. Stat. Soc. Ser. B Stat. Methodol., 67 (2005), pp. 395–410. 1369-7412 CrossrefISIGoogle Scholar

  • [7]  A. Bovier, , M. Eckhoff, , V. Gayrard and , and M. Klein, Metastability in stochastic dynamics of disordered mean-field models, Probab. Theory Related Fields, 119 (2001), pp. 99–161. PTRFEU 0178-8051 CrossrefISIGoogle Scholar

  • [8]  A. Bovier, , M. Eckhoff, , V. Gayrard and , and M. Klein, Metastability and low lying spectra in reversible Markov chains, Comm. Math. Phys., 228 (2002), pp. 219–255. CMPHAY 0010-3616 CrossrefISIGoogle Scholar

  • [9]  A. Brass, , B. J. Pendleton, , Y. Chen and , and B. Robson, Hybrid Monte Carlo simulations theory and initial comparison with molecular dynamics, Biopolymers, 33 (1993), pp. 1207–1315. BIPMAA 0006-3525 CrossrefISIGoogle Scholar

  • [10]  Google Scholar

  • [11]  R. C. Coifman and  and S. Lafon, Diffusion maps, Appl. Comput. Harmon. Anal., 21 (2006), pp. 5–30. ACOHE9 1063-5203 CrossrefISIGoogle Scholar

  • [12]  P. Deuflhard, , W. Huisinga, , A. Fischer and , and Ch. Schütte, Identification of almost invariant aggregates in reversible nearly uncoupled Markov chains, Linear Algebra Appl., 315 (2000), pp. 39–59. LAAPAW 0024-3795 CrossrefISIGoogle Scholar

  • [13]  Google Scholar

  • [14]  D. L. Donoho and  and C. Grimes, Hessian eigenmaps: New locally linear embedding techniques for high-dimensional data, Proc. Natl. Acad. Sci. USA, 100 (2003), pp. 5591–5596. PNASA6 0027-8424 CrossrefISIGoogle Scholar

  • [15]  Google Scholar

  • [16]  W. E and  and E. Vanden-Eijnden, Towards a theory of transition paths, J. Stat. Phys., 123 (2006), pp. 503–523. JSTPBS 0022-4715 CrossrefISIGoogle Scholar

  • [17]  Google Scholar

  • [18]  Google Scholar

  • [19]  Google Scholar

  • [20]  S. Huo and  and J. E. Straub, The MaxFlux algorithm for calculating variationally optimized reaction paths for conformational transitions in many body systems at finite temperature, J. Chem. Phys., 107 (1997), pp. 5000–5006. JCPSA6 0021-9606 CrossrefISIGoogle Scholar

  • [21]  S. Lafon and  and A. B. Lee, Diffusion maps and coarse-graining: A unified framework for dimensionality reduction, graph partitioning, and data set parameterization, IEEE Trans. Pattern Anal. Mach. Intell., 28 (2006), pp. 1393–1403. ITPIDJ 0162-8828 CrossrefISIGoogle Scholar

  • [22]  E. Lindahl, , B. Hess and , and D. van der Spoel, GROMACS 3.0: A package for molecular simulation and trajectory analysis, J. Mol. Model., 7 (2001), pp. 306–317. JMMOFK 0948-5023 CrossrefISIGoogle Scholar

  • [23]  Google Scholar

  • [24]  P. Metzner, , E. Dittmer, , T. Jahnke and , and Ch. Schütte, Generator estimation for Markov jump processes, J. Comput. Phys., 227 (2007), pp. 353–375. JCTPAH 0021-9991 CrossrefISIGoogle Scholar

  • [25]  P. Metzner, , Ch. Schütte and , and E. Vanden-Eijnden, Illustration of transition path theory on a collection of simple examples, J. Chem. Phys., 125 (2006), 084110. JCPSA6 0021-9606 CrossrefISIGoogle Scholar

  • [26]  M. E. J. Newman, The structure and function of complex networks, SIAM Rev., 45 (2003), pp. 167–256. SIREAD 0036-1445 LinkISIGoogle Scholar

  • [27]  S. Park, , M. K. Sener, , D. Lu and , and K. Schulten, Reaction paths based on mean first-passage times, J. Chem. Phys., 119 (2003), pp. 1313–1319. JCPSA6 0021-9606 CrossrefISIGoogle Scholar

  • [28]  D. M. Roma, , R. O'Flanagan, , A. Ruckenstein, , A. M. Sengupta and , and R. Mukhopadhyay, Optimal path in epigenetic switching, Phys. Rev. E (3), 71 (2005), 011902. PLEEE8 1063-651X CrossrefISIGoogle Scholar

  • [29]  S. T. Roweis and  and L. K. Saul, Nonlinear dimensionality reduction by locally linear embedding, Science, 290 (2000), pp. 2323–2326. CrossrefISIGoogle Scholar

  • [30]  Ch. Schütte, , A. Fischer, , W. Huisinga and , and P. Deuflhard, A direct approach to conformational dynamics based on hybrid Monte Carlo, J. Comput. Phys., 151 (1999), pp. 146–168. JCTPAH 0021-9991 CrossrefISIGoogle Scholar

  • [31]  Google Scholar

  • [32]  J. Shi and  and J. Malik, Normalized cuts and image segmentation, IEEE Trans. Pattern Anal. Mach. Intell., 22 (2000), pp. 888–905. ITPIDJ 0162-8828 CrossrefISIGoogle Scholar

  • [33]  Google Scholar

  • [34]  Google Scholar

Keywords

Previous article
Next article