Time-Scale Separation from Diffusion-Mapped Delay Coordinates
Abstract
It has long been known that the method of time-delay embedding can be used to reconstruct nonlinear dynamics from time series data. A less-appreciated fact is that the induced geometry of time-delay coordinates increasingly biases the reconstruction toward the stable directions as delays are added. This bias can be exploited, using the diffusion maps approach to dimension reduction, to extract dynamics on desired time scales from high-dimensional observed data. We demonstrate the technique on a wide range of examples, including data generated by a model of meandering spiral waves and video recordings of a liquid-crystal experiment.
Keywords
MSC codes
Get full access to this article
View all available purchase options and get full access to this article.
Supplementary Material
References
1.
D. Aeyels, Generic observability of differentiable systems, SIAM J. Control Optim., 19 (1981), pp. 595--603.
2.
L. Arnold, Random Dynamical Systems, Springer-Verlag, New York, 1998.
3.
D. Barkley, Spiral meandering, in Chemical Waves and Patterns, R. Kapral and K. Showalter, eds., Springer-Verlag, New York, 1995, pp. 163--190.
4.
D. Barkley and I. G. Kevrekidis, A dynamical systems approach to spiral-wave dynamics, Chaos, 4 (1994), pp. 453--460.
5.
D. S. Broomhead and G. P. King, Extracting qualitative dynamics from experimental data, Phys. D, 20 (1986), pp. 217--236.
6.
R. Coifman, R. Erban, A. Singer, and I. Kevrekidis, Detecting intrinsic slow variables in stochastic dynamical systems by anisotropic diffusion maps, Proc. Natl. Acad. Sci. USA, 106 (2009), pp. 16090--16095.
7.
R. Coifman and S. Lafon, Diffusion maps, Appl. Comput. Harmonic Anal., 21 (2006), pp. 5--30.
8.
R. R. Coifman, I. G. Kevrekidis, S. Lafon, M. Maggioni, and B. Nadler, Diffusion maps, reduction coordinates, and low dimensional representation of stochastic systems, Multiscale Model. Simul., 7 (2008), pp. 842--864.
9.
R. Coifman, S. Lafon, B. Nadler, and I. Kevrekidis, Diffusion maps, spectral clustering and reaction coordinates of dynamical systems, Appl. Comput. Harmonic Anal., 21 (2006), pp. 113--127.
10.
R. Coifman and M. Maggioni, Diffusion wavelets, Appl. Comput. Harmonic Anal., 21 (2006), pp. 53--94.
11.
G. Dangelmayr, G. Acharya, J. Gleeson, I. Oprea, and J. Ladd, Diagnosis of spatiotemporal chaos in wave-envelopes of a nematic electroconvection pattern, Phys. Rev. E, 79 (2009), pp. 46215--46235.
12.
M. Dennin, D. S. Cannell, and G. Ahlers, Patterns of electroconvection in a nematic liquid crystal, Phys. Rev. E, 57 (1998), pp. 638--649.
13.
M. Desroches, J. Guckenheimer, B. Krauskopf, C. Kuehn, H. M. Osinga, and M. Wechselberger, Mixed-mode oscillations with multiple time scales, SIAM Rev., 54 (2012), pp. 211--288.
14.
J.-P. Eckmann and D. Ruelle, Ergodic theory of chaos and strange attractors, Rev. Modern Phys., 57 (1985), pp. 617--656.
15.
D. Egolf, I. Melnikov, W. Pesche, and R. Ecke, Mechanisms of extensive spatiotemporal chaos in Raleigh-Bénard convection, Nature, 404 (2000), pp. 733--736.
16.
V. Garcia, E. Debreuve, and M. Barlaud, Fast k-nearest neighbor search using GPU, in Proceedings of the CVPR Workshop on Computer Vision on GPU, Anchorage, AK, 2008.
17.
C. W. Gear, T. J. Kaper, I. G. Kevrekidis, and A. Zagaris, Projecting to a slow manifold: Singularly perturbed systems and legacy codes, SIAM J. Appl. Dyn. Syst., 4 (2005), pp. 711--732.
18.
P. G. De Gennes and J. Prost, The Physics of Liquid Crystals, Clarendon Press, Oxford, UK, 1993.
19.
D. Giannakis and A. J. Majda, Nonlinear Laplacian spectral analysis for time series with intermittency and low-frequency variability, Proc. Natl. Acad. Sci. USA, 109 (2012), pp. 2222--2227.
20.
J. Jost, Riemannian Geometry and Geometric Analysis, Springer-Verlag, Berlin, 2002.
21.
J. A. Lee and M. Verleysen, Nonlinear Dimensionality Reduction, Springer-Verlag, New York, 2007.
22.
V. I. Oseledets, A multiplicative ergodic theorem, Trans. Moscow Math. Soc., 19 (1968), pp. 197--231.
23.
N. H. Packard, J. P. Crutchfield, J. D. Farmer, and R. S. Shaw, Geometry from a time series, Phys. Rev. Lett., 45 (1980), pp. 712--716.
24.
Y. B. Pesin, Families of invariant manifolds corresponding to nonzero characteristic exponents, Math. USSR Izvestia, 10 (1976), pp. 1261--1305.
25.
T. Sauer, Time series prediction by using delay coordinate embedding, in Time Series Prediction: Forecasting the Future and Understanding the Past, A. S. Weigend and N. A. Gershenfeld, eds., Addison-Wesley, Harlow, UK, 1994, pp. 175--193.
26.
T. Sauer, J. A. Yorke, and M. Casdagli, Embedology, J. Statist. Phys., 65 (1991), pp. 579--616.
27.
A. Singer, From graph to manifold Laplacian: The convergence rate, Appl. Comput. Harmonic Anal., 21 (2006), pp. 128--134.
28.
A. Singer, R. Erban, I. G. Kevrekidis, and R. Coifman, Detecting intrinsic slow variables in stochastic dynamical systems by anisotropic diffusion maps, Proc. Natl. Acad. Sci. USA, 106 (2009), pp. 16090--16095.
29.
A. Singer and H.-T. Wu, Vector diffusion maps and the connection Laplacian, Comm. Pure Appl. Math., 65 (2012), pp. 1067--1144.
30.
J. Stark, Delay embeddings for forced systems. I. Deterministic forcing, J. Nonlinear Sci., 9 (1999), pp. 255--332.
31.
J. Stark, D. S. Broomhead, M. E. Davies, and J. Huke, Delay embeddings for forced systems. II. Stochastic forcing, J. Nonlinear Sci., 13 (2003), pp. 519--577.
32.
F. Takens, Detecting strange attractors in turbulence, in Dynamical Systems and Turbulence, D. Rand and L.-S. Young, eds., Lecture Notes in Math. 898, Springer, Berlin, Heidelberg, 1981, pp. 366--381.
33.
J. Tenenbaum, V. Silva, and J. Langford, A global geometric framework for nonlinear dimensionality reduction, Science, 290 (2000), pp. 2319--2324.
34.
T. Toh-Katona, J. R. Cressman, W. Golburg, and J. Gleeson, Persistent global power fluctuations near a dynamic transition in electroconvection, Phys. Rev. E, 68 (2003), 103010.
35.
A. Zagaris, H. G. Kaper, and T. J. Kaper, Two perspectives on reduction of ordinary differential equations, Math. Nachr., 278 (2005), pp. 1629--1642.
Information & Authors
Information
Published In
SIAM Journal on Applied Dynamical Systems
Pages: 618 - 649
DOI: 10.1137/12088183X
ISSN (online): 1536-0040
Copyright
© 2013, Society for Industrial and Applied Mathematics.
History
Submitted: 22 June 2012
Accepted: 20 February 2013
Published online: 30 April 2013
Keywords
MSC codes
Authors
Metrics & Citations
Metrics
Citations
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
Cited By
- Data-driven discovery of quasiperiodically driven dynamicsNonlinear Dynamics, Vol. 111 | 29 July 2024
- Conditional expectation using compactification operatorsApplied and Computational Harmonic Analysis, Vol. 71 | 1 Jul 2024
- Consistent spectral approximation of Koopman operators using resolvent compactificationNonlinearity, Vol. 37, No. 7 | 4 June 2024
- Transformations establishing equivalence across neural networks: When have two networks learned the same task?Chaos: An Interdisciplinary Journal of Nonlinear Science, Vol. 34, No. 7 | 18 July 2024
- Analysis of hippocampal local field potentials by diffusion mapped delay coordinatesJournal of Computational Neuroscience, Vol. 52, No. 2 | 6 April 2024
- Detecting Phase Transitions in Financial Market based on Manifold Learning2024 4th Asia Conference on Information Engineering (ACIE) | 26 Jan 2024
- Mitigating Model Error via a Multimodel Method and Application to Tropical Intraseasonal OscillationsSIAM Journal on Applied Dynamical Systems, Vol. 22, No. 4 | 3 November 2023
- Learning Theory for Dynamical SystemsSIAM Journal on Applied Dynamical Systems, Vol. 22, No. 3 | 8 August 2023
- Koopman-Theoretic Modeling of Quasiperiodically Driven Systems: Example of Signalized Traffic CorridorIEEE Transactions on Systems, Man, and Cybernetics: Systems, Vol. 53, No. 7 | 1 Jul 2023
- Koopman Operator Inspired Nonlinear System IdentificationSIAM Journal on Applied Dynamical Systems, Vol. 22, No. 2 | 26 June 2023
- Quantum process tomography of unitary maps from time-delayed measurementsQuantum Information Processing, Vol. 22, No. 6 | 22 June 2023
- Double Diffusion Maps and their Latent Harmonics for Scientific Computations in Latent SpaceJournal of Computational Physics | 1 Apr 2023
- Attractor-like dynamics extracted from human electrocorticographic recordings underlie computational principles of auditory bistable perceptionThe Journal of Neuroscience | 28 March 2023
- Inferring Pathways of Oxidative Folding from Prefolding Free Energy Landscapes of Disulfide-Rich ToxinsThe Journal of Physical Chemistry B, Vol. 127, No. 8 | 15 February 2023
- Learning effective stochastic differential equations from microscopic simulations: Linking stochastic numerics to deep learningChaos: An Interdisciplinary Journal of Nonlinear Science, Vol. 33, No. 2 | 15 February 2023
- Maximally predictive states: From partial observations to long timescalesChaos: An Interdisciplinary Journal of Nonlinear Science, Vol. 33, No. 2 | 21 February 2023
- Reweighted Manifold Learning of Collective Variables from Enhanced Sampling SimulationsJournal of Chemical Theory and Computation, Vol. 18, No. 12 | 11 November 2022
- Modeling Melburnians—Using the Koopman operator to gain insight into crowd dynamicsTransportation Research Part C: Emerging Technologies, Vol. 133 | 1 Dec 2021
- Initializing LSTM internal states via manifold learningChaos: An Interdisciplinary Journal of Nonlinear Science, Vol. 31, No. 9 | 14 September 2021
- Learning forecasts of rare stratospheric transitions from short simulationsMonthly Weather Review, Vol. 20 | 31 Aug 2021
- A novel composite forecasting framework by adaptive data preprocessing and optimized nonlinear grey Bernoulli model for new energy vehicles salesCommunications in Nonlinear Science and Numerical Simulation, Vol. 12 | 1 Apr 2021
- Delay-coordinate maps, coherence, and approximate spectra of evolution operatorsResearch in the Mathematical Sciences, Vol. 8, No. 1 | 28 January 2021
- Data-driven model reduction, Wiener projections, and the Koopman-Mori-Zwanzig formalismJournal of Computational Physics, Vol. 424 | 1 Jan 2021
- Operator-theoretic framework for forecasting nonlinear time series with kernel analog techniquesPhysica D: Nonlinear Phenomena, Vol. 409 | 1 Aug 2020
- Machine learning for collective variable discovery and enhanced sampling in biomolecular simulationMolecular Physics, Vol. 118, No. 5 | 10 March 2020
- On the automatic parameter selection for permutation entropyChaos: An Interdisciplinary Journal of Nonlinear Science, Vol. 30, No. 3 | 19 March 2020
- Spatiotemporal Pattern Extraction by Spectral Analysis of Vector-Valued ObservablesJournal of Nonlinear Science, Vol. 29, No. 5 | 13 May 2019
- Data-driven spectral decomposition and forecasting of ergodic dynamical systemsApplied and Computational Harmonic Analysis, Vol. 47, No. 2 | 1 Sep 2019
- Galerkin approximation of dynamical quantities using trajectory dataThe Journal of Chemical Physics, Vol. 150, No. 24 | 26 June 2019
- Delay-Coordinate Maps and the Spectra of Koopman OperatorsJournal of Statistical Physics, Vol. 175, No. 6 | 2 April 2019
- Comparative analysis of properties of weakening buffer operators in time series prediction modelsCommunications in Nonlinear Science and Numerical Simulation, Vol. 68 | 1 Mar 2019
- Recovery of Protein Folding Funnels from Single-Molecule Time Series by Delay Embeddings and Manifold LearningThe Journal of Physical Chemistry B, Vol. 122, No. 50 | 14 November 2018
- Koopman analysis of the long-term evolution in a turbulent convection cellJournal of Fluid Mechanics, Vol. 847 | 29 May 2018
- Parsimonious representation of nonlinear dynamical systems through manifold learning: A chemotaxis case studyApplied and Computational Harmonic Analysis, Vol. 44, No. 3 | 1 May 2018
- Indo-Pacific Variability on Seasonal to Multidecadal Time Scales. Part II: Multiscale Atmosphere–Ocean LinkagesJournal of Climate, Vol. 31, No. 2 | 1 Jan 2018
- Extraction and prediction of indices for monsoon intraseasonal oscillations: an approach based on nonlinear Laplacian spectral analysisClimate Dynamics, Vol. 49, No. 9-10 | 12 January 2017
- Dimensionless embedding for nonlinear time series analysisPhysical Review E, Vol. 96, No. 3 | 19 September 2017
- Indo-Pacific Variability on Seasonal to Multidecadal Time Scales. Part I: Intrinsic SST Modes in Models and ObservationsJournal of Climate, Vol. 30, No. 14 | 1 Jul 2017
- Kernel Analog Forecasting of Tropical Intraseasonal OscillationsJournal of the Atmospheric Sciences, Vol. 74, No. 4 | 5 April 2017
- Data-driven prediction strategies for low-frequency patterns of North Pacific climate variabilityClimate Dynamics, Vol. 48, No. 5-6 | 27 May 2016
- Higher Order Dynamic Mode DecompositionSIAM Journal on Applied Dynamical Systems, Vol. 16, No. 2 | 9 May 2017
- Machine learning for autonomous crystal structure identificationSoft Matter, Vol. 13, No. 27 | 1 January 2017
- Method for reconstructing nonlinear modes with adaptive structure from multidimensional dataChaos: An Interdisciplinary Journal of Nonlinear Science, Vol. 26, No. 12 | 1 December 2016
- Analog forecasting with dynamics-adapted kernelsNonlinearity, Vol. 29, No. 9 | 12 August 2016
- Nonlinear Laplacian spectral analysis of Rayleigh–Bénard convectionJournal of Computational Physics, Vol. 315 | 1 Jun 2016
- Local kernels and the geometric structure of dataApplied and Computational Harmonic Analysis, Vol. 40, No. 3 | 1 May 2016
- Dynamics from noisy data with extreme timing uncertaintyNature, Vol. 532, No. 7600 | 27 April 2016
- Extensions to a manifold learning framework for time-series analysis on dynamic manifolds in bioelectric signalsPhysical Review E, Vol. 93, No. 4 | 29 April 2016
- Forecasting turbulent modes with nonparametric diffusion models: Learning from noisy dataPhysica D: Nonlinear Phenomena, Vol. 320 | 1 Apr 2016
- Extraction and predictability of coherent intraseasonal signals in infrared brightness temperature dataClimate Dynamics, Vol. 46, No. 5-6 | 29 May 2015
- Semiparametric modeling: Correcting low-dimensional model error in parametric modelsJournal of Computational Physics, Vol. 308 | 1 Mar 2016
- Nonlinear reconstruction of single-molecule free-energy surfaces from univariate time seriesPhysical Review E, Vol. 93, No. 3 | 21 March 2016
- Data-Driven Reduction for a Class of Multiscale Fast-Slow Stochastic Dynamical SystemsSIAM Journal on Applied Dynamical Systems, Vol. 15, No. 3 | 7 July 2016
- Numerical Model Construction with Closed ObservablesSIAM Journal on Applied Dynamical Systems, Vol. 15, No. 4 | 1 November 2016
- Variable bandwidth diffusion kernelsApplied and Computational Harmonic Analysis, Vol. 40, No. 1 | 1 Jan 2016
- Parsimonious description for predicting high-dimensional dynamicsScientific Reports, Vol. 5, No. 1 | 29 October 2015
- Sea‐ice reemergence in a model hierarchyGeophysical Research Letters, Vol. 42, No. 13 | 3 July 2015
- Arctic Sea Ice Reemergence: The Role of Large-Scale Oceanic and Atmospheric Variability*Journal of Climate, Vol. 28, No. 14 | 13 July 2015
- Combined delay and graph embedding of epileptic discharges in EEG reveals complex and recurrent nonlinear dynamics2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI) | 1 Apr 2015
- Data‐Driven Methods for Dynamical SystemsMathematical and Computational Modeling | 8 May 2015
- Machine learning of single molecule free energy surfaces and the impact of chemistry and environment upon structure and dynamicsThe Journal of Chemical Physics, Vol. 142, No. 10 | 12 March 2015
- Nonparametric forecasting of low-dimensional dynamical systemsPhysical Review E, Vol. 91, No. 3 | 19 March 2015
- Dynamics-Adapted Cone KernelsSIAM Journal on Applied Dynamical Systems, Vol. 14, No. 2 | 14 April 2015
- Computing ManifoldsMultiple Time Scale Dynamics | 11 November 2014
- Kernel and Information-Theoretic Methods for the Extraction and Predictability of Organized Tropical ConvectionMachine Learning and Data Mining Approaches to Climate Science | 1 Jan 2015
- Mathematical Methods for Large Geophysical Data SetsEncyclopedia of Applied and Computational Mathematics | 21 November 2015
- Coarse-grained particle model for pedestrian flow using diffusion mapsPhysical Review E, Vol. 89, No. 1 | 14 January 2014
View Options
- Access via your Institution
- Questions about how to access this content? Contact SIAM at [email protected].