# Covariance Matrix Estimation for the Cryo-EM Heterogeneity Problem

## Abstract

### Keywords

### MSC codes

## Get full access to this article

View all available purchase options and get full access to this article.

## References

*Structure of the yeast mitochondrial large ribosomal subunit*, Science, 343 (2014), pp. 1485--1489.

*Operational and convolution properties of three dimensional Fourier transforms in spherical polar coordinates*, J. Opt. Soc. Amer. A, 27 (2010), pp. 2144--2155.

*Ribosome structures to near-atomic resolution from thirty thousand cryo-em particles*, eLife, 2:e00461, 2013.

*Phase transition of the largest eigenvalue for nonnull complex sample covariance matrices*, Ann. Probab., 33 (2005), pp. 1643--1697.

*Eigenvalues of large sample covariance matrices of spiked population models*, J. Multivariate Anal., 97 (2006), pp. 1382--1408.

*The Netflix prize*, in the 13th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Jose, CA, ACM, New York, 2007.

*Covariance regularization by thresholding*, Ann. Statist., 36 (2008), pp. 2577--2604.

*Pattern Recognition and Machine Learning*, Inf. Sci. Statist., Springer-Verlag, New York, 2006.

*Matrix completion with noise*, Proc. IEEE, 98 (2010), pp. 925--936.

*Maximum likelihood from incomplete data via the EM algorithm*, J. R. Stat. Soc. Ser. B Stat. Methodol., 39 (1977), pp. 1--38.

*High-dimensional data analysis: The curses and blessings of dimensionality*, in Math Challenges of the 21st Century, Los Angeles, 2000.

*Three-Dimensional Electron Microscopy of Macromolecular Assemblies: Visualization of Biological Molecules in Their Native State*, Oxford, Oxford University Press, 2006.

*Exploring the Dynamics of Supramolecular Machines with Cryo-Electron Microscopy*, Proceedings of the 23rd International Solvay Conference on Chemistry, International Solvay Institutes, Brussels, 2013.

*Story in a sample -- the potential (and limitations) of cryo-electron microscopy applied to molecular machines*, Biopolymers, 99 (2013), pp. 832--836.

*Realizing the potential of electron cryo-microscopy*, Quart. Rev. Biophys., 37 (2004), pp. 3--13.

*Classification of heterogeneous electron microscopic projections into homogeneous subsets*, Ultramicroscopy, 108 (2008), pp. 327--338.

*Complex-valued matrix differentiation: Techniques and key results*, IEEE Trans. Signal Process., 55 (2007), pp. 2740--2746.

*Practical approaches to principal component analysis in the presence of missing values*, J. Mach. Learn. Res., 11 (2010), pp. 1957--2000.

*Low-rank matrix completion using alternating minimization*, in Proceedings of the Forty-Fifth Annual ACM Symposium on Theory of Computing, STOC '13, ACM, New York, 2013, pp. 665--674.

*Iterative elastic 3D-to-2D alignment method using normal modes for studying structural dynamics of large macromolecular complexes*, Structure, 22 (2014), pp. 496--506.

*On the distribution of the largest eigenvalue in principal components analysis*, Ann. Statist., 29 (2001), pp. 295--327.

*On consistency and sparsity for principal components analysis in high dimensions*, J. Amer. Statist. Assoc., 104 (2009), pp. 682--693.

*Disentangling Gaussians*, Commun. ACM, 55 (2012), pp. 113--120.

*The resolution revolution*, Science, 343 (2014), pp. 1443--1444.

*A collaborative framework for $3$D alignment and classification of heterogeneous subvolumes in cryo-electron tomography*, J. Struct. Biol., 181 (2013), pp. 116--127.

*Efficient matrix completion with Gaussian models*, in IEEE 2011 International Conference on Acoustics, Speech and Signal Processing (ICASSP), IEEE, Piscataway, NJ, 2011, pp. 1113--1116.

*Electron counting and beam-induced motion correction enable near-atomic-resolution single-particle cryo-em*, Nature Methods, 10 (2013), pp. 584--590.

*Classification by bootstrapping in single particle methods*, Proceedings of the 2010 IEEE International Conference on Biomedical Imaging: From Nano to Macro, IEEE, Piscataway, NJ, 2010, pp. 169--172.

*Structure of the TRPV1 ion channel determined by electron cryo-microscopy*, Nature, 504 (2013), pp. 107--124.

*Statistical Analysis with Missing Data*, 2nd ed., Wiley Ser. Probab. Stat., John Wiley, Hoboken, NJ, 2002.

*High-dimensional regression with noisy and missing data: Provable guarantees with nonconvexity*, Ann. Statist., 40 (2012), pp. 1637--1664.

*High-dimensional covariance matrix estimation with missing observations*, Bernoulli, 20 (2014), pp. 1029--1058.

*De novo backbone trace of GroEL from single particle electron cryomicroscopy*, Structure, 16 (2008), pp. 441--448.

*Distribution of eigenvalues of some sets of random matrices*, Math. USSR Sb., 1 (1967), pp. 507--536.

*A guide to rotations in quantum mechanics*, Aust. J. Phys., 40 (1987), pp. 465--497.

*Finite sample approximation results for principal component analysis: A matrix perturbation approach*, Ann. Statist., 36 (2008), pp. 2791--2817.

*The Mathematics of Computerized Tomography*, Classics Appl. Math., SIAM, Philadelphia, 2001.

*An algorithm for the rapid evaluation of special function transforms*, Appl. Comput. Harmon. Anal., 28 (2010), pp. 203--226.

*On lines and planes of closest fit to systems of points in space*, Philos. Mag., 2 (1901), pp. 559--572.

*Variance in three-dimensional reconstructions from projections*, in Proceedings of the 2002 IEEE International Symposium on Biomedical Imaging, M. Unser and Z. P. Liang, eds., IEEE, Piscataway, NJ, 2002, pp. 749--752.

*Estimation of variance in single-particle reconstruction using the bootstrap technique*, J. Struct. Biol., 154 (2006), pp. 168--183.

*Identifying conformational states of macromolecules by eigen-analysis of resampled cryo-EM images*, Structure, 19 (2011), pp. 1582--1590.

*Gridding-based direct Fourier inversion of the three-dimensional ray transform*, J. Opt. Soc. Amer. A, 21 (2004), pp. 499--509.

*Integrals and Series: Special Functions*, Gordon and Breach, Amsterdam, 1983.

*Guaranteed minimum-rank solutions of linear matrix equations via nuclear norm minimization*, SIAM Rev., 52 (2010), pp. 471--501.

*Random vectors in the isotropic position*, J. Funct. Anal., 164 (1999), pp. 60--72.

*The correlation averaging of a regularly arranged bacterial cell envelope protein*, J. Microscopy, 127 (1982), pp. 127--138.

*Relion: Implementation of a Bayesian approach to cryo-EM structure determination*, J. Struct. Biol., 180 (2012), pp. 519--530.

*Maximum-likelihood methods in cryo-EM. Part II: Application to experimental data*, J. Struct. Biol., 181 (2013), pp. 195--206.

*Analysis of incomplete climate data: Estimation of mean values and covariance matrices and imputation of missing values*, J. Climate, 14 (2001), pp. 853--871.

*Automated multi-model reconstruction from single-particle electron microscopy data*, J. Struct. Biol., 170 (2010), pp. 98--108.

*Maximum-likelihood methods in cryo-EM. Part I: Theoretical basis and overview of existing approaches*, Methods Enzymology, 482 (2010), pp. 263--294.

*On the empirical distribution of eigenvalues of a class of large dimensional random matrices*, J. Multivariate Anal., 54 (1995), pp. 175--192.

*Three-dimensional structure determination from common lines in cryo-EM by eigenvectors and semidefinite programming*, SIAM J. Imag. Sci., 4 (2011), pp. 543--572.

*Prolate spheroidal wave functions, Fourier analysis and uncertainty -- IV: Extensions to many dimensions; generalized prolate spheroidal functions*, Bell System Tech. J., 43 (1964), pp. 3009--3057.

*Introduction to Fourier Analysis on Euclidean Spaces*, Princeton University Press, Princeton, NJ, 1971.

*Numerical Linear Algebra*, SIAM, Philadelphia, 1997.

*User-friendly tail bounds for sums of random matrices*, Found. Comput. Math., 12 (2012), pp. 389--434.

*Principles of Phase Contrast (Electron) Microscopy*, http://www.singleparticles.org/methodology/MvH_Phase_Contrast.pdf(2009).

*Single particle electron cryo-microscopy: Towards atomic resolution*, Quart. Rev. Biophys., 33 (2000), pp. 307--369.

*Introduction to the non-asymptotic analysis of random matrices*, in Compressed Sensing, Theory and Applications, Y. Eldar and G. Kutyniok, eds., Cambridge University Press, Cambridge, 2012, pp. 210--268.

*Cryo-EM and single particles*, Physiology (Bethesda), 21 (2006), pp. 13--18.

*Orientation determination of cryo-EM images using least unsquared deviations*, SIAM J. Imag. Sci., 6 (2013), pp. 2450--2483.

*Dynamics in cryo EM reconstructions visualized with maximum-likelihood derived variance maps*, J. Struct. Biol., 181 (2013), pp. 195--206.

*Moments and distributions of estimates of population parameters from fragmentary samples*, Ann. Math. Statist., 3 (1932), pp. 163--195.

*Heterogeneity of large macromolecular complexes revealed by $3$d cryo-em variance analysis*, Structure, 16 (2008), pp. 1770--1776.

*Near-atomic resolution using electron cryomicroscopy and single-particle reconstruction*, Proc. Natl. Acad. Sci. USA, 105 (2008), pp. 1867--1872.

*Fourier-Bessel rotational invariant eigenimages*, J. Opt. Soc. Amer. A, 30 (2013), pp. 871--877.

*Rotationally invariant image representation for viewing direction classification in cryo-EM*, J. Struct. Biol., 186 (2014), pp. 153--166.

## Information & Authors

### Information

#### Published In

#### Copyright

#### History

**Submitted**: 3 September 2013

**Accepted**: 22 September 2014

**Published online**: 22 January 2015

#### Keywords

#### MSC codes

### Authors

## Metrics & Citations

### Metrics

### Citations

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

#### Cited By

- Single-particle reconstruction in cryo-EM based on three-dimensional weighted nuclear norm minimizationPattern Recognition, Vol. 143 | 1 Nov 2023
- Conformational heterogeneity and probability distributions from single-particle cryo-electron microscopyCurrent Opinion in Structural Biology, Vol. 81 | 1 Aug 2023
- Spectral decomposition of atomic structures in heterogeneous cryo-EMInverse Problems, Vol. 39, No. 3 | 30 January 2023
- Methods for Cryo-EM Single Particle Reconstruction of Macromolecules Having Continuous HeterogeneityJournal of Molecular Biology, Vol. 37 | 1 Feb 2023
- MDSPACE: Extracting Continuous Conformational Landscapes from Cryo-EM Single Particle Datasets Using 3D-to-2D Flexible Fitting based on Molecular Dynamics SimulationJournal of Molecular Biology, Vol. 111 | 1 Jan 2023
- Gaussian Patch Mixture Model Guided Low-Rank Covariance Matrix Minimization for Image DenoisingSIAM Journal on Imaging Sciences, Vol. 15, No. 4 | 6 October 2022
- Deep generative modeling for volume reconstruction in cryo-electron microscopyJournal of Structural Biology, Vol. 214, No. 4 | 1 Dec 2022
- Visualizing Conformational Space of Functional Biomolecular Complexes by Deep Manifold LearningInternational Journal of Molecular Sciences, Vol. 23, No. 16 | 9 August 2022
- Emerging Themes in CryoEM─Single Particle Analysis Image ProcessingChemical Reviews, Vol. 579 | 4 July 2022
- Perturbation theory for cross data matrix-based PCAJournal of Multivariate Analysis, Vol. 190 | 1 Jul 2022
- Computed Origami TomographySIAM Review, Vol. 64, No. 2 | 5 May 2022
- Data-driven determination of number of discrete conformations in single-particle cryo-EMComputer Methods and Programs in Biomedicine, Vol. 6 | 1 May 2022
- Machine Learning for Structure Determination in Single-Particle Cryo-Electron Microscopy: A Systematic ReviewIEEE Transactions on Neural Networks and Learning Systems, Vol. 33, No. 2 | 1 Feb 2022
- Refinement of AlphaFold2 models against experimental and hybrid cryo-EM density mapsQRB Discovery, Vol. 3 | 20 September 2022
- TomoFlow: Analysis of Continuous Conformational Variability of Macromolecules in Cryogenic Subtomograms based on 3D Dense Optical FlowJournal of Molecular Biology, Vol. 434, No. 2 | 1 Jan 2022
- A Bayesian approach to extracting free-energy profiles from cryo-electron microscopy experimentsScientific Reports, Vol. 11, No. 1 | 1 July 2021
- Principal component analysis is limited to low-resolution analysis in cryoEMActa Crystallographica Section D Structural Biology, Vol. 77, No. 6 | 19 May 2021
- A representation theory perspective on simultaneous alignment and classificationApplied and Computational Harmonic Analysis, Vol. 49, No. 3 | 1 Nov 2020
- Representation and reconstruction of covariance operators in linear inverse problemsInverse Problems, Vol. 36, No. 8 | 20 August 2020
- Computational Methods for Single-Particle Electron CryomicroscopyAnnual Review of Biomedical Data Science, Vol. 3, No. 1 | 20 Jul 2020
- Cryo-EM reconstruction of continuous heterogeneity by Laplacian spectral volumesInverse Problems, Vol. 36, No. 2 | 28 January 2020
- Optimal prediction in the linearly transformed spiked modelThe Annals of Statistics, Vol. 48, No. 1 | 1 Feb 2020
- Separating distinct structures of multiple macromolecular assemblies from cryo-EM projectionsJournal of Structural Biology, Vol. 209, No. 1 | 1 Jan 2020
- Hybrid Electron Microscopy Normal Mode Analysis with ScipionProtein Science, Vol. 29, No. 1 | 20 November 2019
- Reconstruction of Stochastic 3D Signals With Symmetric Statistics From 2D Projection Images Motivated by Cryo-Electron MicroscopyIEEE Transactions on Image Processing, Vol. 28, No. 11 | 1 Nov 2019
- A max-cut approach to heterogeneity in cryo-electron microscopyJournal of Mathematical Analysis and Applications, Vol. 479, No. 1 | 1 Nov 2019
- Survey of the analysis of continuous conformational variability of biological macromolecules by electron microscopyActa Crystallographica Section F Structural Biology Communications, Vol. 75, No. 1 | 1 January 2019
- Advances in image processing for single-particle analysis by electron cryomicroscopy and challenges aheadCurrent Opinion in Structural Biology, Vol. 52 | 1 Oct 2018
- Allosteric effects in bacteriophage HK97 procapsids revealed directly from covariance analysis of cryo EM dataJournal of Structural Biology, Vol. 202, No. 2 | 1 May 2018
- Heterogeneous multireference alignment: A single pass approach2018 52nd Annual Conference on Information Sciences and Systems (CISS) | 1 Mar 2018
- Structural Variability from Noisy Tomographic ProjectionsSIAM Journal on Imaging Sciences, Vol. 11, No. 2 | 31 May 2018
- Massively parallel unsupervised single-particle cryo-EM data clustering via statistical manifold learningPLOS ONE, Vol. 12, No. 8 | 7 August 2017
- Particle segmentation algorithm for flexible single particle reconstructionBiophysics Reports, Vol. 3, No. 1-3 | 19 May 2017
- Computational methods for analyzing conformational variability of macromolecular complexes from cryo-electron microscopy imagesCurrent Opinion in Structural Biology, Vol. 43 | 1 Apr 2017
- Structural Study of Heterogeneous Biological Samples by Cryoelectron Microscopy and Image ProcessingBioMed Research International, Vol. 2017 | 1 Jan 2017
- 3-D understanding of electron microscopy images of nano bio objects by computing generative mechanical models2016 IEEE International Conference on Image Processing (ICIP) | 1 Sep 2016
- Denoising and covariance estimation of single particle cryo-EM imagesJournal of Structural Biology, Vol. 195, No. 1 | 1 Jul 2016
- StructMap: Elastic Distance Analysis of Electron Microscopy Maps for Studying Conformational ChangesBiophysical Journal, Vol. 110, No. 8 | 1 Apr 2016
- Effect of the viral protease on the dynamics of bacteriophage HK97 maturation intermediates characterized by variance analysis of cryo EM particle ensemblesJournal of Structural Biology, Vol. 193, No. 3 | 1 Mar 2016
- Principles of cryo-EM single-particle image processingMicroscopy, Vol. 65, No. 1 | 24 December 2015
- Cryo-electron Microscopy Analysis of Structurally Heterogeneous Macromolecular ComplexesComputational and Structural Biotechnology Journal, Vol. 14 | 1 Jan 2016
- Versatility of Approximating Single-Particle Electron Microscopy Density Maps Using Pseudoatoms and Approximation-Accuracy ControlBioMed Research International, Vol. 2016 | 1 Jan 2016
- Directly reconstructing principal components of heterogeneous particles from cryo-EM imagesJournal of Structural Biology, Vol. 191, No. 2 | 1 Aug 2015
- Efficient Estimation of Three-Dimensional Covariance and its Application in the Analysis of Heterogeneous Samples in Cryo-Electron MicroscopyStructure, Vol. 23, No. 6 | 1 Jun 2015
- Covariance estimation using conjugate gradient for 3D classification in CRYO-EM2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI) | 1 Apr 2015