Proximal Heterogeneous Block Implicit-Explicit Method and Application to Blind Ptychographic Diffraction Imaging
Abstract
We propose a general alternating minimization algorithm for nonconvex optimization problems with separable structure and nonconvex coupling between blocks of variables. To fix our ideas, we apply the methodology to the problem of blind ptychographic imaging. Compared to other schemes in the literature, our approach differs in two ways: (i) it is posed within a clear mathematical framework with practical verifiable assumptions, and (ii) under the given assumptions, it is provably convergent to critical points. A numerical comparison of our proposed algorithm with the current state of the art on simulated and experimental data validates our approach and points toward directions for further improvement.
Keywords
MSC codes
Get full access to this article
View all available purchase options and get full access to this article.
References
1.
F. Abboud, E. Chouzenoux, J.-C. Pesquet, J.-H. Chenot, and L. Laborelli, A hybrid alternating proximal method for blind video restoration, in 2014 Proceedings of the 22nd European Signal Processing Conference (EUSIPCO), Lisbon, Portugal, IEEE, Piscataway, NJ, 2014, pp. 1811--1815.
2.
H. Attouch and J. Bolte, On the convergence of the proximal algorithm for nonsmooth functions involving analytic features, Math. Program., 116 (2009), pp. 5--16.
3.
H. Attouch, J. Bolte, P. Redont, and A. Soubeyran, Proximal alternating minimization and projection methods for nonconvex problems: An approach based on the Kurdyka--Łojasiewicz inequality, Math. Oper. Res., 35 (2010), pp. 438--457.
4.
H. Attouch, J. Bolte, and B. F. Svaiter, Convergence of descent methods for semi-algebraic and tame problems: Proximal algorithms, forward-backward splitting, and regularized Gauss--Seidel methods, Math. Program., 137 (2013), pp. 91--129.
5.
H. H. Bauschke, P. L. Combettes, and D. R. Luke, Finding best approximation pairs relative to two closed convex sets in Hilbert spaces, J. Approx. Theory, 127 (2004), pp. 178--192.
6.
A. Beck and M. Teboulle, A fast iterative shrinkage-thresholding algorithm for linear inverse problems, SIAM J. Imaging Sci., 2 (2009), pp. 183--202.
7.
T. Blumensath and M. Davies, Iterative hard thresholding for compressed sensing, Appl. Comput. Harmon. Anal., 27 (2009), pp. 265--274.
8.
T. Blumensath and M. Davies, Normalised iterative hard thresholding; guaranteed stability and performance, IEEE J. Sel. Top. Signal Process., 4 (2010), pp. 298--309.
9.
J. Bolte, A. Daniilidis, and A. Lewis, The Łojasiewicz inequality for nonsmooth subanalytic functions with applications to subgradient dynamical systems, SIAM J. Optim., 17 (2007), pp. 1205--1223.
10.
J. Bolte, A. Daniilidis, A. Lewis, and M. Shiota, Clarke subgradients of stratifiable functions, SIAM J. Optim., 18 (2007), pp. 556--572.
11.
J. Bolte, S. Sabach, and M. Teboulle, Proximal alternating linearized minimization for nonconvex and nonsmooth problems, Math. Program., 146 (2014), pp. 459--494.
12.
E. Chouzenoux, J.-C. Pesquet, and A. Repetti, A Block Coordinate Variable Metric Forward-Backward Algorithm, http://www.optimization-online.org/DB_HTML/2013/12/4178.html (2013).
13.
P. L. Combettes and V. R. Wajs, Signal recovery by proximal forward-backward splitting, Multiscale Model. Simul., 4 (2005), pp. 1168--1200.
14.
J. Douglas and H. H. Rachford, On the numerical solution of heat conduction problems in two or three space variables. Trans. Amer. Math. Soc., 82 (1956), pp. 421--439.
15.
J. R. Fienup, Phase retrieval algorithms: A comparison, Appl. Opt., 21 (1982), pp. 2758--2769.
16.
P. Frankel, G. Garrigos, and J. Peypouquet, Splitting methods with variable metric for Kurdyka--Łojasiewicz functions and general convergence rates, J. Optim. Theory Appl., to appear.
17.
R. W. Gerchberg and W. O. Saxton, A practical algorithm for the determination of phase from image and diffraction plane pictures, Optik, 35 (1972), pp. 237--246.
18.
R. A. Gonsalves, Phase retrieval and diversity in adaptive optics, Opt. Eng., 21 (1982), pp. 829--832.
19.
M. Guizar-Sicairos, S. T. Thurman, and J. R. Fienup, Efficient subpixel image registration algorithms, Opt. Lett., 33 (2008), pp. 156--158.
20.
J. Hagemann, A.-L. Robisch, D. R. Luke, C. Homann, T. Hohage, P. Cloetens, H. Suhonen, and T. Salditt, Reconstruction of wave front and object for inline holography from a set of detection planes, Opt. Express, 22 (2014), pp. 11552--11569.
21.
R. Hesse, D. R. Luke, and P. Neumann, Alternating projections and Douglas--Rachford for sparse affine feasibility, IEEE Trans. Signal Process., 62 (2014), pp. 4868--4881.
22.
R. Hegerl and W. Hoppe, Dynamische theorie der kristallstrukturanalyse durch elektronenbeugung im inhomogenen primärstrahlwellenfeld, Ber. Bunsenges. Phys. Chem, 74 (1970), pp. 1148--1154.
23.
P. L. Lions and B. Mercier, Splitting algorithms for the sum of two nonlinear operators, SIAM J. Numer. Anal., 16 (1979), pp. 964--979.
24.
D. R. Luke, Finding best approximation pairs relative to a convex and a prox-regular set in a Hilbert space, SIAM J. Optim., 19 (2008), pp. 714--739.
25.
D. R. Luke, J. V. Burke, and R. G. Lyon, Optical wavefront reconstruction: Theory and numerical methods, SIAM Rev., 44 (2002), pp. 169--224.
26.
D. R. Luke, Relaxed averaged alternating reflections for diffraction imaging, Inverse Problems, 21 (2005), pp. 37--50.
27.
A. M. Maiden and J. M. Rodenburg, An improved ptychographical phase retrieval algorithm for diffractive imaging, Ultramicroscopy, 109 (2009), pp. 1256--1262.
28.
P. Mattsson, Projection Methods in Ptychographic Imaging, Masters Thesis, Georg-August-Universität, Göttingen, 2013.
29.
L. Meyer, Blocking Strategies for Large-Scale Split Feasibility, Masters Thesis, Georg-August-Universität, Göttingen, 2014.
30.
J. Qian, C. Yang, A. Schirotzek, F. Maia, and S. Marchesini, Efficient algorithms for ptychographic phase retrieval, in Inverse Problems and Applications, Contemp. Math. 615, (2014), pp. 261--280.
31.
R. T. Rockafellar and R. J. Wets, Variational Analysis, Grundlehren Math. Wiss., Springer-Verlag, Berlin, 1998.
32.
J. M. Rodenburg, Ptychography and related diffractive imaging methods, Adv. Imaging Electron Phys., 150 (2008), pp. 87--184.
33.
J. M. Rodenburg and R. H. T. Bates, The theory of super-resolution electron microscopy via Wigner-distribution deconvolution, R. Soc. London Philos. Trans. Ser. A Math. Phys. Eng. Sci., 339 (1992), pp. 521--553.
34.
J. M. Rodenburg, A. C. Hurst, A. G. Cullis, B. R. Dobson, F. Pfeiffer, O. Bunk, C. David, K. Jefimovs, and I. Johnson, Hard-X-ray lensless imaging of extended objects, Phys. Rev. Lett., 98 (2007), 034801.
35.
Y. Shechtman, Y. C. Eldar, O. Cohen, H. N. Chapman, J. Miao, and M. Segev, Phase retrieval with application to optical imaging, IEEE Signal Process. Magazine, to appear.
36.
P. Thibault, M. Dierolf, O. Bunk, A. Menzel, and F. Pfeiffer, Probe retrieval in ptychographic coherent diffractive imaging, Ultramicroscopy, 109 (2009), pp. 338--343.
37.
R. N. Wilke, M. Priebe, M. Bartels, K. Giewekemeyer, A. Diaz, P. Karvinen, and T. Salditt, Hard X-ray imaging of bacterial cells: Nano-diffraction and ptychographic reconstruction, Opt. Express, 20 (2012), pp. 19232--19254.
Information & Authors
Information
Published In
Copyright
© 2015, Society for Industrial and Applied Mathematics.
History
Submitted: 11 August 2014
Accepted: 20 November 2014
Published online: 24 February 2015
Keywords
MSC codes
Authors
Metrics & Citations
Metrics
Citations
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
Cited By
- A semi-Bregman proximal alternating method for a class of nonconvex problems: local and global convergence analysisJournal of Global Optimization, Vol. 79 | 3 November 2023
- An adaptive noise-blind-separation algorithm for ptychographyOptics and Lasers in Engineering, Vol. 169 | 1 Oct 2023
- Image Recovery for Blind Polychromatic PtychographySIAM Journal on Imaging Sciences, Vol. 16, No. 3 | 28 July 2023
- Convergent Nested Alternating Minimization Algorithms for Nonconvex Optimization ProblemsMathematics of Operations Research, Vol. 48, No. 1 | 1 Feb 2023
- Solving Blind Ptychography Effectively Via Linearized Alternating Direction Method of MultipliersJournal of Scientific Computing, Vol. 94, No. 1 | 16 December 2022
- Fast Iterative Algorithms for Blind Phase Retrieval: A SurveyHandbook of Mathematical Models and Algorithms in Computer Vision and Imaging | 25 February 2023
- Π-Net: A double-branch network framework for scanning coherent diffraction imagingDigital Signal Processing, Vol. 131 | 1 Nov 2022
- Batch-based alternating direction methods of multipliers for Fourier PtychographyOptics Express | 24 August 2022
- Fast Iterative Algorithms for Blind Phase Retrieval: A SurveyHandbook of Mathematical Models and Algorithms in Computer Vision and Imaging | 6 May 2022
- Ptychography-based high-throughput lensless on-chip microscopy via incremental proximal algorithmsOptics Express, Vol. 29, No. 23 | 29 October 2021
- Efficient ptychographic phase retrieval via a matrix-free Levenberg-Marquardt algorithmOptics Express, Vol. 29, No. 15 | 7 July 2021
- Overlapping Domain Decomposition Methods for Ptychographic ImagingSIAM Journal on Scientific Computing, Vol. 43, No. 3 | 10 May 2021
- Iterative X-ray spectroscopic ptychographyJournal of Applied Crystallography, Vol. 53, No. 4 | 8 July 2020
- Blind ptychography: uniqueness and ambiguitiesInverse Problems, Vol. 36, No. 4 | 26 February 2020
- Ptychographic phase retrieval by proximal algorithmsNew Journal of Physics, Vol. 22, No. 2 | 27 February 2020
- Multigrid Optimization for Large-Scale Ptychographic Phase RetrievalSIAM Journal on Imaging Sciences, Vol. 13, No. 1 | 19 February 2020
- Fixed Point Analysis of Douglas--Rachford Splitting for Ptychography and Phase RetrievalSIAM Journal on Imaging Sciences, Vol. 13, No. 2 | 27 April 2020
- Efficient, Quantitative Numerical Methods for Statistical Image Deconvolution and DenoisingNanoscale Photonic Imaging | 10 June 2020
- Convergence Analysis of Iterative Algorithms for Phase RetrievalNanoscale Photonic Imaging | 10 June 2020
- Proximal Methods for Image ProcessingNanoscale Photonic Imaging | 10 June 2020
- Semi-implicit relaxed Douglas-Rachford algorithm (sDR) for ptychographyOptics Express, Vol. 27, No. 22 | 14 October 2019
- 3D Phaseless Imaging at Nano-scale: Challenges and Possible Solutions2019 13th International conference on Sampling Theory and Applications (SampTA) | 1 Jul 2019
- Using automatic differentiation as a general framework for ptychographic reconstructionOptics Express, Vol. 27, No. 13 | 19 June 2019
- Advanced denoising for X-ray ptychographyOptics Express, Vol. 27, No. 8 | 1 April 2019
- Convex optimization-based blind deconvolution for images taken with coherent illuminationJournal of the Optical Society of America A, Vol. 36, No. 4 | 28 March 2019
- Joint ptycho-tomography reconstruction through alternating direction method of multipliersOptics Express, Vol. 27, No. 6 | 14 March 2019
- Direct three-dimensional tomographic reconstruction and phase retrieval of far-field coherent diffraction patternsPhysical Review A, Vol. 99, No. 2 | 1 February 2019
- Alternating Structure-Adapted Proximal Gradient Descent for Nonconvex Nonsmooth Block-Regularized ProblemsSIAM Journal on Optimization, Vol. 29, No. 3 | 30 July 2019
- Blind Ptychographic Phase Retrieval via Convergent Alternating Direction Method of MultipliersSIAM Journal on Imaging Sciences, Vol. 12, No. 1 | 22 January 2019
- Optimization on Spheres: Models and Proximal Algorithms with Computational Performance ComparisonsSIAM Journal on Mathematics of Data Science, Vol. 1, No. 3 | 13 August 2019
- PtychographySpringer Handbook of Microscopy | 2 November 2019
- Newton-Like Dynamics Associated to Nonconvex Optimization ProblemsNonsmooth Optimization and Its Applications | 30 March 2019
- High Performance Partial Coherent X-Ray PtychographyComputational Science – ICCS 2019 | 8 June 2019
- Phase contrast scanning transmission electron microscopy imaging of light and heavy atoms at the limit of contrast and resolutionScientific Reports, Vol. 8, No. 1 | 8 February 2018
- Quantitative Convergence Analysis of Iterated Expansive, Set-Valued MappingsMathematics of Operations Research, Vol. 43, No. 4 | 1 Nov 2018
- 3D x-ray imaging of continuous objects beyond the depth of focus limitOptica, Vol. 5, No. 9 | 31 August 2018
- Fast and Guaranteed Blind Multichannel Deconvolution Under a Bilinear System ModelIEEE Transactions on Information Theory, Vol. 64, No. 7 | 1 Jul 2018
- Approaching Nonsmooth Nonconvex Optimization Problems Through First Order Dynamical Systems with Hidden Acceleration and Hessian Driven Damping TermsSet-Valued and Variational Analysis, Vol. 26, No. 2 | 31 May 2017
- Invited Article: Mask-modulated lensless imaging with multi-angle illuminationsAPL Photonics, Vol. 3, No. 6 | 1 Jun 2018
- A forward-backward dynamical approach to the minimization of the sum of a nonsmooth convex with a smooth nonconvex functionESAIM: Control, Optimisation and Calculus of Variations, Vol. 24, No. 2 | 22 January 2018
- Coded aperture ptychography: uniqueness and reconstructionInverse Problems, Vol. 34, No. 2 | 10 January 2018
- Total Variation--Based Phase Retrieval for Poisson Noise RemovalSIAM Journal on Imaging Sciences, Vol. 11, No. 1 | 9 January 2018
- Variational Phase Retrieval with Globally Convergent Preconditioned Proximal AlgorithmSIAM Journal on Imaging Sciences, Vol. 11, No. 1 | 11 January 2018
- GPU-Based Implementation of Ptycho-ADMM for High Performance X-Ray ImagingComputational Science – ICCS 2018 | 12 June 2018
- Block-Coordinate Primal-Dual Method for Nonsmooth Minimization over Linear ConstraintsLarge-Scale and Distributed Optimization | 12 November 2018
- 13-fold resolution gain through turbid layer via translated unknown speckle illuminationBiomedical Optics Express, Vol. 9, No. 1 | 19 December 2017
- Efficient Sum of Outer Products Dictionary Learning (SOUP-DIL) and Its Application to Inverse ProblemsIEEE Transactions on Computational Imaging, Vol. 3, No. 4 | 1 Dec 2017
- Further improvements to the ptychographical iterative engineOptica, Vol. 4, No. 7 | 30 June 2017
- SHARP : a distributed GPU-based ptychographic solverJournal of Applied Crystallography, Vol. 49, No. 4 | 14 July 2016
- An inertial forward–backward algorithm for the minimization of the sum of two nonconvex functionsEURO Journal on Computational Optimization, Vol. 4, No. 1 | 1 Feb 2016
- An Alternating Semiproximal Method for Nonconvex Regularized Structured Total Least Squares ProblemsSIAM Journal on Matrix Analysis and Applications, Vol. 37, No. 3 | 24 August 2016
- Quantitative electron phase imaging with high sensitivity and an unlimited field of viewScientific Reports, Vol. 5, No. 1 | 1 October 2015