Alternating Minimization Algorithm with Automatic Relevance Determination for Transmission Tomography under Poisson Noise
Abstract
We propose a globally convergent alternating minimization (AM) algorithm for image reconstruction in transmission tomography, which extends automatic relevance determination (ARD) to Poisson noise models with Beer's law. The algorithm promotes solutions that are sparse in the pixel/voxel--difference domain by introducing additional latent variables, one for each pixel/voxel, and then learning these variables from the data using a hierarchical Bayesian model. Importantly, the proposed AM algorithm is free of any tuning parameters with image quality comparable to standard penalized likelihood methods. Our algorithm exploits optimization transfer principles which reduce the problem into parallel one-dimensional optimization tasks (one for each pixel/voxel), making the algorithm feasible for large-scale problems. This approach considerably reduces the computational bottleneck of ARD associated with the posterior variances. Positivity constraints inherent in transmission tomography problems are also enforced. We demonstrate the performance of the proposed algorithm for x-ray computed tomography using synthetic and real-world datasets. The algorithm is shown to have much better performance than prior ARD algorithms based on approximate Gaussian noise models, even for high photon flux. Sample code is available from http://www.yan-kaganovsky.com/\#!code/c24bp.
Keywords
MSC codes
Formats available
You can view the full content in the following formats:
References
1.
A. C. Kak and M. Slaney, Principles of Computerized Tomographic Imaging, SIAM, Philadelphia, 2001, ŭlhttp://www.slaney.org/pct/.
2.
F. Natterer, The Mathematics of Computerized Tomography, B. G. Teubner, Stuttgart; John Wiley and Sons, Ltd., Chichester, 1986; reprinted, SIAM, Philadelphia, 2001.
3.
W. A. Kalender, X-ray computed tomography, Phys. Med. Biol., 51 (2006), pp. R29--R43.
4.
J. Frank, Electron Tomography, Springer, New York, 1992.
5.
M. H. Li, H. Q. Yang, and H. Kudo, An accurate iterative reconstruction algorithm for sparse objects: Application to 3d blood vessel reconstruction from a limited number of projections, Phys. Med. Biol., 47 (2002), pp. 2599--2609.
6.
J. A. Fessler, Statistical image reconstruction methods for transmission tomography, in Handbook of Medical Imaging, Vol. 2, M. Sonka and J. M. Fitzpatrick, eds., SPIE, Bellingham, WA, 2000.
7.
E. P. Simoncelli, Modeling the joint statistics of images in the wavelet domain, in Proceedings of the SPIE, 1999, pp. 188--195.
8.
L. Boubchir and J. M. Fadili, Multivariate statistical modeling of images with the curvelet transform, in Proceedings of the 8th International Conference on Signal Processing and Its Applications, 2005, pp. 747--750.
9.
K. Lang and R. Carson, EM reconstruction algorithms for emission and transmission tomography, J. Comput. Assist. Tomog., 8 (1984), pp. 306--316.
10.
P. W. Holland and R. E. Welsch, Robust regression using iteratively reweighted least-squares, Commun. Stat. Theor. M., 6 (1977), pp. 813--827.
11.
K. Lange and J. A. Fessler, Globally convergent algorithms for maximum a posteriori transmission tomography, IEEE Trans. Image Process., 4 (1995), pp. 1430--1438.
12.
H. Erdogan and J. A. Fessler, Ordered subsets algorithms for transmission tomography, Phys. Med. Biol., 44 (1999), pp. 2835--2851.
13.
J. A. O'Sullivan and J. Benac, Alternating minimization algorithms for transmission tomography, IEEE Trans. Med. Imaging, 26 (2007), pp. 283--297.
14.
R. M. Neal, Bayesian Learning for Neural Networks, Springer-Verlag, New York, 1996.
15.
M. E. Tipping, Sparse Bayesian learning and the relevance vector machine, J. Mach. Learn. Res., 1 (2001), pp. 211--244.
16.
D. P. Wipf, B. D. Rao, and S. Nagarajan, Latent variable Bayesian models for promoting sparsity, IEEE Trans. Inform. Theory, 57 (2011), pp. 6236--6255.
17.
H. Jeon, Y. Kaganovsky, S. Han, and L. Carin, GPU-based sparse Bayesian learning for adaptive transmission tomography, in Proceedings of the IEEE Nuclear Science Symposium and Medical Imaging Conference, 2015.
18.
J. S. Iwanczyk, E. Nyg\aard, O. Meirav, J. Arenson, W. C. Barber, N. E. Hartsough, N. Malakhov, and J. C. Wessel, Photon counting energy dispersive detector arrays for x-ray imaging, IEEE Trans. Nucl. Sci., 56 (2009), pp. 535--542.
19.
C. A. Bouman and K. Sauer, A unified approach to statistical tomography using coordinate descent optimization, IEEE Trans. Image Process., 5 (1996), pp. 480--492.
20.
S. Ramani and J. Fessler, A splitting-based iterative algorithm for accelerated statistical X-ray CT reconstruction, IEEE Trans. Med. Imaging, 31 (2012), pp. 677--688.
21.
P. Sukovic and N. H. Clinthorne, Penalized weighted least-squares image reconstruction for dual energy X-ray transmission tomography, IEEE Trans. Med. Imaging, 19 (2000), pp. 1075--1081.
22.
J. Fessler, Hybrid Poisson/polynomial objective functions for tomographic image reconstruction from transmission scans, IEEE Trans. Image Process., 4 (1995), pp. 1439--1450.
23.
W. Zhuang, S. S. Gopal, and T. J. Hebert, Numerical evaluation of methods for computing tomographic projections, IEEE Trans. Nucl. Sci., 4 (1994), pp. 1660--1665.
24.
I. Csiszár and G. Tusnády, Information geometry and alternating minimization procedures, Statistics and Decisions, Supplementary Issue 1 (1984), pp. 205--237.
25.
E. Y. Sidky, C. M. Kao, and X. H. Pan, Accurate image reconstruction from few-views and limited-angle data in divergent-beam CT, J. X-Ray Sci. Tech., 14 (2006), pp. 119--139.
26.
E. Y. Sidky and X. C. Pan, Image reconstruction in circular cone-beam computed tomography by constrained total-variation minimization, Phys. Med. Biol., 53 (2008), pp. 4777--4807.
27.
D. P. Wipf, J. Palmer, and B. Rao, Perspectives on sparse Bayesian learning, in Advances in Neural Information Processing Systems, Vol. 16, MIT Press, Cambridge, MA, 2004, pp. 249--256.
28.
D. P. Wipf and S. Nagarajan, A new view of automatic relevance determination, in Advances in Neural Information Processing Systems, Vol. 20, MIT Press, Cambridge, MA, 2008, pp. 1625--1632.
29.
A. P. Dempster, N. M. Laird, and D. B. Rubin, Maximum likelihood from incomplete data via the EM algorithm, J. Roy. Statist. Soc. Ser. B., 39 (1977), pp. 1--38.
30.
M. W. Seeger and H. Nickisch, Large scale Bayesian inference and experimental design for sparse linear models, SIAM J. Imaging Sci., 4 (2011), pp. 166--199.
31.
M. Seeger and P. Wipf, Variational Bayesian inference techniques, IEEE Mag. Signal Process., 27 (2010), pp. 81--91.
32.
C. Bekas, E. Kokiopoulou, and Y. Saad, An estimator for the diagonal of a matrix, Appl. Numer. Math., 57 (2007), pp. 1214--1229.
33.
G. Papandreou and A. L. Yuille, Efficient variational inference in large-scale Bayesian compressed sensing, in Proceedings of the IEEE Workshop on Information Theory in Computer Vision and Pattern Recognition, 2011.
34.
D. G. Luenberger and Y. Ye, Linear and Nonlinear Programming, 3rd ed., Springer, New York, 2008.
35.
R. M. Neal and G. E. Hinton, A view of the EM algorithm that justifies incremental, sparse, and other variants, in Learning in Graphical Models, Springer, New York, 1998, pp. 355--368.
36.
A. Gunawardana and W. Byrne, Convergence theorems for generalized alternating minimization procedures, J. Mach. Learn. Res., 6 (2005), pp. 2049--2073.
37.
D. G. Tzikas, A. C. Likas, and N. P. Galatsanos, The variational approximation for Bayesian inference, IEEE Mag. Signal Process., 25 (2008), pp. 131--146.
38.
C. F. J. Wu, On the convergence properties of the EM algorithm, Ann. Statist., 11 (1983), pp. 95--103.
39.
S. Boyd and L. Vandenberghe, Convex Optimization, Cambridge University Press, Cambridge, UK, 2004.
40.
C. M. Bishop, Pattern Recognition and Machine Learning, Springer, New York, 2006.
41.
W. I. Zangwill, Nonlinear Programming: A Unified Approach, Prentice--Hall, Englewood Cliffs, NJ, 1969.
42.
R. Chartrand and W. Yin, Iteratively reweighted algorithms for compressive sensing, in Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, 2008, pp. 3869--3872.
43.
D. Wipf and S. Nagarajan, Iterative reweighted $\ell_1$ and $\ell_2$ methods for finding sparse solutions, IEEE J. Sel. Topics Signal Process., 4 (2010), pp. 317--329.
44.
T. M. Cover and J. A. Thomas, Elements of Information Theory, John Wiley and Sons, New York, 2012.
45.
D. Keesing, Development and Implementation of Fully 3D Statistical Image Reconstruction Algorithms for Helical CT and Half- Ring PET Insert System, Ph.D. thesis, Washington University in St. Louis, St. Louis, MO, 2009.
46.
S. Degirmenci, D. G. Politte, C. Bosch, N. Tricha, and J. A. O'Sullivan, Acceleration of iterative image reconstruction for x-ray imaging for security applications, in Computational Imaging XIII, Proc. SPIE 9401, SPIE, Bellingham, WA, 2015.
47.
E. Challis and D. Barber, Concave Gaussian variational approximations for inference in large-scale Bayesian linear models, in Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics, 2011, pp. 199--207.
48.
M. E. Khan, A. Aravkin, M. Friedlander, and M. Seeger, Fast dual variational inference for non-conjugate latent Gaussian models, in Proceedings of the International Conference on Machine Learning, 2013, pp. 951--959.
49.
S. Banerjee, B. P. Carlin, and A. E. Gelfand, Hierarchical Modeling and Analysis for Spatial Data, CRC Press, Boca Raton, FL, 2014.
50.
B. R. Whiting, Signal statistics of X-ray computed tomography, in Proceedings of the SPIE Conference on Medical Imaging 2002: Physics of Medical Imaging, Proc. SPIE 4682, L. Antonuk and M. Yaffe, eds., SPIE, Bellingham, WA, 2002, pp. 53--60.
51.
B. R. Whiting, P. Massoumzadeh, O. A. Earl, J. A. O'Sullivan, D. L. Snyder, and J. F. Williamson, X-ray computed tomography signal properties, Med. Phys., 33 (2006), pp. 3290--330.
52.
J. Nuyts, B. De Man, J. A. Fessler, W. Zbijewski, and F. J. Beekman, Modelling the physics in the iterative reconstruction for transmission computed tomography, Phys. Med. Biol., 58 (2013), pp. R63--R96.
53.
S. Basu and B. De Man, Branchless Distance-Driven Projection and Backprojection, Proc. SPIE 6065, SPIE, Bellingham, WA, 2006.
54.
B. De Man and S. Basu, Distance-driven projection and backprojection in three dimensions, Phys. Med. Biol., 49 (2004), pp. 2463--2475.
55.
Z. Yu, J. B. Thibault, C. A. Bouman, K. D. Sauer, and J. Hsieh, Fast model-based X-ray CT reconstruction using spatially nonhomogeneous ICD optimization, IEEE Trans. Image Process., 20 (2011), pp. 161--175.
56.
Y. Kaganovsky, ŭlhttp://www.yan-kaganovsky.com/#!code/c24bp.
57.
Y. Saad, Iterative Methods for Sparse Linear Systems, 2nd ed., SIAM, Philadelphia, 2003.
58.
T. Tang and Y. Saad, A probing method for computing the diagonal of a matrix inverse, Numer. Linear Algebra Appl., 19 (2012), pp. 485--501.
59.
D. C. Sorensen, Newton's method with a model trust region modification, SIAM J. Numer. Anal., 19 (1982), pp. 409--426.
60.
D. J. Crotty, R. L. McKinley, and M. P. Tornai, Experimental spectral measurements of heavy k-edge filtered beams for x-ray computed mammotomography, Phys. Med. Biol., 52 (2007), pp. 603--616.
61.
C. W. Dodge, A Rapid Method for the Simulation of Filtered X-Ray Spectra in Diagnostic Imaging Systems, ProQuest, Ann Arbor, MI, 2008.
Information & Authors
Information
Published In
Copyright
© 2015, Society for Industrial and Applied Mathematics. This work is licensed under a Creative Commons Attribution 4.0 International License
History
Submitted: 18 December 2014
Accepted: 4 August 2015
Published online: 30 September 2015
Keywords
MSC codes
Authors
Metrics & Citations
Metrics
Citations
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
Cited By
- A variational method for Abel inversion tomography with mixed Poisson-Laplace-Gaussian noiseInverse Problems and Imaging, Vol. 16, No. 4 | 1 Jan 2022
- Accelerated alternating minimization algorithm for Poisson noisy image recoveryInverse Problems in Science and Engineering, Vol. 28, No. 7 | 6 January 2020
- Adaptive Overlapping Community Detection with Bayesian NonNegative Matrix FactorizationDatabase Systems for Advanced Applications | 22 March 2017
View Options
View options
- Access via your Institution
- Questions about how to access this content? Contact SIAM at [email protected].