Abstract

Several ways to generalize scalar total variation to vector-valued functions have been proposed in the past. In this paper, we give a detailed analysis of a variant we denote by $\text{TV}_J$, which has not been previously explored as a regularizer. The contributions of the manuscript are twofold: on the theoretical side, we show that $\text{TV}_J$ can be derived from the generalized Jacobians from geometric measure theory. Thus, within the context of this theory, $\text{TV}_J$ is the most natural form of a vectorial total variation. As an important feature, we derive how $\text{TV}_J$ can be written as the support functional of a convex set in $\mathcal{L}^2$. This property allows us to employ fast and stable minimization algorithms to solve inverse problems. The analysis also shows that in contrast to other total variation regularizers for color images, the proposed one penalizes across a common edge direction for all channels, which is a major theoretical advantage. Our practical contribution consist of an extensive experimental section, where we compare the performance of a number of provable convergent algorithms for inverse problems with our proposed regularizer. In particular, we show in experiments for denoising, deblurring, superresolution, and inpainting that its use leads to a significantly better restoration of color images, both visually and quantitatively. Source code for all algorithms employed in the experiments is provided online.

MSC codes

  1. 68U10
  2. 49M29
  3. 65K10

Keywords

  1. algorithms
  2. duality
  3. vectorial total variation regularization
  4. color image restoration

Get full access to this article

View all available purchase options and get full access to this article.

References

1.
L. Ambrosio, N. Fusco, and D. Pallara, Functions of Bounded Variation and Free Discontinuity Problems, Oxford University Press, Oxford, UK, 2000.
2.
K. Arrow, Studies in Linear and Non-linear Programming, Stanford Mathematical Studies in the Social Sciences 11, Stanford University Press, Stanford, CA, 1958.
3.
H. Attouch, G. Buttazzo, and G. Michaille, Variational Analysis in Sobolev and BV Spaces, MPS/SIAM Ser. Optim., SIAM, Philadelphia, 2006.
4.
J.-F. Aujol, Some first-order algorithms for total variation based image restoration, J. Math. Imaging Vision, 34 (2009), pp. 307–327.
5.
A. Beck and M. Teboulle, Fast gradient-based algorithms for constrained total variation image denoising and deblurring problems, IEEE Trans. Image Process., 18 (2009), pp. 2419–2434.
6.
A. Beck and M. Teboulle, Fast iterative shrinkage-thresholding algorithm for linear inverse problems, SIAM J. Imaging Sci., 2 (2009), pp. 183–202.
7.
A. Bermùdez and C. Moreno, Duality methods for solving variational inequalities, Comput. Math. Appl., 7 (1981), pp. 43–58.
8.
M. Bertalmio, L. Vese, G. Sapiro, and S. Osher, Simultaneous structure and texture image inpainting, IEEE Trans. Image Process., 12 (2003), pp. 882–889.
9.
P. Blomgren and T. F. Chan, Color TV: Total variation methods for restoration of vector-valued images, IEEE Trans. Image Process., 7 (1998), pp. 304–309.
10.
X. Bresson and T. F. Chan, Fast dual minimization of the vectorial total variation norm and applications to color image processing, Inverse Prob. Imaging, 2 (2008), pp. 455–484.
11.
A. Chambolle, Partial differential equations and image processing, in Proceedings of the ICIP, 1994, pp. 16–20.
12.
A. Chambolle, An algorithm for total variation minimization and applications, Math. Imaging Vision, 20 (2004), pp. 89–97.
13.
A. Chambolle, Total variation minimization and a class of binary MRF models, in Proceedings of the EMMCVPR, 2005, pp. 136–152.
14.
A. Chambolle, V. Caselles, D. Cremers, M. Novaga, and T. Pock, An introduction to total variation for image analysis, in Theoretical Foundations and Numerical Methods for Sparse Recovery, De Gruyter, Berlin, 2010.
15.
A. Chambolle, D. Cremers, and T. Pock, A convex approach for computing minimal partitions, Technical report TR-2008-05, Department of Computer Science, University of Bonn, Bonn, Germany, 2008.
16.
A. Chambolle and P.-L. Lions, Image recovery via total variation minimization and related problems, Numer. Math., 76 (1997), pp. 167–188.
17.
A. Chambolle and T. Pock, A first-order primal-dual algorithm for convex problems with applications to imaging, J. Math. Imaging Vis., 40 (2011), pp. 120–145.
18.
T. Chan, S. Esedog¯lu, and M. Nikolova, Algorithms for finding global minimizers of image segmentation and denoising models, SIAM J. Appl. Math., 66 (2006), pp. 1632–1648.
19.
T. F. Chan, G. H. Golub, and P. Mulet, A nonlinear primal-dual method for total variation-based image restoration, SIAM J. Sci. Comput., 20 (1999), pp. 1964–1977.
20.
S. di Zenzo, A note on the gradient of a multi-image, CVGIP, 33 (1986), pp. 116–125.
21.
D. Dobson and F. Santosa, Recovery of blocky images from noisy and blurred data, SIAM J. Appl. Math., 56 (1996), pp. 1181–1198.
22.
V. Duval, J.-F. Aujol, and L. Vese, Projected gradient based color image decomposition, in Scale Space and Variational Methods in Computer Vision, Lecture Notes in Comput. Sci. 5567, Springer, Berlin, 2009, pp. 295–306.
23.
H. Federer, Geometric Measure Theory, Classics Math. 153, Springer, New York, 1996.
24.
B. Goldluecke and D. Cremers, An approach to vectorial total variation based on geometric measure theory, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2010.
25.
R. Kimmel, A natural norm for color processing, in Proceedings of the ACCV, 1998.
26.
R. Kimmel, R. Malladi, and N. Sochen, Images as embedded maps and minimal surfaces: Movies, color, texture and volumetric medical images, Internat. J. Comput. Vision, 39 (2000), pp. 111–129.
27.
K. Kolev, M. Klodt, T. Brox, and D. Cremers, Continuous global optimization in multview 3d reconstruction, Internat. J. Comput. Vision, (2009).
28.
A. Marquina and S. Osher, Image super-resolution by TV-regularization and Bregman iteration, J. Sci. Comput., 37 (2008), pp. 367–382.
29.
L. Mirsky, Symmetric gauge functions and unitarily invariant norms, Quart. J. Math. Oxford, 2 (1960), pp. 50–59.
30.
Y. Nievergelt, Schmidt-Mirsky matrix approximation with linearly constrained singular values, Linear Algebra Appl., 261 (1997), pp. 207–219.
31.
T. Pock, D. Cremers, H. Bischof, and A. Chambolle, An algorithm for minimizing the piecewise smooth Mumford-Shah functional, in Proceedings of the IEEE International Conference on Computer Vision, Kyoto, Japan, 2009.
32.
B. Recht, M. Fazel, and P. Parrilo, Guaranteed minimum-rank solutions of linear matrix equations via nuclear norm minimization, SIAM Rev., 52 (2010), pp. 471–501.
33.
T. Rockafellar, Convex Analysis, Princeton University Press, Princeton, NJ, 1970.
34.
L. I. Rudin, S. Osher, and E. Fatemi, Nonlinear total variation based noise removal algorithms, Phys. D, 60 (1992), pp. 259–268.
35.
G. Sapiro, Vector-valued active contours, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1996, pp. 680–685.
36.
G. Sapiro, Color snakes, Comput. Vision Image Understanding, 68 (1997), pp. 247–253.
37.
G. Sapiro and D. L. Ringach, Anisotropic diffusion of multi-valued images with applications to color filtering, IEEE Trans. Image Process., 5 (1996), pp. 1582–1586.
38.
N. Sochen, R. Kimmel, and R. Malladi, A general framework for low level vision, IEEE Trans. Image Process., 7 (1998), pp. 310–318.
39.
D. Tschumperlé and R. Deriche, Constrained and unconstrained PDEs for vector image restoration, in Proceedings of the Scandinavian Conference on Image Analysis, 2001.
40.
J. Weickert, Coherence-enhancing diffusion of colour images, Image Vision Comput., 17 (1999), pp. 201–212.
41.
C. Zach, T. Pock, and H. Bischof, A duality based approach for realtime $TV-L^1$ optical flow, in Pattern Recognition, Proceedings of DAGM, 2007, pp. 214–223.

Information & Authors

Information

Published In

cover image SIAM Journal on Imaging Sciences
SIAM Journal on Imaging Sciences
Pages: 537 - 563
ISSN (online): 1936-4954

History

Submitted: 8 February 2011
Accepted: 14 December 2011
Published online: 12 April 2012

MSC codes

  1. 68U10
  2. 49M29
  3. 65K10

Keywords

  1. algorithms
  2. duality
  3. vectorial total variation regularization
  4. color image restoration

Authors

Affiliations

Metrics & Citations

Metrics

Citations

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

Cited By

View Options

View options

PDF

View PDF

Figures

Tables

Media

Share

Share

Copy the content Link

Share with email

Email a colleague

Share on social media