Abstract.

We study the problem of computing the \(p\rightarrow q\) norm of a matrix \(A \in{\mathbb{R}}^{m \times n}\) , defined as \(\|A\|_{p\rightarrow q} \:= \max _{x \in{\mathbb{R}}^n \setminus \{0\}} \frac{\|Ax\|_{q}}{\|x\|_{p}}\) . This problem generalizes the spectral norm of a matrix ( \(p=q=2\) ) and the Grothendieck problem ( \(p=\infty\) , \(q=1\) ) and has been widely studied in various regimes. When \(p \geq q\) , the problem exhibits a dichotomy: constant factor approximation algorithms are known if \(2 \in{[q,p]}\) , and the problem is hard to approximate within almost polynomial factors when \(2 \notin{[q,p]}\) . The regime when \(p \lt q\) , known as hypercontractive norms, is particularly significant for various applications but much less well understood. The case with \(p=2\) and \(q \gt 2\) was studied by Barak et al. [Proceedings of the 44th Annual ACM Symposium on Theory of Computing, 2012, pp. 307–326], who gave subexponential algorithms for a promise version of the problem (which captures small-set expansion) and also proved hardness of approximation results based on the exponential time hypothesis. However, no NP-hardness of approximation is known for these problems for any \(p \lt q\) . We prove the first NP-hardness result (under randomized reductions) for approximating hypercontractive norms. We show that for any \(1\lt p \lt q \lt \infty\) with \(2 \notin{[p,q]}\) , \(\|A\|_{p\rightarrow q}\) is hard to approximate within \(2^{O((\log n)^{1-\epsilon })}\) assuming \(\textrm{NP} \not \subseteq \textrm{BPTIME}(2^{(\log n)^{O(1)}})\) . En route to the above result, we also prove almost tight results for the case when \(p \geq q\) with \(2 \in{[q,p]}\) .

Keywords

  1. operator norms
  2. continuous optimization
  3. inapproximability

MSC codes

  1. 68
  2. 90
  3. 46

Get full access to this article

View all available purchase options and get full access to this article.

References

AK06.
F. Albiac and N. J. Kalton, Topics in Banach Space Theory, Springer, New York, 2006.
ABI86.
N. Alon, L. Babai, and A. Itai, A fast and simple randomized parallel algorithm for the maximal independent set problem, J. Algorithms, 7 (1986), pp. 567–583.
AMMN06.
N. Alon, K. Makarychev, Y. Makarychev, and A. Naor, Quadratic forms on graphs, Invent. Math., 163 (2006), pp. 499–522.
ABH+05.
S. Arora, E. Berger, E. Hazan, G. Kindler, and M. Safra, On non-approximability for quadratic programs, in Proceedings of the 46th Annual IEEE Symposium on Foundations of Computer Science, IEEE, 2005, pp. 206–215.
BBH+12.
B. Barak, F. G. S. L. Brandao, A. W. Harrow, J. Kelner, D. Steurer, and Y. Zhou, Hypercontractivity, sum-of-squares proofs, and their applications, in Proceedings of the 44th Annual ACM Symposium on Theory of Computing, ACM, 2012, pp. 307–326.
BV11.
A. Bhaskara and A. Vijayaraghavan, Approximating matrix p-norms, in Proceedings of the 22nd Annual ACM-SIAM Symposium on Discrete Algorithms, SIAM, 2011, pp. 497–511.
BGG+18.
V. Bhattiprolu, M. Ghosh, V. Guruswami, E. Lee, and M. Tulsiani, Approximating Operator Norms via Generalized Krivine Rounding, 2018.
BM15.
G. Biau and D. M. Mason, High-dimensional p-norms, in Mathematical Statistics and Limit Theorems, Springer, New York, 2015, pp. 21–40.
Bis11.
P. Biswal, Hypercontractivity and Its Applications, preprint, https://arxiv.org/abs/1101.2913, 2011.
BH15.
F. G. S. L. Brandao and A. W. Harrow, Estimating Operator Norms Using Covering Nets, preprint, https://arxiv.org/abs/1509.05065, 2015.
BMMN13.
M. Braverman, K. Makarychev, Y. Makarychev, and A. Naor, The Grothendieck constant is strictly smaller than Krivine’s bound, in Forum of Mathematics, Pi, Vol. 1, Cambridge University Press, 2013.
BRS15.
J. Briët, O. Regev, and R. Saket, Tight hardness of the non-commutative Grothendieck problem, in Proceedings of the 56th Annual Symposium on Foundations of Computer Science, IEEE, 2015, pp. 1108–1122.
Gro56.
A. Grothendieck, Résumé de la théorie métrique des produits tensoriels topologiques, Sociedade de Matemática de São Paulo, 1956.
GRSW16.
V. Guruswami, P. Raghavendra, R. Saket, and Y. Wu, Bypassing UGC from some optimal geometric inapproximability results, ACM Trans. Algorithms, 12 (2016), 6.
Haa81.
U. Haagerup, The best constants in the Khintchine inequality, Stud. Math., 70 (1981), pp. 231–283.
HM13.
A. W. Harrow and A. Montanaro, Testing product states, quantum Merlin-Arthur games and tensor optimization, J. ACM, 60 (2013), 3.
HNW16.
A. W. Harrow, A. Natarajan, and X. Wu, Limitations of Semidefinite Programs for Separable States and Entangled Games, preprint, https://arxiv.org/abs/1612.09306, 2016.
Ind06.
P. Indyk, Stable distributions, pseudorandom generators, embeddings, and data stream computation, J. ACM, 53 (2006), pp. 307–323.
KN08.
S. Khot and A. Naor, Linear equations modulo 2 and the \(L_1\) diameter of convex bodies, SIAM J. Comput., 38 (2008), pp. 1448–1463.
KN12.
S. Khot and A. Naor, Grothendieck-type inequalities in combinatorial optimization, Comm. Pure Appl. Math., 65 (2012), pp. 992–1035.
KO09.
S. Khot and R. O’Donnell, SDP gaps and UGC-hardness for Max-Cut-Gain, Theory Comput., 5 (2009), pp. 83–117.
Kho02.
S. Khot, Hardness results for coloring 3-colorable 3-uniform hypergraphs, in Proceedings of the 43rd Annual IEEE Symposium on Foundations of Computer Science, IEEE, 2002, pp. 23–32.
KNS10.
G. Kindler, A. Naor, and G. Schechtman, The UGC hardness threshold of the Lp Grothendieck problem, Math. Oper. Res., 35 (2010), pp. 267–283.
KMW18.
A. Krishnan, S. Mohanty, and D. P. Woodruff, On Sketching q to p Norms, manuscript, 2018.
Kri77.
J.-L. Krivine, Sur la constante de grothendieck, C. R. Acad. Sci. Paris Ser. AB, 284 (1977), pp. A445–A446.
Nes98.
Y. Nesterov, Semidefinite relaxation and nonconvex quadratic optimization, Optim. Methods Softw., 9 (1998), pp. 141–160.
Pis12.
G. Pisier, Grothendieck’s theorem, past and present, Bull. Amer. Math. Soc., 49 (2012), pp. 237–323.
RS09.
P. Raghavendra and D. Steurer, Towards computing the Grothendieck constant, in Proceedings of the 20th Annual ACM-SIAM Symposium on Discrete Algorithms, SIAM, Philadelphia, 2009, pp. 525–534.
RS10.
P. Raghavendra and D. Steurer, Graph expansion and the unique games conjecture, in Proceedings of the 42nd Annual ACM Symposium on Theory of Computing, ACM 2010, pp. 755–764.
Ree91.
J. A. Reeds, A New Lower Bound on the Real Grothendieck Constant, manuscript, 1991.
Sch87.
G. Schechtman, More on embedding subspaces of \(\left({l}_{p}\right)\) in \(\left({{l}}^{{n_r}}\right)\) , Compos. Math., 61 (1987), pp. 159–169.
Sch06.
G. Schechtman, Two observations regarding embedding subsets of euclidean spaces in normed spaces, Adv. Math., 200 (2006), pp. 125–135.
Ste61.
S. B. Stechkin, On best lacunary systems of functions, Izv. Akad. Nauk SSSR Ser. Mat., 25 (1961), pp. 357–366 (in Russian).
Ste05.
D. Steinberg, Computation of Matrix Norms with Applications to Robust Optimization, Research thesis, Technion–Israel University of Technology, 2005.
vB72.
P. van Beek, An application of Fourier methods to the problem of sharpening the Berry-Esseen inequality, Z. Wahrscheinlichkeitstheorie verwandte Gebiete, 23 (1972), pp. 187–196.
Ver17.
R. Vershynin, High-Dimensional Probability, Cambridge University Press, Cambridge, UK, 2017.

Information & Authors

Information

Published In

cover image SIAM Journal on Computing
SIAM Journal on Computing
Pages: 132 - 155
ISSN (online): 1095-7111

History

Submitted: 17 December 2018
Accepted: 10 August 2022
Published online: 14 February 2023

Keywords

  1. operator norms
  2. continuous optimization
  3. inapproximability

MSC codes

  1. 68
  2. 90
  3. 46

Authors

Affiliations

Vijay Bhattiprolu Contact the author
University of Waterloo, Waterloo N2L 3G1, ON, Canada.
Mrinal Kanti Ghosh
Toyota Technological Institute at Chicago, Chicago, IL 60637 USA.
Venkatesan Guruswami
Computer Science Department, Carnegie Mellon University, Pittsburgh, PA 15213 USA.
Euiwoong Lee
University of Michigan, Ann Arbor, MI 48109 USA.
Madhur Tulsiani
Toyota Technological Institute at Chicago, Chicago, IL 60637 USA.

Funding Information

Simons Institute for the Theory of Computing
Funding: The work of the first author was supported by NSF grant CCF-1422045. The work of the second and fifth authors was supported by NSF grant CCF-1254044. The work of the third author was supported by NSF grant CCF-1526092. The work of the fourth author was supported by the Simons Institute for the Theory of Computing.

Metrics & Citations

Metrics

Citations

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

Cited By

View Options

View options

PDF

View PDF

Full Text

View Full Text

Figures

Tables

Media

Share

Share

Copy the content Link

Share with email

Email a colleague

Share on social media