Submodular and fractionally subadditive (or equivalently XOS) functions play
a fundamental role in combinatorial optimization, algorithmic game theory and
machine learning. Motivated by learnability of these classes of functions from
random examples, we consider the question of how well such functions can be
approximated by low-degree polynomials in ℓ2 norm over the uniform
distribution. This question is equivalent to understanding of the concentration
of Fourier weight on low-degree coefficients, a central concept in Fourier
analysis. We show that
- For any submodular function f:{0,1}n→[0,1], there is a
polynomial of degree O(log(1/ϵ)/ϵ4/5) approximating f
within ϵ in ℓ2, and there is a submodular function that requires
degree Ω(1/ϵ4/5).
- For any XOS function f:{0,1}n→[0,1], there is a
polynomial of degree O(1/ϵ) and there exists an XOS function that
requires degree Ω(1/ϵ).
This improves on previous approaches that all showed an upper bound of
O(1/ϵ2) for submodular and XOS functions. The best previous lower
bound was Ω(1/ϵ2/3) for monotone submodular functions. Our
techniques reveal new structural properties of submodular and XOS functions and
the upper bounds lead to nearly optimal PAC learning algorithms for these
classes of functions.