Summands of theta divisors on Jacobians

We show that the only summands of theta divisors on Jacobians of curves and on intermediate Jacobians of cubic threefolds are the obvious powers of the curve and the Fano surface of lines on the threefold. The proof uses the decomposition theorem for perverse sheaves, a bit of representation theory and a computation of characteristic cycles for Brill-Noether sheaves.