The Capacity of Modern Hopfield Networks under the Data Manifold Hypothesis

We generalize the computation of the capacity of exponential Hopfield model from Lucibello and Mézard (2024) to more generic pattern ensembles, including binary patterns and patterns generated from a hidden manifold model.