Memorisation, convergence and generalisation in generative models
A new theoretical analysis pins down when generative models shift from memorizing training data to learning genuine distributions. Building on prior empirical work showing diffusion models converge across disjoint datasets, researchers provide exact mathematical characterization of this memorization-to-generalization phase transition in linear models. The finding matters because it quantifies a fundamental question haunting deep learning: whether scale and data volume actually teach models or just encode training examples. Understanding this boundary has direct implications for data efficiency, model scaling laws, and confidence in generative AI reliability.62
