Deep neural networks have an inbuilt Occam’s razor

Nature Communications Nature Research 16:1 (2025) 220

Authors:

Chris Mingard, Henry Rees, Guillermo Valle-Pérez, Ard A Louis

Abstract:

The remarkable performance of overparameterized deep neural networks (DNNs) must arise from an interplay between network architecture, training algorithms, and structure in the data. To disentangle these three components for supervised learning, we apply a Bayesian picture based on the functions expressed by a DNN. The prior over functions is determined by the network architecture, which we vary by exploiting a transition between ordered and chaotic regimes. For Boolean function classification, we approximate the likelihood using the error spectrum of functions on data. Combining this with the prior yields an accurate prediction for the posterior, measured for DNNs trained with stochastic gradient descent. This analysis shows that structured data, together with a specific Occam’s razor-like inductive bias towards (Kolmogorov) simple functions that exactly counteracts the exponential growth of the number of functions with complexity, is a key to the success of DNNs.

Coarse-graining dense, deformable active particles

(2025)

Authors:

Mehrana R Nejad, Julia M Yeomans

Cellular dynamics emerging from turbulent flows steered by active filaments

(2025)

Authors:

Mehrana R Nejad, Julia M Yeomans, Sumesh P Thampi

Minimal Hubbard models of maximal Hilbert Space fragmentation

Physical Review Letters American Physical Society 134:1 (2025) 010411

Authors:

Yves Kwan, Patrick Wilhelm, Sounak Biswas, Siddharth Ashok Parameswaran

Abstract:

We show that Hubbard models with nearest-neighbor hopping and a nearest-neighbor hardcore constraint exhibit “maximal” Hilbert space fragmentation in many lattices of arbitrary dimension 𝑑. Focusing on the 𝑑 =1 rhombus chain and the 𝑑 =2 Lieb lattice, we demonstrate that the fragmentation is strong for all fillings in the thermodynamic limit, and explicitly construct all emergent integrals of motion, which include an extensive set of higher-form symmetries. Blockades consisting of frozen particles partition the system in real space, leading to anomalous dynamics. Our results are potentially relevant to optical lattices of dipolar and Rydberg-dressed atoms.

Vertex model with internal dissipation enables sustained flows

Nature Communications Nature Research 16:1 (2025) 530

Authors:

Jan Rozman, KVS Chaithanya, Julia M Yeomans, Rastko Sknepnek

Abstract:

Complex tissue flows in epithelia are driven by intra- and inter-cellular processes that generate, maintain, and coordinate mechanical forces. There has been growing evidence that cell shape anisotropy, manifested as nematic order, plays an important role in this process. Here we extend an active nematic vertex model by replacing substrate friction with internal viscous dissipation, dominant in epithelia not supported by a substrate or the extracellular matrix, which are found in many early-stage embryos. When coupled to cell shape anisotropy, the internal viscous dissipation allows for long-range velocity correlations and thus enables the spontaneous emergence of flows with a large degree of spatiotemporal organisation. We demonstrate sustained flow in epithelial sheets confined to a channel, providing a link between the cell-level vertex model of tissue dynamics and continuum active nematics, whose behaviour in a channel is theoretically understood and experimentally realisable. Our findings also show a simple mechanism that could account for collective cell migration correlated over distances large compared to the cell size, as observed during morphogenesis.