Double-descent curves in neural networks: a new perspective using Gaussian processes

Proceedings of the AAAI Conference on Artificial Intelligence Association for the Advancement of Artificial Intelligence 38:10 (2024) 11856-11864

Authors:

Ouns El Harzli, Bernardo Cuenca Grau, Guillermo Valle-Pérez, Adriaan A Louis

Abstract:

Double-descent curves in neural networks describe the phenomenon that the generalisation error initially descends with increasing parameters, then grows after reaching an optimal number of parameters which is less than the number of data points, but then descends again in the overparameterized regime. In this paper, we use techniques from random matrix theory to characterize the spectral distribution of the empirical feature covariance matrix as a width-dependent perturbation of the spectrum of the neural network Gaussian process (NNGP) kernel, thus establishing a novel connection between the NNGP literature and the random matrix theory literature in the context of neural networks. Our analytical expressions allow us to explore the generalisation behavior of the corresponding kernel and GP regression. Furthermore, they offer a new interpretation of double-descent in terms of the discrepancy between the width-dependent empirical kernel and the width-independent NNGP kernel.

Coulomb-driven band unflattening suppresses K-phonon pairing in moire graphene

Physical Review B American Physical Society 109 (2024) 104504

Authors:

Glenn Wagner, Yves H Kwan, Nick Bultinck, Steven Simon, Siddharth A Parameswaran

Abstract:

It is a matter of current debate whether the gate-tunable superconductivity in twisted bilayer graphene is phonon-mediated or arises from electron-electron interactions. The recent observation of the strong coupling of electrons to so-called K-phonon modes in angle-resolved photoemission spectroscopy experiments has resuscitated early proposals that K-phonons drive superconductivity. We show that the bandwidth-enhancing effect of interactions drastically weakens both the intrinsic susceptibility towards pairing as well as the screening of Coulomb repulsion that is essential for the phonon attraction to dominate at low temperature. This rules out purely K-phonon-mediated superconductivity with the observed transition temperature of ∼1 K. We conclude that the unflattening of bands by Coulomb interactions challenges any purely phonon-driven pairing mechanism, and must be addressed by a successful theory of superconductivity in moiré graphene

Decay of long-lived oscillations after quantum quenches in gapped interacting quantum systems

Physical Review A American Physical Society (APS) 109:3 (2024) 032208

Authors:

Jacob H Robertson, Riccardo Senese, Fabian HL Essler

Abstract:

The presence of long-lived oscillations in the expectation values of local observables after quantum quenches has recently attracted considerable attention in relation to weak ergodicity breaking. Here, we focus on an alternative mechanism that gives rise to such oscillations in a class of systems that support kinematically protected gapped excitations at zero temperature. An open question in this context is whether such oscillations will ultimately decay. We provide strong support for the decay hypothesis by considering spin models that can be mapped to systems of weakly interacting fermions, which in turn are amenable to an analysis by standard methods based on the Bogoliubov-Born-Green-Kirkwood-Yvon (BBGKY) hierarchy. We find that there is a time scale beyond which the oscillations start to decay that grows as the strength of the quench is made small.

Cell sorting by active forces in a phase-field model of cell monolayers

(2024)

Authors:

James N Graham, Guanming Zhang, Julia M Yeomans

Cell sorting by active forces in a phase-field model of cell monolayers

Soft Matter Royal Society of Chemistry 20:13 (2024) 2955-2960

Authors:

James N Graham, Guanming Zhang, Julia M Yeomans

Abstract:

Cell sorting, the segregation of cells with different properties into distinct domains, is a key phenomenon in biological processes such as embryogenesis. We use a phase-field model of a confluent cell layer to study the role of activity in cell sorting. We find that a mixture of cells with extensile or contractile dipolar activity, and which are identical apart from their activity, quickly sort into small, elongated patches which then grow slowly in time. We interpret the sorting as driven by the different diffusivity of the extensile and contractile cells, mirroring the ordering of Brownian particles connected to different hot and cold thermostats. We check that the free energy is not changed by either partial or complete sorting, thus confirming that activity can be responsible for the ordering even in the absence of thermodynamic mechanisms.