What We Don't C: Representations for scientific discovery beyond VAEs

Machine Learning and the Physical Sciences workshop at NeurIPS 2025

Authors:

Brian Rogers, Micah Bowles, Chris J. Lintott, Steve Croft

Abstract:

Accessing information in learned representations is critical for scientific discovery in high-dimensional domains. We introduce a novel method based on latent flow matching with classifier-free guidance that disentangles latent subspaces by explicitly separating information included in conditioning from information that remains in the residual representation. Across three experiments -- a synthetic 2D Gaussian toy problem, colored MNIST, and the Galaxy10 astronomy dataset -- we show that our method enables access to meaningful features of high dimensional data. Our results highlight a simple yet powerful mechanism for analyzing, controlling, and repurposing latent representations, providing a pathway toward using generative models for scientific exploration of what we don't capture, consider, or catalog.

Commensal Transient Searches with MeerKAT in Gamma-Ray Burst and Supernova Fields

(2024)

Authors:

SI Chastain, AJ van der Horst, A Horesh, A Rowlinson, A Andersson, R Diretse, M Vaccari, RP Fender, PA Woudt

Anomaly Detection and Radio-frequency Interference Classification with Unsupervised Learning in Narrowband Radio Technosignature Searches

ArXiv 2411.16556 (2024)

Authors:

Ben Jacobson-Bell, Steve Croft, Carmen Choza, Alex Andersson, Daniel Bautista, Vishal Gajjar, Matthew Lebofsky, David HE MacMahon, Caleb Painter, Andrew PV Siemion

LOFAR observations of asymmetric quasi-periodic scintillations in the mid-latitude ionosphere.

(2024)

Authors:

Gareth Dorrian, David R Themens, Toralf Renkwitz, Grzegorz Nykiel, Alan George Wood, Ben Boyde, Richard Andrew Fallows, Maaijke Mevius, Hannah Trigg

A randomized study on the effect of a wearable device using 0.75 Hz transcranial electrical stimulation on sleep onset insomnia

Frontiers in Neuroscience 18:1427462 (2024)

Authors:

Stephen B Simons, Maria Provo, Alexandra Yanoschak, Calvin Schmidt, Isabel Gerrard, Michael Weisend, Craig Anderson, Renee Shimizu, Patrick M Connolly

Abstract:

Introduction: The normal transition to sleep is characterized by a reduction in higher frequency activity and an increase in lower frequency activity in frontal brain regions. In sleep onset insomnia these changes in activity are weaker and may prolong the transition to sleep.

Methods: Using a wearable device, we compared 30min of short duration repetitive transcranial electric stimulation (SDR-tES) at 0.75Hz, prior to going to bed, with an active control at 25Hz in the same individuals.

Results: Treatment with 0.75Hz significantly reduced sleep onset latency (SOL) by 53% when compared with pre-treatment baselines and was also significantly more effective than stimulation with 25Hz which reduced SOL by 30%. Reductions in SOL with 25Hz stimulation displayed order effects suggesting the possibility of placebo. No order effects were observed with 0.75Hz stimulation. The decrease in SOL with 0.75Hz treatment was proportional to an individual’s baseline wherein those suffering from the longest pre-treated SOLs realized the greatest benefits. Changes in SOL were correlated with left/right frontal EEG signal coherence around the stimulation frequency, providing a possible mechanism and target for more focused treatment. Stimulation at both frequencies also decreased perceptions of insomnia symptoms measured with the Insomnia Severity Index, and comorbid anxiety measured with the State Trait Anxiety Index.

Discussion: Our study identifies a new potential treatment for sleep onset insomnia that is comparably effective to current state-of-practice options including pharmacotherapy and cognitive behavioral therapy and is safe, effective, and can be delivered in the home.