What We Don't C: Representations for scientific discovery beyond VAEs
Machine Learning and the Physical Sciences workshop at NeurIPS 2025
Abstract:
Accessing information in learned representations is critical for scientific discovery in high-dimensional domains. We introduce a novel method based on latent flow matching with classifier-free guidance that disentangles latent subspaces by explicitly separating information included in conditioning from information that remains in the residual representation. Across three experiments -- a synthetic 2D Gaussian toy problem, colored MNIST, and the Galaxy10 astronomy dataset -- we show that our method enables access to meaningful features of high dimensional data. Our results highlight a simple yet powerful mechanism for analyzing, controlling, and repurposing latent representations, providing a pathway toward using generative models for scientific exploration of what we don't capture, consider, or catalog.
Commensal Transient Searches with MeerKAT in Gamma-Ray Burst and Supernova Fields
(2024)
Anomaly Detection and Radio-frequency Interference Classification with Unsupervised Learning in Narrowband Radio Technosignature Searches
ArXiv 2411.16556 (2024)
LOFAR observations of asymmetric quasi-periodic scintillations in the mid-latitude ionosphere.
(2024)
A randomized study on the effect of a wearable device using 0.75 Hz transcranial electrical stimulation on sleep onset insomnia
Frontiers in Neuroscience 18:1427462 (2024)
Abstract:
Introduction: The normal transition to sleep is characterized by a reduction in higher frequency activity and an increase in lower frequency activity in frontal brain regions. In sleep onset insomnia these changes in activity are weaker and may prolong the transition to sleep.
Methods: Using a wearable device, we compared 30min of short duration repetitive transcranial electric stimulation (SDR-tES) at 0.75Hz, prior to going to bed, with an active control at 25Hz in the same individuals.
Results: Treatment with 0.75Hz significantly reduced sleep onset latency (SOL) by 53% when compared with pre-treatment baselines and was also significantly more effective than stimulation with 25Hz which reduced SOL by 30%. Reductions in SOL with 25Hz stimulation displayed order effects suggesting the possibility of placebo. No order effects were observed with 0.75Hz stimulation. The decrease in SOL with 0.75Hz treatment was proportional to an individual’s baseline wherein those suffering from the longest pre-treated SOLs realized the greatest benefits. Changes in SOL were correlated with left/right frontal EEG signal coherence around the stimulation frequency, providing a possible mechanism and target for more focused treatment. Stimulation at both frequencies also decreased perceptions of insomnia symptoms measured with the Insomnia Severity Index, and comorbid anxiety measured with the State Trait Anxiety Index.
Discussion: Our study identifies a new potential treatment for sleep onset insomnia that is comparably effective to current state-of-practice options including pharmacotherapy and cognitive behavioral therapy and is safe, effective, and can be delivered in the home.
Methods: Using a wearable device, we compared 30min of short duration repetitive transcranial electric stimulation (SDR-tES) at 0.75Hz, prior to going to bed, with an active control at 25Hz in the same individuals.
Results: Treatment with 0.75Hz significantly reduced sleep onset latency (SOL) by 53% when compared with pre-treatment baselines and was also significantly more effective than stimulation with 25Hz which reduced SOL by 30%. Reductions in SOL with 25Hz stimulation displayed order effects suggesting the possibility of placebo. No order effects were observed with 0.75Hz stimulation. The decrease in SOL with 0.75Hz treatment was proportional to an individual’s baseline wherein those suffering from the longest pre-treated SOLs realized the greatest benefits. Changes in SOL were correlated with left/right frontal EEG signal coherence around the stimulation frequency, providing a possible mechanism and target for more focused treatment. Stimulation at both frequencies also decreased perceptions of insomnia symptoms measured with the Insomnia Severity Index, and comorbid anxiety measured with the State Trait Anxiety Index.
Discussion: Our study identifies a new potential treatment for sleep onset insomnia that is comparably effective to current state-of-practice options including pharmacotherapy and cognitive behavioral therapy and is safe, effective, and can be delivered in the home.