CN101 - A Digital Thermodynamic Computer for Generative AI

ArXiv 2608.00754 (2026)

Authors:

Lars Holdijk, Denis Melanson, Zier Mensch, Brandon Birchall, Vincent Cheung, Nicholas Lehrter, Maxwell Aifer, Samuel Duffield, Jan Ole Ernst, Rajath Salegame, Antonio J Martinez, Gavin Crooks, Miranda Cheng, Zach Belateche, Marc Bright, Patrick J Coles, Faris Sbahi

Autoformalizing Memory Specifications with Agents

ArXiv 2605.00058 (2026)

Authors:

Jan Ole Ernst, Dmitri Michelangelo Saberi, Derek Christ, Thomas Zimmermann, Rajath Salegame, Suhaas M Bhat, Stanislav Levental, Thomas Dybdahl Ahle, Matthias Jung

Reinforcement Learning for Quantum Control under Physical Constraints

ArXiv 2501.14372 (2025)

Authors:

Jan Ole Ernst, Aniket Chatterjee, Tim Franzmeyer, Axel Kuhn

Supercharging Single-Atom Traps by Collisional Blockade

(2025)

Authors:

Mark IJspeert, Naomi Holland, Benjamin Yuen, Axel Kuhn

Reinforcement Learning for Quantum Control under Physical Constraints

Proceedings of Machine Learning Research 267 (2025) 15463-15489

Authors:

JO Ernst, A Chatterjee, T Franzmeyer, A Kuhn

Abstract:

Quantum control is concerned with the realisation of desired dynamics in quantum systems, serving as a linchpin for advancing quantum technologies and fundamental research. Analytic approaches and standard optimisation algorithms do not yield satisfactory solutions for more complex quantum systems, and especially not for real world quantum systems which are open and noisy. We devise a physics-constrained Reinforcement Learning (RL) algorithm that restricts the space of possible solutions. We incorporate priors about the desired time scales of the quantum state dynamics – as well as realistic control signal limitations – as constraints to the RL algorithm. These constraints improve solution quality and enhance computationalscaleability. We evaluate our method onthree broadly relevant quantum systems and incorporatereal-world complications, arising from dissipation and control signal perturbations. We achieve both higher fidelities – which exceed 0.999 across all systems – and better robustness to time-dependent perturbations and experimental imperfections than previous methods. Lastly, wedemonstrate that incorporating multi-step feedback can yield solutions robust even to strong perturbations. Our implementation can be found at https://github.com/jan-o-e/RL4qcWpc.