Exploratory combinatorial optimization with reinforcement learning

Proceedings of the AAAI Conference on Artificial Intelligence Association for the Advancement of Artificial Intelligence 34:4 (2020)

Authors:

Thomas Barrett, WR Clements, JN Foerster, AI Lvovsky

Abstract:

Many real-world problems can be reduced to combinatorial optimization on a graph, where the subset or ordering of vertices that maximize some objective function must be found. With such tasks often NP-hard and analytically intractable, reinforcement learning (RL) has shown promise as a framework with which efficient heuristic methods to tackle these problems can be learned. Previous works construct the solution subset incrementally, adding one element at a time, however, the irreversible nature of this approach prevents the agent from revising its earlier decisions, which may be necessary given the complexity of the optimization task. We instead propose that the agent should seek to continuously improve the solution by learning to explore at test time. Our approach of exploratory combinatorial optimization (ECO-DQN) is, in principle, applicable to any combinatorial problem that can be defined on a graph. Experimentally, we show our method to produce state-of-the-art RL performance on the Maximum Cut problem. Moreover, because ECO-DQN can start from any arbitrary configuration, it can be combined with other search methods to further improve performance, which we demonstrate using a simple random search.

Quantum-enhanced interferometry with large heralded photon-number states

(2020)

Authors:

GS Thekkadath, ME Mycroft, BA Bell, CG Wade, A Eckstein, DS Phillips, RB Patel, A Buraczewski, AE Lita, T Gerrits, SW Nam, M Stobińska, AI Lvovsky, IA Walmsley

Interferobot: aligning an optical interferometer by a reinforcement learning agent

(2020)

Authors:

Dmitry Sorokin, Alexander Ulanov, Ekaterina Sazhina, Alexander Lvovsky

Experimental quantum homodyne tomography via machine learning

Optica Optical Society of America 7:5 (2020) 448-454

Authors:

Es Tiunov, Vv Tiunova (Vyborova), Ae Ulanov, Ai Lvovsky, Ak Fedorov

Abstract:

Complete characterization of states and processes that occur within quantum devices is crucial for understanding and testing their potential to outperform classical technologies for communications and computing. However, solving this task with current state-of-the-art techniques becomes unwieldy for large and complex quantum systems. Here we realize and experimentally demonstrate a method for complete characterization of a quantum harmonic oscillator based on an artificial neural network known as the restricted Boltzmann machine. We apply the method to optical homodyne tomography and show it to allow full estimation of quantum states based on a smaller amount of experimental data compared to state-of-the-art methods. We link this advantage to reduced overfitting. Although our experiment is in the optical domain, our method provides a way of exploring quantum resources in a broad class of large-scale physical systems, such as superconducting circuits, atomic and molecular ensembles, and optomechanical systems.

Comprehensive model and performance optimization of phase-only spatial light modulators

(2020)

Authors:

AA Pushkina, JI Costa-Filho, G Maltese, AI Lvovsky