Quantum Machine Learning With Glow For Episodic Tasks And Decision Games

Abstract

We consider a general class of models, where a reinforcement learning (RL) agent learns from cyclic interactions with an external environment via classical signals. Perceptual inputs are encoded as quantum states, which are subsequently transformed by a quantum channel representing the agent's memory, while the outcomes of measurements performed at the channel's output determine the agent's actions. The learning takes place via stepwise modifications of the channel properties. They are described by an update rule that is inspired by the projective simulation (PS) model and equipped with a glow mechanism that allows for a backpropagation of policy changes, analogous to the eligibility traces in RL and edge glow in PS. In this way, the model combines features of PS with the ability for generalization, offered by its physical embodiment as a quantum system. We apply the agent to various setups of an invasion game and a grid world, which serve as elementary model tasks allowing a direct co

Stats

• citations11
• S2 citations—
• github stars0
• HF likes0
• heat score8.09
• arxiv keyclausen2016quantum

Related papers

• Quantum Algorithms For Reinforcement Learning With A Generative Model (2021)0.00
• Efficient Quantum Recurrent Reinforcement Learning Via Quantum Reservoir Computing (2023)0.00
• Quantum Policy Iteration Via Amplitude Estimation And Grover Search -- Towards Quantum Advantage For Reinforcement Learning (2022)0.00
• On The Convergence Of Projective-simulation-based Reinforcement Learning In Markov Decision Processes (2019)8.35
• A Bit Of Freedom Goes A Long Way: Classical And Quantum Algorithms For Reinforcement Learning Under A Generative Model (2025)0.00
• Deep Reinforcement Learning With Quantum-inspired Experience Replay (2021)0.00
• Auxiliary Task-based Deep Reinforcement Learning For Quantum Control (2023)5.84
• Hybrid Quantum-classical Algorithm For Near-optimal Planning In Pomdps (2025)0.00