Variational Quantum Soft Actor-critic

Abstract

Quantum computing has a superior advantage in tackling specific problems, such as integer factorization and Simon's problem. For more general tasks in machine learning, by applying variational quantum circuits, more and more quantum algorithms have been proposed recently, especially in supervised learning and unsupervised learning. However, little work has been done in reinforcement learning, arguably more important and challenging. Previous work in quantum reinforcement learning mainly focuses on discrete control tasks where the action space is discrete. In this work, we develop a quantum reinforcement learning algorithm based on soft actor-critic -- one of the state-of-the-art methods for continuous control. Specifically, we use a hybrid quantum-classical policy network consisting of a variational quantum circuit and a classical artificial neural network. Tested in a standard reinforcement learning benchmark, we show that this quantum version of soft actor-critic is comparable with t

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keylan2021variational

Related papers

• Variational Quantum Circuits For Deep Reinforcement Learning (2019)19.19
• Quantum Policy Gradient Algorithm With Optimized Action Decoding (2022)0.00
• Robustness And Generalization In Quantum Reinforcement Learning Via Lipschitz Regularization (2024)0.00
• Quantum Natural Policy Gradients: Towards Sample-efficient Reinforcement Learning (2023)7.16
• Quantum Reinforcement Learning By Adaptive Non-local Observables (2025)2.26
• Hybrid Quantum-classical Policy Gradient For Adaptive Control Of Cyber-physical Systems: A Comparative Study Of VQC Vs. MLP (2025)0.00
• A Survey On Quantum Reinforcement Learning (2022)0.00
• Quantum Algorithms For Reinforcement Learning With A Generative Model (2021)0.00