Deep Reinforcement Learning With Quantum-inspired Experience Replay

Abstract

In this paper, a novel training paradigm inspired by quantum computation is proposed for deep reinforcement learning (DRL) with experience replay. In contrast to traditional experience replay mechanism in DRL, the proposed deep reinforcement learning with quantum-inspired experience replay (DRL-QER) adaptively chooses experiences from the replay buffer according to the complexity and the replayed times of each experience (also called transition), to achieve a balance between exploration and exploitation. In DRL-QER, transitions are first formulated in quantum representations, and then the preparation operation and the depreciation operation are performed on the transitions. In this progress, the preparation operation reflects the relationship between the temporal difference errors (TD-errors) and the importance of the experiences, while the depreciation operation is taken into account to ensure the diversity of the transitions. The experimental results on Atari 2600 games show that DRL

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keywei2021deep

Related papers

• Efficient Quantum Recurrent Reinforcement Learning Via Quantum Reservoir Computing (2023)0.00
• An Introduction To Quantum Reinforcement Learning (QRL) (2024)0.00
• Ardns-fn-quantum: A Quantum-enhanced Reinforcement Learning Framework With Cognitive-inspired Adaptive Exploration For Dynamic Environments (2025)2.26
• Variational Quantum Circuits For Deep Reinforcement Learning (2019)19.19
• Quantum Framework For Reinforcement Learning: Integrating Markov Decision Process, Quantum Arithmetic, And Trajectory Search (2024)0.00
• MADQRL: Distributed Quantum Reinforcement Learning Framework For Multi-agent Environments (2026)0.00
• Auxiliary Task-based Deep Reinforcement Learning For Quantum Control (2023)5.84
• Prioritized Sequence Experience Replay (2019)0.00