Quantum Imitation Learning

Abstract

Despite remarkable successes in solving various complex decision-making tasks, training an imitation learning (IL) algorithm with deep neural networks (DNNs) suffers from the high computation burden. In this work, we propose quantum imitation learning (QIL) with a hope to utilize quantum advantage to speed up IL. Concretely, we develop two QIL algorithms, quantum behavioural cloning (Q-BC) and quantum generative adversarial imitation learning (Q-GAIL). Q-BC is trained with a negative log-likelihood loss in an off-line manner that suits extensive expert data cases, whereas Q-GAIL works in an inverse reinforcement learning scheme, which is on-line and on-policy that is suitable for limited expert data cases. For both QIL algorithms, we adopt variational quantum circuits (VQCs) in place of DNNs for representing policies, which are modified with data re-uploading and scaling parameters to enhance the expressivity. We first encode classical data into quantum states as inputs, then perform V

Stats

• citations3
• S2 citations—
• github stars0
• HF likes0
• heat score4.52
• arxiv keycheng2023quantum

Related papers

• Iq-learn: Inverse Soft-q Learning For Imitation (2021)0.00
• Variational Quantum Circuits For Deep Reinforcement Learning (2019)19.19
• Augmented Q Imitation Learning (AQIL) (2020)0.00
• Efficient Quantum Recurrent Reinforcement Learning Via Quantum Reservoir Computing (2023)0.00
• Quantum Algorithms For Reinforcement Learning With A Generative Model (2021)0.00
• Quantum Natural Policy Gradients: Towards Sample-efficient Reinforcement Learning (2023)7.16
• Quantum Policy Iteration Via Amplitude Estimation And Grover Search -- Towards Quantum Advantage For Reinforcement Learning (2022)0.00
• Quantum Reinforcement Learning By Adaptive Non-local Observables (2025)2.26