D3rlpy: An Offline Deep Reinforcement Learning Library

Abstract

In this paper, we introduce d3rlpy, an open-sourced offline deep reinforcement learning (RL) library for Python. d3rlpy supports a set of offline deep RL algorithms as well as off-policy online algorithms via a fully documented plug-and-play API. To address a reproducibility issue, we conduct a large-scale benchmark with D4RL and Atari 2600 dataset to ensure implementation quality and provide experimental scripts and full tables of results. The d3rlpy source code can be found on GitHub: https://github.com/takuseno/d3rlpy.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyseno2021d3rlpy

Code

• takuseno/d3rlpy—

Related papers

• D4RL: Datasets For Deep Data-driven Reinforcement Learning (2020)0.00
• Pytupli: A Scalable Infrastructure For Collaborative Offline Reinforcement Learning Projects (2025)0.00
• An Optimistic Perspective On Offline Reinforcement Learning (2019)0.00
• CORL: Research-oriented Deep Offline Reinforcement Learning Library (2022)0.00
• RL Unplugged: A Suite Of Benchmarks For Offline Reinforcement Learning (2020)0.00
• Data Valuation For Offline Reinforcement Learning (2022)0.00
• AWAC: Accelerating Online Reinforcement Learning With Offline Datasets (2020)0.00
• Towards Robust Policy: Enhancing Offline Reinforcement Learning With Adversarial Attacks And Defenses (2024)3.58