D4RL

Datasets for Deep Data-Driven RL — standardized offline-RL benchmark tasks and logged datasets.

Papers using D4RL (125)

Penalizing Infeasible Actions and Reward Scaling in Reinforcement Learning with Offline Data2025 · 6 citesDirectly Forecasting Belief for Reinforcement Learning with Delays2025 · 4 citesShortcut Trajectory Planning for Efficient Offline Reinforcement Learning2026Fast and Highly Expressive Policy Learning for Offline Reinforcement Learning via Bootstrapped Flow Q-Learning2026Wavelet Fourier Diffuser: Frequency-Aware Diffusion Model for Reinforcement Learning2025 · 2 citesBeyond the Known: Decision Making with Counterfactual Reasoning Decision Transformer2025 · 1 citesLearning on One Mode: Addressing Multi-modality in Offline Reinforcement Learning2024 · 1 citesDiffusion Model Predictive Control2024Drift Q-Learning2026Counterfactual Transport Flows for Offline Conservative Trajectory Refinement2026Beyond Autoregressive RTG: Conditioning via Injection Outside Sequential Modeling in Decision Transformer2026Path-Coupled Bellman Flows for Distributional Reinforcement Learning2026RankQ: Offline-to-Online Reinforcement Learning via Self-Supervised Action Ranking2026Peng's Q($\lambda$) for Conservative Value Estimation in Offline Reinforcement Learning2026COOPO: Cyclic Offline-Online Policy Optimization Algorithm2026Neuro-Inspired Inverse Learning for Planning and Control2026Moment Matching Q-Learning2026Reinforcement Learning via Value Gradient Flow2026Preserve Support, Not Correspondence: Dynamic Routing for Offline Reinforcement Learning2026When Policies Cannot Be Retrained: A Unified Closed-Form View of Post-Training Steering in Offline Reinforcement Learning2026IPD: Boosting Sequential Policy with Imaginary Planning Distillation in Offline Reinforcement Learning2026Robust Regularized Policy Iteration under Transition Uncertainty2026GEM: Guided Expectation-Maximization for Behavior-Normalized Candidate Action Selection in Offline RL2026Efficient Anti-exploration via VQVAE and Fuzzy Clustering in Offline Reinforcement Learning2026SMAC: Score-Matched Actor-Critics for Robust Offline-to-Online Transfer2026Flow Actor-Critic for Offline Reinforcement Learning2026CS-GBA: A Critical Sample-based Gradient-guided Backdoor Attack for Offline Reinforcement Learning2026Off-Policy Actor-Critic with Sigmoid-Bounded Entropy for Real-World Robot Learning2026Automatic Constraint Policy Optimization based on Continuous Constraint Interpolation Framework for Offline Reinforcement Learning2026Agile Reinforcement Learning through Separable Neural Architecture2026Guided Flow Policy: Learning from High-Value Actions in Offline Reinforcement Learning2025Long-Horizon Model-Based Offline Reinforcement Learning Without Explicit Conservatism2025Optimal Perturbation Budget Allocation for Data Poisoning in Offline Reinforcement Learning2025Adaptive Replay Buffer for Offline-to-Online Reinforcement Learning2025From Static Constraints to Dynamic Adaptation: Sample-Level Constraint Relaxation for Offline-to-Online Reinforcement Learning2025Diffusion Policies with Value-Conditional Optimization for Offline Reinforcement Learning2025Opinion: Towards Unified Expressive Policy Optimization for Robust Robot Learning2025Quantile Q-Learning: Revisiting Offline Extreme Q-Learning with Quantile Regression2025One-Step Generative Policies with Q-Learning: A Reformulation of MeanFlow2025Enhancing Robustness of Offline Reinforcement Learning Under Data Corruption via Sharpness-Aware Minimization2025ASTRO: Adaptive Stitching via Dynamics-Guided Trajectory Rollouts2025Offline Reinforcement Learning with Generative Trajectory Policies2025Human-in-the-Loop Bandwidth Estimation for Quality of Experience Optimization in Real-Time Video Communication2025What Fundamental Structure in Reward Functions Enables Efficient Sparse-Reward Learning?2025Diffusion Policies with Offline and Inverse Reinforcement Learning for Promoting Physical Activity in Older Adults Using Wearable Sensors2025DAWM: Diffusion Action World Models for Offline Reinforcement Learning via Action-Inferred Transitions2025Unleashing Flow Policies with Distributional Critics2025Robust Policy Expansion for Offline-to-Online RL under Diverse Data Corruption2025Offline-to-Online Reinforcement Learning with Classifier-Free Diffusion Generation2025One-Step Flow Q-Learning: Addressing the Diffusion Policy Bottleneck in Offline Reinforcement Learning2025Double Check My Desired Return: Transformer with Target Alignment for Offline Reinforcement Learning2025Adaptive Scaling of Policy Constraints for Offline Reinforcement Learning2025Online Pre-Training for Offline-to-Online Reinforcement Learning2025Consistency Trajectory Planning: High-Quality and Efficient Trajectory Optimization for Offline Model-Based Reinforcement Learning2025Should We Ever Prefer Decision Transformer for Offline Reinforcement Learning?2025Offline Reinforcement Learning with Wasserstein Regularization via Optimal Transport Maps2025From Novelty to Imitation: Self-Distilled Rewards for Offline Reinforcement Learning2025Belief-Based Offline Reinforcement Learning for Delay-Robust Policy Optimization2025BiTrajDiff: Bidirectional Trajectory Generation with Diffusion Models for Offline Reinforcement Learning2025Offline RL with Smooth OOD Generalization in Convex Hull and its Neighborhood2025Policy-Based Trajectory Clustering in Offline Reinforcement Learning2025MOORL: A Framework for Integrating Offline-Online Reinforcement Learning2025CAWR: Corruption-Averse Advantage-Weighted Regression for Robust Policy Optimization2025Accelerating Residual Reinforcement Learning with Uncertainty Estimation2025TROFI: Trajectory-Ranked Offline Inverse Reinforcement Learning2025Analytic Energy-Guided Policy Optimization for Offline Reinforcement Learning2025Taming OOD Actions for Offline Reinforcement Learning: An Advantage-Based Approach2025Pretraining a Shared Q-Network for Data-Efficient Offline Reinforcement Learning2025Imagination-Limited Q-Learning for Offline Reinforcement Learning2025Diffusion Self-Weighted Guidance for Offline Reinforcement Learning2025Learning to Trust Bellman Updates: Selective State-Adaptive Regularization for Offline RL2025Decision SpikeFormer: Spike-Driven Transformer for Decision Making2025VIPO: Value Function Inconsistency Penalized Offline Reinforcement Learning2025An Optimal Discriminator Weighted Imitation Perspective for Reinforcement Learning2025Model-Based Offline Reinforcement Learning with Adversarial Data Augmentation2025Learning from Suboptimal Data in Continuous Control via Auto-Regressive Soft Q-Network2025Flow Q-Learning2025Behavior-Regularized Diffusion Policy Optimization for Offline Reinforcement Learning2025Habitizing Diffusion Planning for Efficient and Effective Decision Making2025M$^3$PC: Test-time Model Predictive Control for Pretrained Masked Trajectory Model2024SR-Reward: Taking The Path More Traveled2025DRDT3: Diffusion-Refined Decision Test-Time Training Model2025PIQL: Projective Implicit Q-Learning with Support Constraint for Offline Reinforcement Learning2025SAMG: Offline-to-Online Reinforcement Learning via State-Action-Conditional Offline Model Guidance2024Q-Distribution guided Q-learning for offline reinforcement learning: Uncertainty penalized Q-value via consistency model2024Diffusion Actor-Critic: Formulating Constrained Policy Iteration as Diffusion Noise Regression for Offline Reinforcement Learning2024Decision Mamba: Reinforcement Learning via Hybrid Selective Sequence Modeling2024 · 29 citesQ-value Regularized Transformer for Offline Reinforcement Learning2024 · 4 citesKAN v.s. MLP for Offline Reinforcement Learning2024 · 2 citesNetworkGym: Reinforcement Learning Environments for Multi-Access Traffic Management in Network Simulation2024 · 2 citesSimple Ingredients for Offline Reinforcement Learning2024 · 1 citesReinformer: Max-Return Sequence Modeling for Offline RL2024 · 1 citesTowards Robust Policy: Enhancing Offline Reinforcement Learning with Adversarial Attacks and Defenses2024 · 1 citesDiffusion Policies creating a Trust Region for Offline Reinforcement Learning2024 · 1 citesIn-Context Decision Transformer: Reinforcement Learning via Hierarchical Chain-of-Thought2024 · 1 citesModel-based Offline Reinforcement Learning with Lower Expectile Q-Learning2024 · 1 citesA2PO: Towards Effective Offline Reinforcement Learning from an Advantage-aware Perspective2024Grid-Mapping Pseudo-Count Constraint for Offline Reinforcement Learning2024Compositional Conservatism: A Transductive Approach in Offline Reinforcement Learning2024Offline Reinforcement Learning with Domain-Unlabeled Data2024Improving Offline Reinforcement Learning with Inaccurate Simulators2024Task-agnostic Decision Transformer for Multi-type Agent Control with Federated Split Training2024State-Constrained Offline Reinforcement Learning2024AlignIQL: Policy Alignment in Implicit Q-Learning through Constrained Optimization2024Learning from Random Demonstrations: Offline Reinforcement Learning with Importance-Sampled Diffusion Models2024Adaptive Advantage-Guided Policy Regularization for Offline Reinforcement Learning2024UDQL: Bridging The Gap between MSE Loss and The Optimal Value Function in Offline Reinforcement Learning2024Strategically Conservative Q-Learning2024Stabilizing Extreme Q-learning by Maclaurin Expansion2024CDSA: Conservative Denoising Score-based Algorithm for Offline Reinforcement Learning2024DiffPoGAN: Diffusion Policies with Generative Adversarial Networks for Offline Reinforcement Learning2024Binary Reward Labeling: Bridging Offline Preference and Reward-Based Reinforcement Learning2024SUMO: Search-Based Uncertainty Estimation for Model-Based Offline Reinforcement Learning2024Forward KL Regularized Preference Optimization for Aligning Diffusion Policies2024Q-value Regularized Decision ConvFormer for Offline Reinforcement Learning2024Planning Transformer: Long-Horizon Offline Reinforcement Learning with Planning Tokens2024Rethinking Optimal Transport in Offline Reinforcement Learning2024Offline Behavior Distillation2024Return Augmented Decision Transformer for Off-Dynamics Reinforcement Learning2024Hypercube Policy Regularization Framework for Offline Reinforcement Learning2024Constrained Latent Action Policies for Model-Based Offline Reinforcement Learning2024Enhancing Decision Transformer with Diffusion-Based Trajectory Branch Generation2024Are Expressive Models Truly Necessary for Offline RL?2024Goal-Conditioned Data Augmentation for Offline Reinforcement Learning2024Diffusion Models as Optimizers for Efficient Planning in Offline RL2024