Neorl-2: Near Real-world Benchmarks For Offline Reinforcement Learning With Extended Realistic Scenarios

Abstract

Offline reinforcement learning (RL) aims to learn from historical data without requiring (costly) access to the environment. To facilitate offline RL research, we previously introduced NeoRL, which highlighted that datasets from real-world tasks are often conservative and limited. With years of experience applying offline RL to various domains, we have identified additional real-world challenges. These include extremely conservative data distributions produced by deployed control systems, delayed action effects caused by high-latency transitions, external factors arising from the uncontrollable variance of transitions, and global safety constraints that are difficult to evaluate during the decision-making process. These challenges are underrepresented in previous benchmarks but frequently occur in real-world tasks. To address this, we constructed the extended Near Real-World Offline RL Benchmark (NeoRL-2), which consists of 7 datasets from 7 simulated tasks along with their correspondi

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keygao2025neorl

Related papers

• D4RL: Datasets For Deep Data-driven Reinforcement Learning (2020)0.00
• RL Unplugged: A Suite Of Benchmarks For Offline Reinforcement Learning (2020)0.00
• Interpretable Performance Analysis Towards Offline Reinforcement Learning: A Dataset Perspective (2021)0.00
• A Dataset Perspective On Offline Reinforcement Learning (2021)0.00
• AD4RL: Autonomous Driving Benchmarks For Offline Reinforcement Learning With Value-based Dataset (2024)7.16
• A Benchmark Environment For Offline Reinforcement Learning In Racing Games (2024)2.26
• AWAC: Accelerating Online Reinforcement Learning With Offline Datasets (2020)0.00
• Hokoff: Real Game Dataset From Honor Of Kings And Its Offline Reinforcement Learning Benchmarks (2024)0.00