Containergym: A Real-world Reinforcement Learning Benchmark For Resource Allocation

Abstract

We present ContainerGym, a benchmark for reinforcement learning inspired by a real-world industrial resource allocation task. The proposed benchmark encodes a range of challenges commonly encountered in real-world sequential decision making problems, such as uncertainty. It can be configured to instantiate problems of varying degrees of difficulty, e.g., in terms of variable dimensionality. Our benchmark differs from other reinforcement learning benchmarks, including the ones aiming to encode real-world difficulties, in that it is directly derived from a real-world industrial problem, which underwent minimal simplification and streamlining. It is sufficiently versatile to evaluate reinforcement learning algorithms on any real-world problem that fits our resource allocation framework. We provide results of standard baseline methods. Going beyond the usual training reward curves, our results and the statistical tools used to interpret them allow to highlight interesting limitations of we

Stats

• citations6
• S2 citations—
• github stars0
• HF likes0
• heat score6.34
• arxiv keypendyala2023containergym

Related papers

• Robust Gymnasium: A Unified Modular Benchmark For Robust Reinforcement Learning (2025)0.00
• Benchmark Environments For Multitask Learning In Continuous Domains (2017)0.00
• Leveraging Procedural Generation To Benchmark Reinforcement Learning (2019)0.00
• A Multi-task Approach To Robust Deep Reinforcement Learning For Resource Allocation (2023)0.00
• Multi-agent Reinforcement Learning For Resources Allocation Optimization: A Survey (2025)0.00
• Gymnasium: A Standard Interface For Reinforcement Learning Environments (2024)0.00
• Edugym: An Environment And Notebook Suite For Reinforcement Learning Education (2023)2.41
• CORA: Benchmarks, Baselines, And Metrics As A Platform For Continual Reinforcement Learning Agents (2021)0.00