Toybox: Better Atari Environments For Testing Reinforcement Learning Agents

Abstract

It is a widely accepted principle that software without tests has bugs. Testing reinforcement learning agents is especially difficult because of the stochastic nature of both agents and environments, the complexity of state-of-the-art models, and the sequential nature of their predictions. Recently, the Arcade Learning Environment (ALE) has become one of the most widely used benchmark suites for deep learning research, and state-of-the-art Reinforcement Learning (RL) agents have been shown to routinely equal or exceed human performance on many ALE tasks. Since ALE is based on emulation of original Atari games, the environment does not provide semantically meaningful representations of internal game state. This means that ALE has limited utility as an environment for supporting testing or model introspection. We propose ToyBox, a collection of reimplementations of these games that solves this critical problem and enables robust testing of RL agents.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyfoley2018toybox

Related papers

• Toybox: A Suite Of Environments For Experimental Evaluation Of Deep Reinforcement Learning (2019)0.00
• Hackatari: Atari Learning Environments For Robust And Continual Reinforcement Learning (2024)0.00
• A Review For Deep Reinforcement Learning In Atari:benchmarks, Challenges, And Solutions (2021)0.00
• Revisiting The Arcade Learning Environment: Evaluation Protocols And Open Problems For General Agents (2017)15.67
• Is Deep Reinforcement Learning Really Superhuman On Atari? Leveling The Playing Field (2019)0.00
• Reliable Validation Of Reinforcement Learning Benchmarks (2022)0.00
• Eden: A Unified Environment Framework For Booming Reinforcement Learning Algorithms (2021)0.00
• Fightladder: A Benchmark For Competitive Multi-agent Reinforcement Learning (2024)0.00