Revisiting The Arcade Learning Environment: Evaluation Protocols And Open Problems For General Agents

Abstract

The Arcade Learning Environment (ALE) is an evaluation platform that poses the challenge of building AI agents with general competency across dozens of Atari 2600 games. It supports a variety of different problem settings and it has been receiving increasing attention from the scientific community, leading to some high-profile success stories such as the much publicized Deep Q-Networks (DQN). In this article we take a big picture look at how the ALE is being used by the research community. We show how diverse the evaluation methodologies in the ALE have become with time, and highlight some key concerns when evaluating agents in the ALE. We use this discussion to present some methodological best practices and provide new benchmark results using these best practices. To further the progress in the field, we introduce a new version of the ALE that supports multiple game modes and provides a form of stochasticity we call sticky actions. We conclude this big picture look by revisiting chall

Stats

• citations122
• S2 citations—
• github stars0
• HF likes0
• heat score15.67
• arxiv keymachado2017revisiting

Related papers

• A Review For Deep Reinforcement Learning In Atari:benchmarks, Challenges, And Solutions (2021)0.00
• CALE: Continuous Arcade Learning Environment (2024)0.00
• Toybox: Better Atari Environments For Testing Reinforcement Learning Agents (2018)0.00
• Is Deep Reinforcement Learning Really Superhuman On Atari? Leveling The Playing Field (2019)0.00
• Multiplayer Support For The Arcade Learning Environment (2020)0.00
• Hackatari: Atari Learning Environments For Robust And Continual Reinforcement Learning (2024)0.00
• The AI Arena: A Framework For Distributed Multi-agent Reinforcement Learning (2021)0.00
• Winning Isn't Everything: Enhancing Game Development With Intelligent Agents (2019)11.29