Acme: A Research Framework For Distributed Reinforcement Learning

Abstract

Deep reinforcement learning (RL) has led to many recent and groundbreaking advances. However, these advances have often come at the cost of both increased scale in the underlying architectures being trained as well as increased complexity of the RL algorithms used to train them. These increases have in turn made it more difficult for researchers to rapidly prototype new ideas or reproduce published RL algorithms. To address these concerns this work describes Acme, a framework for constructing novel RL algorithms that is specifically designed to enable agents that are built using simple, modular components that can be used at various scales of execution. While the primary goal of Acme is to provide a framework for algorithm development, a secondary goal is to provide simple reference implementations of important or state-of-the-art algorithms. These implementations serve both as a validation of our design decisions as well as an important contribution to reproducibility in RL research.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyhoffman2020acme

Related papers

• Dopamine: A Research Framework For Deep Reinforcement Learning (2018)0.00
• Accerl: Policy Acceleration Framework For Deep Reinforcement Learning (2022)0.00
• Integrating Distributed Architectures In Highly Modular RL Libraries (2020)0.00
• A Reference Architecture Of Reinforcement Learning Frameworks (2026)0.00
• The AI Arena: A Framework For Distributed Multi-agent Reinforcement Learning (2021)0.00
• A Comprehensive Survey Of Reinforcement Learning: From Algorithms To Practical Challenges (2024)0.00
• Human-inspired Framework To Accelerate Reinforcement Learning (2023)0.00
• Rllib: Abstractions For Distributed Reinforcement Learning (2017)0.00