Cleanrl: High-quality Single-file Implementations Of Deep Reinforcement Learning Algorithms

Abstract

CleanRL is an open-source library that provides high-quality single-file implementations of Deep Reinforcement Learning algorithms. It provides a simpler yet scalable developing experience by having a straightforward codebase and integrating production tools to help interact and scale experiments. In CleanRL, we put all details of an algorithm into a single file, making these performance-relevant details easier to recognize. Additionally, an experiment tracking feature is available to help log metrics, hyperparameters, videos of an agent's gameplay, dependencies, and more to the cloud. Despite succinct implementations, we have also designed tools to help scale, at one point orchestrating experiments on more than 2000 machines simultaneously via Docker and cloud providers. Finally, we have ensured the quality of the implementations by benchmarking against a variety of environments. The source code of CleanRL can be found at https://github.com/vwxyzjn/cleanrl

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyhuang2021cleanrl

Code

• vwxyzjn/cleanrl—

Related papers

• Cleanba: A Reproducible And Efficient Distributed Reinforcement Learning Platform (2023)4.19
• SLM Lab: A Comprehensive Benchmark And Modular Software Framework For Reproducible Deep Reinforcement Learning (2019)0.00
• CORL: Research-oriented Deep Offline Reinforcement Learning Library (2022)0.00
• Rltools: A Fast, Portable Deep Reinforcement Learning Library For Continuous Control (2023)0.00
• Scilab-rl: A Software Framework For Efficient Reinforcement Learning And Cognitive Modeling Research (2024)0.00
• Toybox: A Suite Of Environments For Experimental Evaluation Of Deep Reinforcement Learning (2019)0.00
• Efficient Reinforcement Learning Development With Rlzoo (2020)3.58
• Pearl: A Production-ready Reinforcement Learning Agent (2023)0.00