Syllabus: Portable Curricula For Reinforcement Learning Agents

Abstract

Curriculum learning has been a quiet, yet crucial component of many high-profile successes of reinforcement learning. Despite this, it is still a niche topic that is not directly supported by any of the major reinforcement learning libraries. These methods can improve the capabilities and generalization of RL agents, but often require complex changes to training code. We introduce Syllabus, a portable curriculum learning library, as a solution to this problem. Syllabus provides a universal API for curriculum learning, modular implementations of popular automatic curriculum learning methods, and infrastructure that allows them to be easily integrated with asynchronous training code in nearly any RL library. Syllabus provides a minimal API for core curriculum learning components, making it easier to design new algorithms and adapt existing ones to new environments. We demonstrate this by evaluating the algorithms in Syllabus on several new environments, each using agents written in a dif

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keysullivan2024syllabus

Related papers

• Learning Curriculum Policies For Reinforcement Learning (2018)5.24
• Curriculum Learning For Reinforcement Learning Domains: A Framework And Survey (2020)0.00
• Curriculum Learning With A Progression Function (2020)0.00
• Generating Automatic Curricula Via Self-supervised Active Domain Randomization (2020)0.00
• Towards Skilled Population Curriculum For Multi-agent Reinforcement Learning (2023)0.00
• Proximal Curriculum With Task Correlations For Deep Reinforcement Learning (2024)0.00
• Curriculum Learning For Cooperation In Multi-agent Reinforcement Learning (2023)0.00
• Learning Progress Driven Multi-agent Curriculum (2022)0.00