Automatic Goal Generation For Reinforcement Learning Agents

Abstract

Reinforcement learning is a powerful technique to train an agent to perform a task. However, an agent that is trained using reinforcement learning is only capable of achieving the single task that is specified via its reward function. Such an approach does not scale well to settings in which an agent needs to perform a diverse set of tasks, such as navigating to varying positions in a room or moving objects to varying locations. Instead, we propose a method that allows an agent to automatically discover the range of tasks that it is capable of performing. We use a generator network to propose tasks for the agent to try to achieve, specified as goal states. The generator network is optimized using adversarial training to produce tasks that are always at the appropriate level of difficulty for the agent. Our method thus automatically produces a curriculum of tasks for the agent to learn. We show that, by using this framework, an agent can efficiently and automatically learn to perform a

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyflorensa2017automatic

Related papers

• Generating Automatic Curricula Via Self-supervised Active Domain Randomization (2020)0.00
• An Agent Design With Goal Reaching Guarantees For Enhancement Of Learning (2024)0.00
• Stein Variational Goal Generation For Adaptive Exploration In Multi-goal Reinforcement Learning (2022)0.00
• Procedural Generation Of Meta-reinforcement Learning Tasks (2023)0.00
• Unsupervised Learning Of Efficient Exploration: Pre-training Adaptive Policies Via Self-imposed Goals (2026)0.00
• Auxiliary Task Discovery Through Generate-and-test (2022)0.00
• Genai-based Multi-agent Reinforcement Learning Towards Distributed Agent Intelligence: A Generative-rl Agent Perspective (2025)0.00
• Learning With Amigo: Adversarially Motivated Intrinsic Goals (2020)0.00