Augmentative Topology Agents For Open-ended Learning

Abstract

In this work, we tackle the problem of open-ended learning by introducing a method that simultaneously evolves agents and increasingly challenging environments. Unlike previous open-ended approaches that optimize agents using a fixed neural network topology, we hypothesize that generalization can be improved by allowing agents' controllers to become more complex as they encounter more difficult environments. Our method, Augmentative Topology EPOET (ATEP), extends the Enhanced Paired Open-Ended Trailblazer (EPOET) algorithm by allowing agents to evolve their own neural network structures over time, adding complexity and capacity as necessary. Empirical results demonstrate that ATEP results in general agents capable of solving more environments than a fixed-topology baseline. We also investigate mechanisms for transferring agents between environments and find that a species-based approach further improves the performance and generalization of agents.

Stats

• citations1
• S2 citations—
• github stars0
• HF likes0
• heat score2.26
• arxiv keynasir2022augmentative

Related papers

• Open-ended Learning Leads To Generally Capable Agents (2021)0.00
• Robust Agents In Open-ended Worlds (2025)0.00
• MAESTRO: Open-ended Environment Design For Multi-agent Reinforcement Learning (2023)0.00
• Emergence Of Collective Open-ended Exploration From Decentralized Meta-reinforcement Learning (2023)0.00
• A Definition Of Open-ended Learning Problems For Goal-conditioned Agents (2023)0.00
• TAPE: Leveraging Agent Topology For Cooperative Multi-agent Policy Gradient (2023)3.58
• Agent-pro: Learning To Evolve Via Policy-level Reflection And Optimization (2024)9.59
• An Efficient Open World Environment For Multi-agent Social Learning (2025)0.00