Lineage Evolution Reinforcement Learning

Abstract

We propose a general agent population learning system, and on this basis, we propose lineage evolution reinforcement learning algorithm. Lineage evolution reinforcement learning is a kind of derivative algorithm which accords with the general agent population learning system. We take the agents in DQN and its related variants as the basic agents in the population, and add the selection, mutation and crossover modules in the genetic algorithm to the reinforcement learning algorithm. In the process of agent evolution, we refer to the characteristics of natural genetic behavior, add lineage factor to ensure the retention of potential performance of agent, and comprehensively consider the current performance and lineage value when evaluating the performance of agent. Without changing the parameters of the original reinforcement learning algorithm, lineage evolution reinforcement learning can optimize different reinforcement learning algorithms. Our experiments show that the idea of evoluti

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyzhang2020lineage

Related papers

• The Evolutionary Dynamics Of Independent Learning Agents In Population Games (2020)0.00
• Supplementing Gradient-based Reinforcement Learning With Simple Evolutionary Ideas (2023)0.00
• Ancestral Reinforcement Learning: Unifying Zeroth-order Optimization And Genetic Algorithms For Reinforcement Learning (2024)0.00
• Evolution Of Societies Via Reinforcement Learning (2024)0.00
• Evolutionary Reinforcement Learning: A Survey (2023)13.93
• Evolution-guided Policy Gradient In Reinforcement Learning (2018)0.00
• The Evolution Theory Of Learning: From Natural Selection To Reinforcement Learning (2023)0.00
• Malthusian Reinforcement Learning (2018)0.00