Combining Evolution And Deep Reinforcement Learning For Policy Search: A Survey

Abstract

Deep neuroevolution and deep Reinforcement Learning have received a lot of attention in the last years. Some works have compared them, highlighting theirs pros and cons, but an emerging trend consists in combining them so as to benefit from the best of both worlds. In this paper, we provide a survey of this emerging trend by organizing the literature into related groups of works and casting all the existing combinations in each group into a generic framework. We systematically cover all easily available papers irrespective of their publication status, focusing on the combination mechanisms rather than on the experimental results. In total, we cover 45 algorithms more recent than 2017. We hope this effort will favor the growth of the domain by facilitating the understanding of the relationships between the methods, leading to deeper analyses, outlining missing useful comparisons and suggesting new combinations of mechanisms.

Stats

• citations42
• S2 citations—
• github stars0
• HF likes0
• heat score12.25
• arxiv keysigaud2022combining

Related papers

• CEM-RL: Combining Evolutionary And Gradient-based Methods For Policy Search (2018)0.00
• Evolutionary Reinforcement Learning: A Survey (2023)13.93
• Collaborative Evolutionary Reinforcement Learning (2019)0.00
• Importance Mixing: Improving Sample Reuse In Evolutionary Policy Search Methods (2018)0.00
• Deep Reinforcement Learning Versus Evolution Strategies: A Comparative Survey (2021)0.00
• An Efficient Asynchronous Method For Integrating Evolutionary And Gradient-based Policy Search (2020)0.00
• Solving Deep Reinforcement Learning Tasks With Evolution Strategies And Linear Policy Networks (2024)0.00
• Erl-re\(^2\): Efficient Evolutionary Reinforcement Learning With Shared State Representation And Individual Policy Representation (2022)0.00