Efficacy Of Modern Neuro-evolutionary Strategies For Continuous Control Optimization

Abstract

We analyze the efficacy of modern neuro-evolutionary strategies for continuous control optimization. Overall, the results collected on a wide variety of qualitatively different benchmark problems indicate that these methods are generally effective and scale well with respect to the number of parameters and the complexity of the problem. Moreover, they are relatively robust with respect to the setting of hyper-parameters. The comparison of the most promising methods indicates that the OpenAI-ES algorithm outperforms or equals the other algorithms on all considered problems. Moreover, we demonstrate how the reward functions optimized for reinforcement learning methods are not necessarily effective for evolutionary strategies and vice versa. This finding can lead to reconsideration of the relative efficacy of the two classes of algorithm since it implies that the comparisons performed to date are biased toward one or the other class.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keypagliuca2019efficacy

Related papers

• Qualitative Differences Between Evolutionary Strategies And Reinforcement Learning Methods For Control Of Autonomous Agents (2022)0.00
• Neuroevolution Of Recurrent Architectures On Control Tasks (2023)4.52
• Comparing Deep Reinforcement Learning And Evolutionary Methods In Continuous Control (2017)0.00
• A Globally Convergent Evolutionary Strategy For Stochastic Constrained Optimization With Applications To Reinforcement Learning (2022)0.00
• Neural Architecture Evolution In Deep Reinforcement Learning For Continuous Control (2019)0.00
• Deep Reinforcement Learning Versus Evolution Strategies: A Comparative Survey (2021)0.00
• Effects Of Different Optimization Formulations In Evolutionary Reinforcement Learning On Diverse Behavior Generation (2021)2.26
• Online Hyper-parameter Tuning In Off-policy Learning Via Evolutionary Strategies (2020)0.00