Diverse Exploration Via Conjugate Policies For Policy Gradient Methods

Abstract

We address the challenge of effective exploration while maintaining good performance in policy gradient methods. As a solution, we propose diverse exploration (DE) via conjugate policies. DE learns and deploys a set of conjugate policies which can be conveniently generated as a byproduct of conjugate gradient descent. We provide both theoretical and empirical results showing the effectiveness of DE at achieving exploration, improving policy performance, and the advantage of DE over exploration by random policy perturbations.

Stats

• citations3
• S2 citations—
• github stars0
• HF likes0
• heat score4.52
• arxiv keycohen2019diverse

Related papers

• Diverse Exploration For Fast And Safe Policy Improvement (2018)4.52
• Learning To Explore With Meta-policy Gradient (2018)0.00
• Diversity-inducing Policy Gradient: Using Maximum Mean Discrepancy To Find A Set Of Diverse Policies (2019)8.35
• Behind The Myth Of Exploration In Policy Gradients (2024)0.00
• PC-PG: Policy Cover Directed Exploration For Provable Policy Gradient Learning (2020)0.00
• Improving Policy Gradient By Exploring Under-appreciated Rewards (2016)0.00
• Curious Explorer: A Provable Exploration Strategy In Policy Learning (2021)0.00
• Policy Gradient From Demonstration And Curiosity (2020)0.00