Proximal Policy Optimization With Adaptive Exploration

Abstract

Proximal Policy Optimization with Adaptive Exploration (axPPO) is introduced as a novel learning algorithm. This paper investigates the exploration-exploitation tradeoff within the context of reinforcement learning and aims to contribute new insights into reinforcement learning algorithm design. The proposed adaptive exploration framework dynamically adjusts the exploration magnitude during training based on the recent performance of the agent. Our proposed method outperforms standard PPO algorithms in learning efficiency, particularly when significant exploratory behavior is needed at the beginning of the learning process.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keylixandru2024proximal

Related papers

• Proximal Policy Optimization Via Enhanced Exploration Efficiency (2020)13.70
• Policy Optimization With Model-based Explorations (2018)5.84
• Proximal Policy Optimization Algorithms (2017)0.00
• Truly Proximal Policy Optimization (2019)0.00
• KIPPO: Koopman-inspired Proximal Policy Optimization (2025)0.00
• Provably Efficient Exploration In Policy Optimization (2019)0.00
• Revisiting Design Choices In Proximal Policy Optimization (2020)0.00
• AM-PPO: (advantage) Alpha-modulation With Proximal Policy Optimization (2025)0.00