Exploring Parity Challenges In Reinforcement Learning Through Curriculum Learning With Noisy Labels

Abstract

This paper delves into applying reinforcement learning (RL) in strategy games, particularly those characterized by parity challenges, as seen in specific positions of Go and Chess and a broader range of impartial games. We propose a simulated learning process, structured within a curriculum learning framework and augmented with noisy labels, to mirror the intricacies of self-play learning scenarios. This approach thoroughly analyses how neural networks (NNs) adapt and evolve from elementary to increasingly complex game positions. Our empirical research indicates that even minimal label noise can significantly impede NNs' ability to discern effective strategies, a difficulty that intensifies with the growing complexity of the game positions. These findings underscore the urgent need for advanced methodologies in RL training, specifically tailored to counter the obstacles imposed by noisy evaluations. The development of such methodologies is crucial not only for enhancing NN proficiency

Stats

• citations1
• S2 citations—
• github stars0
• HF likes0
• heat score2.26
• arxiv keyzhou2023exploring

Related papers

• Impartial Games: A Challenge For Reinforcement Learning (2022)0.00
• Adaptive Symmetric Reward Noising For Reinforcement Learning (2019)0.00
• Emergence Of In-context Reinforcement Learning From Noise Distillation (2023)0.00
• Generating Automatic Curricula Via Self-supervised Active Domain Randomization (2020)0.00
• Reinforcement Learning With Perturbed Rewards (2018)13.74
• Quantifying First-order Markov Violations In Noisy Reinforcement Learning: A Causal Discovery Approach (2025)0.00
• Disturbing Reinforcement Learning Agents With Corrupted Rewards (2021)0.00
• Noise As A Double-edged Sword: Reinforcement Learning Exploits Randomized Defenses In Neural Networks (2024)0.00