Policy Fusion For Adaptive And Customizable Reinforcement Learning Agents

Abstract

In this article we study the problem of training intelligent agents using Reinforcement Learning for the purpose of game development. Unlike systems built to replace human players and to achieve super-human performance, our agents aim to produce meaningful interactions with the player, and at the same time demonstrate behavioral traits as desired by game designers. We show how to combine distinct behavioral policies to obtain a meaningful "fusion" policy which comprises all these behaviors. To this end, we propose four different policy fusion methods for combining pre-trained policies. We further demonstrate how these methods can be used in combination with Inverse Reinforcement Learning in order to create intelligent agents with specific behavioral styles as chosen by game designers, without having to define many and possibly poorly-designed reward functions. Experiments on two different environments indicate that entropy-weighted policy fusion significantly outperforms all others. We

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keysestini2021policy

Related papers

• Flexible Attention-based Multi-policy Fusion For Efficient Deep Reinforcement Learning (2022)2.26
• Dynamic Policy Fusion For User Alignment Without Re-interaction (2024)0.00
• Blendrl: A Framework For Merging Symbolic And Neural Policy Learning (2024)0.00
• Policyevolve: Evolving Programmatic Policies By Llms For Multi-player Games Via Population-based Training (2025)0.00
• Winning Isn't Everything: Enhancing Game Development With Intelligent Agents (2019)11.29
• Learning From Learners: Adapting Reinforcement Learning Agents To Be Competitive In A Card Game (2020)0.00
• Data Efficient Training For Reinforcement Learning With Adaptive Behavior Policy Sharing (2020)0.00
• Policy Composition In Reinforcement Learning Via Multi-objective Policy Optimization (2023)0.00