Predicting Game Difficulty And Churn Without Players

Abstract

We propose a novel simulation model that is able to predict the per-level churn and pass rates of Angry Birds Dream Blast, a popular mobile free-to-play game. Our primary contribution is to combine AI gameplay using Deep Reinforcement Learning (DRL) with a simulation of how the player population evolves over the levels. The AI players predict level difficulty, which is used to drive a player population model with simulated skill, persistence, and boredom. This allows us to model, e.g., how less persistent and skilled players are more sensitive to high difficulty, and how such players churn early, which makes the player population and the relation between difficulty and churn evolve level by level. Our work demonstrates that player behavior predictions produced by DRL gameplay can be significantly improved by even a very simple population-level simulation of individual player differences, without requiring costly retraining of agents or collecting new DRL gameplay data for each simulate

Stats

• citations31
• S2 citations—
• github stars0
• HF likes0
• heat score11.29
• arxiv keyroohi2020predicting

Related papers

• Personalized Dynamic Difficulty Adjustment -- Imitation Learning Meets Reinforcement Learning (2024)0.00
• A Human Mixed Strategy Approach To Deep Reinforcement Learning (2018)7.50
• Testing Match-3 Video Games With Deep Reinforcement Learning (2020)0.00
• Angrier Birds: Bayesian Reinforcement Learning (2016)0.00
• Diagnosing And Exploiting The Computational Demands Of Videos Games For Deep Reinforcement Learning (2023)0.00
• Beyond Winning And Losing: Modeling Human Motivations And Behaviors Using Inverse Reinforcement Learning (2018)0.00
• Scaling Intelligent Agents In Combat Simulations For Wargaming (2024)0.00
• Towards Human-like RL: Taming Non-naturalistic Behavior In Deep RL Via Adaptive Behavioral Costs In 3D Games (2023)0.00