An Approach To Partial Observability In Games: Learning To Both Act And Observe

Abstract

Reinforcement learning (RL) is successful at learning to play games where the entire environment is visible. However, RL approaches are challenged in complex games like Starcraft II and in real-world environments where the entire environment is not visible. In these more complex games with more limited visual information, agents must choose where to look and how to optimally use their limited visual information in order to succeed at the game. We verify that with a relatively simple model the agent can learn where to look in scenarios with a limited visual bandwidth. We develop a method for masking part of the environment in Atari games to force the RL agent to learn both where to look and how to play the game in order to study where the RL agent learns to look. In addition, we develop a neural network architecture and method for allowing the agent to choose where to look and what action to take in the Pong game. Further, we analyze the strategies the agent learns to better understand

Stats

• citations2
• S2 citations—
• github stars0
• HF likes0
• heat score3.58
• arxiv keygilmour2021an

Related papers

• Reinforcement Learning Under Partial Observability Guided By Learned Environment Models (2022)6.34
• High-level Strategy Selection Under Partial Observability In Starcraft: Brood War (2018)0.00
• Model-based Reinforcement Learning For Atari (2019)0.00
• On Improving Deep Reinforcement Learning For Pomdps (2017)0.00
• Revealing The Learning Process In Reinforcement Learning Agents Through Attention-oriented Metrics (2024)0.00
• Supervised And Reinforcement Learning From Observations In Reconnaissance Blind Chess (2022)7.16
• Diagnosing And Exploiting The Computational Demands Of Videos Games For Deep Reinforcement Learning (2023)0.00
• Sample-efficient Reinforcement Learning Of Partially Observable Markov Games (2022)0.00