Discriminative Particle Filter Reinforcement Learning For Complex Partial Observations
2020 · Xiao Ma, Peter Karkus, David Hsu, et al.
Abstract
Deep reinforcement learning is successful in decision making for sophisticated games, such as Atari, Go, etc. However, real-world decision making often requires reasoning with partial information extracted from complex visual observations. This paper presents Discriminative Particle Filter Reinforcement Learning (DPFRL), a new reinforcement learning framework for complex partial observations. DPFRL encodes a differentiable particle filter in the neural network policy for explicit reasoning with partial observations over time. The particle filter maintains a belief using learned discriminative update, which is trained end-to-end for decision making. We show that using the discriminative update instead of standard generative models results in significantly improved performance, especially for tasks with complex visual observations, because they circumvent the difficulty of modeling complex observations that are irrelevant to decision making. In addition, to extract features from the part
Authors
(none)
Tags
Stats
Related papers
- On Improving Deep Reinforcement Learning For Pomdps (2017)0.00
- Learning Interpretable Policies In Hindsight-observable Pomdps Through Partially Supervised Reinforcement Learning (2024)2.26
- Deep Hierarchical Reinforcement Learning Algorithm In Partially Observable Markov Decision Processes (2018)12.87
- Provable Representation With Efficient Planning For Partial Observable Reinforcement Learning (2023)0.00
- Dynamic Deep-reinforcement-learning Algorithm In Partially Observable Markov Decision Processes (2023)0.00
- Provably Efficient Reinforcement Learning In Partially Observable Dynamical Systems (2022)0.00
- Real-time Recurrent Reinforcement Learning (2023)2.26
- Generalized Reinforcement Learning: Experience Particles, Action Operator, Reinforcement Field, Memory Association, And Decision Concepts (2022)0.00