Iterative Batch Reinforcement Learning Via Safe Diversified Model-based Policy Search

Abstract

Batch reinforcement learning enables policy learning without direct interaction with the environment during training, relying exclusively on previously collected sets of interactions. This approach is, therefore, well-suited for high-risk and cost-intensive applications, such as industrial control. Learned policies are commonly restricted to act in a similar fashion as observed in the batch. In a real-world scenario, learned policies are deployed in the industrial system, inevitably leading to the collection of new data that can subsequently be added to the existing recording. The process of learning and deployment can thus take place multiple times throughout the lifespan of a system. In this work, we propose to exploit this iterative nature of applying offline reinforcement learning to guide learned policies towards efficient and informative data collection during deployment, leading to continuous improvement of learned policies while remaining within the support of collected data. W

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keynajib2024iterative

Related papers

• Knowledge Transfer From Teachers To Learners In Growing-batch Reinforcement Learning (2023)0.00
• Off-policy Deep Reinforcement Learning Without Exploration (2018)0.00
• Stackelberg Batch Policy Learning (2023)0.00
• A Model-based Approach For Sample-efficient Multi-task Reinforcement Learning (2019)0.00
• Overcoming Model Bias For Robust Offline Deep Reinforcement Learning (2020)11.58
• Constrained Latent Action Policies For Model-based Offline Reinforcement Learning (2024)0.00
• Deployment-efficient Reinforcement Learning Via Model-based Offline Optimization (2020)0.00
• Gradient-aware Model-based Policy Search (2019)6.77