Adaptable Automation With Modular Deep Reinforcement Learning And Policy Transfer

Abstract

Recent advances in deep Reinforcement Learning (RL) have created unprecedented opportunities for intelligent automation, where a machine can autonomously learn an optimal policy for performing a given task. However, current deep RL algorithms predominantly specialize in a narrow range of tasks, are sample inefficient, and lack sufficient stability, which in turn hinder their industrial adoption. This article tackles this limitation by developing and testing a Hyper-Actor Soft Actor-Critic (HASAC) RL framework based on the notions of task modularization and transfer learning. The goal of the proposed HASAC is to enhance the adaptability of an agent to new tasks by transferring the learned policies of former tasks to the new task via a "hyper-actor". The HASAC framework is tested on a new virtual robotic manipulation benchmark, Meta-World. Numerical experiments show superior performance by HASAC over state-of-the-art deep RL algorithms in terms of reward value, success rate, and task com

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyraziei2020adaptable

Related papers

• Boosting Hierarchical Reinforcement Learning With Meta-learning For Complex Task Adaptation (2024)0.00
• Human-inspired Framework To Accelerate Reinforcement Learning (2023)0.00
• Robustifying A Policy In Multi-agent RL With Diverse Cooperative Behaviors And Adversarial Style Sampling For Assistive Tasks (2024)0.00
• Deep Multi-agent Reinforcement Learning With Hybrid Action Spaces Based On Maximum Entropy (2022)0.00
• Hierarchical Meta-reinforcement Learning Via Automated Macro-action Discovery (2024)0.00
• Sample-efficient Automated Deep Reinforcement Learning (2020)0.00
• Discrete And Continuous Action Representation For Practical RL In Video Games (2019)0.00
• A Further Exploration Of Deep Multi-agent Reinforcement Learning With Hybrid Action Space (2022)5.84