Deep TAMER: Interactive Agent Shaping In High-dimensional State Spaces

Abstract

While recent advances in deep reinforcement learning have allowed autonomous learning agents to succeed at a variety of complex tasks, existing algorithms generally require a lot of training data. One way to increase the speed at which agents are able to learn to perform tasks is by leveraging the input of human trainers. Although such input can take many forms, real-time, scalar-valued feedback is especially useful in situations where it proves difficult or impossible for humans to provide expert demonstrations. Previous approaches have shown the usefulness of human input provided in this fashion (e.g., the TAMER framework), but they have thus far not considered high-dimensional state spaces or employed the use of deep learning. In this paper, we do both: we propose Deep TAMER, an extension of the TAMER framework that leverages the representational power of deep neural networks in order to learn complex tasks in just a short amount of time with a human trainer. We demonstrate Deep TAM

Stats

• citations91
• S2 citations—
• github stars0
• HF likes0
• heat score14.73
• arxiv keywarnell2017deep

Related papers

• DQN-TAMER: Human-in-the-loop Reinforcement Learning With Intractable Feedback (2018)0.00
• FRESH: Interactive Reward Shaping In High-dimensional State Spaces Using Human Feedback (2020)0.00
• Facial Feedback For Reinforcement Learning: A Case Study And Offline Analysis Using The TAMER Framework (2020)9.59
• Multi-agent Deep Reinforcement Learning With Human Strategies (2018)8.09
• Deep Multi-agent Reinforcement Learning With Hybrid Action Spaces Based On Maximum Entropy (2022)0.00
• A Further Exploration Of Deep Multi-agent Reinforcement Learning With Hybrid Action Space (2022)5.84
• Deep Multi-agent Reinforcement Learning With Discrete-continuous Hybrid Action Spaces (2019)12.47
• Hierarchical Deep Multiagent Reinforcement Learning With Temporal Abstraction (2018)0.00