Facial Feedback For Reinforcement Learning: A Case Study And Offline Analysis Using The TAMER Framework
2020 · Guangliang Li, Hamdi Dibeklioğlu, Shimon Whiteson, et al.
Abstract
Interactive reinforcement learning provides a way for agents to learn to solve tasks from evaluative feedback provided by a human user. Previous research showed that humans give copious feedback early in training but very sparsely thereafter. In this article, we investigate the potential of agent learning from trainers' facial expressions via interpreting them as evaluative feedback. To do so, we implemented TAMER which is a popular interactive reinforcement learning method in a reinforcement-learning benchmark problem --- Infinite Mario, and conducted the first large-scale study of TAMER involving 561 participants. With designed CNN-RNN model, our analysis shows that telling trainers to use facial expressions and competition can improve the accuracies for estimating positive and negative feedback using facial expressions. In addition, our results with a simulation experiment show that learning solely from predicted feedback based on facial expressions is possible and using strong/effe
Authors
(none)
Tags
Stats
Related papers
- DQN-TAMER: Human-in-the-loop Reinforcement Learning With Intractable Feedback (2018)0.00
- Improving Multimodal Interactive Agents With Reinforcement Learning From Human Feedback (2022)0.00
- Deep TAMER: Interactive Agent Shaping In High-dimensional State Spaces (2017)14.73
- Mapping Out The Space Of Human Feedback For Reinforcement Learning: A Conceptual Framework (2024)0.00
- Towards Reinforcement Learning From Neural Feedback: Mapping Fnirs Signals To Agent Performance (2025)0.00
- Actor-critic Reinforcement Learning With Simultaneous Human Control And Feedback (2017)0.00
- Convergence Of A Human-in-the-loop Policy-gradient Algorithm With Eligibility Trace Under Reward, Policy, And Advantage Feedback (2021)0.00
- Accelerating Reinforcement Learning Agent With Eeg-based Implicit Human Feedback (2020)0.00