Assessing Human Interaction In Virtual Reality With Continually Learning Prediction Agents Based On Reinforcement Learning Algorithms: A Pilot Study

Abstract

Artificial intelligence systems increasingly involve continual learning to enable flexibility in general situations that are not encountered during system training. Human interaction with autonomous systems is broadly studied, but research has hitherto under-explored interactions that occur while the system is actively learning, and can noticeably change its behaviour in minutes. In this pilot study, we investigate how the interaction between a human and a continually learning prediction agent develops as the agent develops competency. Additionally, we compare two different agent architectures to assess how representational choices in agent design affect the human-agent interaction. We develop a virtual reality environment and a time-based prediction task wherein learned predictions from a reinforcement learning (RL) algorithm augment human predictions. We assess how a participant's performance and behaviour in this task differs across agent types, using both quantitative and qualitati

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keybrenneis2021assessing

Related papers

• Improving Multimodal Interactive Agents With Reinforcement Learning From Human Feedback (2022)0.00
• Human AI Interaction Loop Training: New Approach For Interactive Reinforcement Learning (2020)0.00
• Can You See How I Learn? Human Observers' Inferences About Reinforcement Learning Agents' Learning Processes (2025)0.00
• Explore, Exploit Or Listen: Combining Human Feedback And Policy Model To Speed Up Deep Reinforcement Learning In 3D Worlds (2017)0.00
• Human Engagement Providing Evaluative And Informative Advice For Interactive Reinforcement Learning (2020)9.23
• Actor-critic Reinforcement Learning With Simultaneous Human Control And Feedback (2017)0.00
• Learning Complex Spatial Behaviours In ABM: An Experimental Observational Study (2022)0.00
• Accelerating Reinforcement Learning Agent With Eeg-based Implicit Human Feedback (2020)0.00