Collaborative Training Of Heterogeneous Reinforcement Learning Agents In Environments With Sparse Rewards: What And When To Share?

Abstract

In the early stages of human life, babies develop their skills by exploring different scenarios motivated by their inherent satisfaction rather than by extrinsic rewards from the environment. This behavior, referred to as intrinsic motivation, has emerged as one solution to address the exploration challenge derived from reinforcement learning environments with sparse rewards. Diverse exploration approaches have been proposed to accelerate the learning process over single- and multi-agent problems with homogeneous agents. However, scarce studies have elaborated on collaborative learning frameworks between heterogeneous agents deployed into the same environment, but interacting with different instances of the latter without any prior knowledge. Beyond the heterogeneity, each agent's characteristics grant access only to a subset of the full state space, which may hide different exploration strategies and optimal solutions. In this work we combine ideas from intrinsic motivation and transf

Stats

• citations6
• S2 citations—
• github stars0
• HF likes0
• heat score6.34
• arxiv keyandres2022collaborative

Related papers

• Coordinated Exploration Via Intrinsic Rewards For Multi-agent Reinforcement Learning (2019)0.00
• Cautiously-optimistic Knowledge Sharing For Cooperative Multi-agent Reinforcement Learning (2023)5.84
• Collaborating With Humans Without Human Data (2021)0.00
• Curiosity-driven Multi-agent Exploration With Mixed Objectives (2022)0.00
• Experience Sharing Between Cooperative Reinforcement Learning Agents (2019)0.00
• Individual Specialization In Multi-task Environments With Multiagent Reinforcement Learners (2019)0.00
• The Impact Of Behavioral Diversity In Multi-agent Reinforcement Learning (2024)0.00
• Learning Heterogeneous Agent Cooperation Via Multiagent League Training (2022)7.16