Universal Successor Representations For Transfer Reinforcement Learning

Abstract

The objective of transfer reinforcement learning is to generalize from a set of previous tasks to unseen new tasks. In this work, we focus on the transfer scenario where the dynamics among tasks are the same, but their goals differ. Although general value function (Sutton et al., 2011) has been shown to be useful for knowledge transfer, learning a universal value function can be challenging in practice. To attack this, we propose (1) to use universal successor representations (USR) to represent the transferable knowledge and (2) a USR approximator (USRA) that can be trained by interacting with the environment. Our experiments show that USR can be effectively applied to new tasks, and the agent initialized by the trained USRA can achieve the goal considerably faster than random initialization.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyma2018universal

Related papers

• Universal Successor Features Approximators (2018)0.00
• Successor Features For Transfer In Reinforcement Learning (2016)0.00
• Successor Feature Representations (2021)0.00
• Advantages And Limitations Of Using Successor Features For Transfer In Reinforcement Learning (2017)0.00
• A New Representation Of Successor Features For Transfer Across Dissimilar Environments (2021)0.00
• Successor Feature Sets: Generalizing Successor Representations Across Policies (2021)5.84
• Transfer With Model Features In Reinforcement Learning (2018)0.00
• A First-occupancy Representation For Reinforcement Learning (2021)0.00