Cross-trajectory Representation Learning For Zero-shot Generalization In RL

Abstract

A highly desirable property of a reinforcement learning (RL) agent -- and a major difficulty for deep RL approaches -- is the ability to generalize policies learned on a few tasks over a high-dimensional observation space to similar tasks not seen during training. Many promising approaches to this challenge consider RL as a process of training two functions simultaneously: a complex nonlinear encoder that maps high-dimensional observations to a latent representation space, and a simple linear policy over this space. We posit that a superior encoder for zero-shot generalization in RL can be trained by using solely an auxiliary SSL objective if the training process encourages the encoder to map behaviorally similar observations to similar representations, as reward-based signal can cause overfitting in the encoder (Raileanu et al., 2021). We propose Cross-Trajectory Representation Learning (CTRL), a method that runs within an RL agent and conditions its encoder to recognize behavioral si

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keymazoure2021cross

Related papers

• A Unified Framework For Zero-shot Reinforcement Learning (2025)0.00
• Zero-shot Reinforcement Learning Via Function Encoders (2024)0.00
• Zero-shot Policy Learning With Spatial Temporal Rewarddecomposition On Contingency-aware Observation (2019)0.00
• Does Zero-shot Reinforcement Learning Exist? (2022)0.00
• On Zero-shot Reinforcement Learning (2025)0.00
• Inferring Behavior-specific Context Improves Zero-shot Generalization In Reinforcement Learning (2024)0.95
• Zero-shot Generalization Of Vision-based RL Without Data Augmentation (2024)0.00
• Improving Zero-shot Generalization In Offline Reinforcement Learning Using Generalized Similarity Functions (2021)2.26