State Chrono Representation For Enhancing Generalization In Reinforcement Learning

Abstract

In reinforcement learning with image-based inputs, it is crucial to establish a robust and generalizable state representation. Recent advancements in metric learning, such as deep bisimulation metric approaches, have shown promising results in learning structured low-dimensional representation space from pixel observations, where the distance between states is measured based on task-relevant features. However, these approaches face challenges in demanding generalization tasks and scenarios with non-informative rewards. This is because they fail to capture sufficient long-term information in the learned representations. To address these challenges, we propose a novel State Chrono Representation (SCR) approach. SCR augments state metric-based representations by incorporating extensive temporal information into the update step of bisimulation metric learning. It learns state distances within a temporal framework that considers both future dynamics and cumulative rewards over current and l

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keychen2024state

Related papers

• Simsr: Simple Distance-based State Representation For Deep Reinforcement Learning (2021)0.00
• Towards Robust Bisimulation Metric Learning (2021)0.00
• Generalization Across Observation Shifts In Reinforcement Learning (2023)0.00
• Time-myopic Go-explore: Learning A State Representation For The Go-explore Paradigm (2023)0.00
• Learning Temporally-consistent Representations For Data-efficient Reinforcement Learning (2021)0.00
• On The Generalization Of Representations In Reinforcement Learning (2022)0.00
• Contrastive Behavioral Similarity Embeddings For Generalization In Reinforcement Learning (2021)0.00
• Understanding Behavioral Metric Learning: A Large-scale Study On Distracting Reinforcement Learning Environments (2025)0.00