Action-adaptive Continual Learning: Enabling Policy Generalization Under Dynamic Action Spaces

Abstract

Continual Learning (CL) is a powerful tool that enables agents to learn a sequence of tasks, accumulating knowledge learned in the past and using it for problem-solving or future task learning. However, existing CL methods often assume that the agent's capabilities remain static within dynamic environments, which doesn't reflect real-world scenarios where capabilities dynamically change. This paper introduces a new and realistic problem: Continual Learning with Dynamic Capabilities (CL-DC), posing a significant challenge for CL agents: How can policy generalization across different action spaces be achieved? Inspired by the cortical functions, we propose an Action-Adaptive Continual Learning framework (AACL) to address this challenge. Our framework decouples the agent's policy from the specific action space by building an action representation space. For a new action space, the encoder-decoder of action representations is adaptively fine-tuned to maintain a balance between stability an

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keypan2025action

Related papers

• Deep RL With Information Constrained Policies: Generalization In Continuous Control (2020)0.00
• Dynamics-adaptive Continual Reinforcement Learning Via Progressive Contextualization (2022)7.16
• Curriculum Learning With Counterfactual Group Relative Policy Advantage For Multi-agent Reinforcement Learning (2025)0.00
• Task-agnostic Continual Reinforcement Learning: Gaining Insights And Overcoming Challenges (2022)0.00
• Growing Action Spaces (2019)0.00
• Continual Knowledge Adaptation For Reinforcement Learning (2025)0.00
• Demonstration-guided Continual Reinforcement Learning In Dynamic Environments (2025)0.00
• Learning In Complex Action Spaces Without Policy Gradients (2024)0.00