SALSA-RL: Stability Analysis In The Latent Space Of Actions For Reinforcement Learning
2025 Β· Xuyang Li, Romit Maulik
Abstract
Modern deep reinforcement learning (DRL) methods have made significant advances in handling continuous action spaces. However, real-world control systems, especially those requiring precise and reliable performance, often demand interpretability in the sense of a-priori assessments of agent behavior to identify safe or failure-prone interactions with environments. To address this limitation, this work proposes SALSA-RL (Stability Analysis in the Latent Space of Actions), a novel RL framework that models control actions as dynamic, time-dependent variables evolving within a latent space. By employing a pre-trained encoder-decoder and a state-dependent linear system, this approach enables interpretability through local stability analysis, where instantaneous growth in action-norms can be predicted before their execution. It is demonstrated that SALSA-RL can be deployed in a non-invasive manner for assessing the local stability of actions from pretrained RL agents without compromising on
Authors
(none)
Tags
Stats
Related papers
- Taming "data-hungry" Reinforcement Learning? Stability In Continuous State-action Spaces (2024)2.26
- Actsafe: Active Exploration With Safety Constraints For Reinforcement Learning (2024)0.00
- Dynamic Reinforcement Learning For Actors (2025)0.00
- Discrete And Continuous Action Representation For Practical RL In Video Games (2019)0.00
- Control-optimized Deep Reinforcement Learning For Artificially Intelligent Autonomous Systems (2025)0.00
- Safe Continual Reinforcement Learning In Non-stationary Environments (2026)12.89
- Implicit Safe Set Algorithm For Provably Safe Reinforcement Learning (2024)0.00
- Interpretable Learning Dynamics In Unsupervised Reinforcement Learning (2025)0.00