Review Of Metrics To Measure The Stability, Robustness And Resilience Of Reinforcement Learning

Abstract

Reinforcement learning has received significant interest in recent years, due primarily to the successes of deep reinforcement learning at solving many challenging tasks such as playing Chess, Go and online computer games. However, with the increasing focus on reinforcement learning, applications outside of gaming and simulated environments require understanding the robustness, stability, and resilience of reinforcement learning methods. To this end, we conducted a comprehensive literature review to characterize the available literature on these three behaviors as they pertain to reinforcement learning. We classify the quantitative and theoretical approaches used to indicate or measure robustness, stability, and resilience behaviors. In addition, we identified the action or event to which the quantitative approaches were attempting to be stable, robust, or resilient. Finally, we provide a decision tree useful for selecting metrics to quantify the behaviors. We believe that this is the

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keypullum2022review

Related papers

• Measuring The Reliability Of Reinforcement Learning Algorithms (2019)4.43
• Metrics And Continuity In Reinforcement Learning (2021)0.00
• Criticality And Safety Margins For Reinforcement Learning (2024)0.00
• Trustworthy Reinforcement Learning Against Intrinsic Vulnerabilities: Robustness, Safety, And Generalizability (2022)0.00
• Reliable Validation Of Reinforcement Learning Benchmarks (2022)0.00
• Empirical Study On Robustness And Resilience In Cooperative Multi-agent Reinforcement Learning (2025)0.00
• How Much Can Change In A Year? Revisiting Evaluation In Multi-agent Reinforcement Learning (2023)0.00
• A Comprehensive Survey Of Reinforcement Learning: From Algorithms To Practical Challenges (2024)0.00