Improving Robustness Of Reinforcement Learning For Power System Control With Adversarial Training

Abstract

Due to the proliferation of renewable energy and its intrinsic intermittency and stochasticity, current power systems face severe operational challenges. Data-driven decision-making algorithms from reinforcement learning (RL) offer a solution towards efficiently operating a clean energy system. Although RL algorithms achieve promising performance compared to model-based control models, there has been limited investigation of RL robustness in safety-critical physical systems. In this work, we first show that several competition-winning, state-of-the-art RL agents proposed for power system control are vulnerable to adversarial attacks. Specifically, we use an adversary Markov Decision Process to learn an attack policy, and demonstrate the potency of our attack by successfully attacking multiple winning agents from the Learning To Run a Power Network (L2RPN) challenge, under both white-box and black-box attack settings. We then propose to use adversarial training to increase the robustnes

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keypan2021improving

Related papers

• Learning To Cope With Adversarial Attacks (2019)0.00
• Robust Deep Reinforcement Learning Through Adversarial Attacks And Training : A Survey (2024)0.00
• Robust Reinforcement Learning On State Observations With Learned Optimal Adversary (2021)0.00
• Optimal Attack And Defense For Reinforcement Learning (2023)6.34
• Adversarial Policies: Attacking Deep Reinforcement Learning (2019)0.00
• Online Robust Policy Learning In The Presence Of Unknown Adversaries (2018)0.00
• Towards Robust Policy: Enhancing Offline Reinforcement Learning With Adversarial Attacks And Defenses (2024)3.58
• Attacking And Defending Deep Reinforcement Learning Policies (2022)0.00