Understanding Adversarial Attacks On Observations In Deep Reinforcement Learning

Abstract

Deep reinforcement learning models are vulnerable to adversarial attacks that can decrease a victim's cumulative expected reward by manipulating the victim's observations. Despite the efficiency of previous optimization-based methods for generating adversarial noise in supervised learning, such methods might not be able to achieve the lowest cumulative reward since they do not explore the environmental dynamics in general. In this paper, we provide a framework to better understand the existing methods by reformulating the problem of adversarial attacks on reinforcement learning in the function space. Our reformulation generates an optimal adversary in the function space of the targeted attacks, repelling them via a generic two-stage framework. In the first stage, we train a deceptive policy by hacking the environment, and discover a set of trajectories routing to the lowest reward or the worst-case performance. Next, the adversary misleads the victim to imitate the deceptive policy by

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyqiaoben2021understanding

Related papers

• Observed Adversaries In Deep Reinforcement Learning (2022)0.00
• Adversarial Policies: Attacking Deep Reinforcement Learning (2019)0.00
• Defending Observation Attacks In Deep Reinforcement Learning Via Detection And Denoising (2022)0.00
• Targeted Adversarial Attacks On Deep Reinforcement Learning Policies Via Model Checking (2022)2.26
• Optimal Attack And Defense For Reinforcement Learning (2023)6.34
• Robust Deep Reinforcement Learning Against Adversarial Behavior Manipulation (2024)0.00
• Snooping Attacks On Deep Reinforcement Learning (2019)2.26
• Regret-based Defense In Adversarial Reinforcement Learning (2023)0.00