Deception In Social Learning: A Multi-agent Reinforcement Learning Perspective

Abstract

Within the framework of Multi-Agent Reinforcement Learning, Social Learning is a new class of algorithms that enables agents to reshape the reward function of other agents with the goal of promoting cooperation and achieving higher global rewards in mixed-motive games. However, this new modification allows agents unprecedented access to each other's learning process, which can drastically increase the risk of manipulation when an agent does not realize it is being deceived into adopting policies which are not actually in its own best interest. This research review introduces the problem statement, defines key concepts, critically evaluates existing evidence and addresses open problems that should be addressed in future research.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keychelarescu2021deception

Related papers

• Emergent Social Learning Via Multi-agent Reinforcement Learning (2020)0.00
• Understanding The World To Solve Social Dilemmas Using Multi-agent Reinforcement Learning (2023)0.00
• Evolutionary Multi-agent Reinforcement Learning In Group Social Dilemmas (2024)0.00
• Learning Through Probing: A Decentralized Reinforcement Learning Architecture For Social Dilemmas (2018)0.00
• Social Learning Spontaneously Emerges By Searching Optimal Heuristics With Deep Reinforcement Learning (2022)0.00
• Deep Multiagent Reinforcement Learning: Challenges And Directions (2021)0.00
• Honesty Is The Best Policy: Defining And Mitigating AI Deception (2023)0.00
• Fully Decentralized Cooperative Multi-agent Reinforcement Learning: A Survey (2024)0.00