Domain-level Explainability -- A Challenge For Creating Trust In Superhuman AI Strategies

Abstract

For strategic problems, intelligent systems based on Deep Reinforcement Learning (DRL) have demonstrated an impressive ability to learn advanced solutions that can go far beyond human capabilities, especially when dealing with complex scenarios. While this creates new opportunities for the development of intelligent assistance systems with groundbreaking functionalities, applying this technology to real-world problems carries significant risks and therefore requires trust in their transparency and reliability. With superhuman strategies being non-intuitive and complex by definition and real-world scenarios prohibiting a reliable performance evaluation, the key components for trust in these systems are difficult to achieve. Explainable AI (XAI) has successfully increased transparency for modern AI systems through a variety of measures, however, XAI research has not yet provided approaches enabling domain level insights for expert users in strategic situations. In this paper, we discuss

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyandrulis2020domain

Related papers

• Explainable Artificial Intelligence (XAI) For Increasing User Trust In Deep Reinforcement Learning Driven Autonomous Systems (2021)0.00
• Explainability In Deep Reinforcement Learning (2020)0.00
• Explainability In Deep Reinforcement Learning, A Review Into Current Methods And Applications (2022)12.33
• Utilizing Explainability Techniques For Reinforcement Learning Model Assurance (2023)2.16
• Brittle AI, Causal Confusion, And Bad Mental Models: Challenges And Successes In The XAI Program (2021)0.00
• Explainable Deep Reinforcement Learning: State Of The Art And Challenges (2023)15.80
• A Survey Of Explainable Reinforcement Learning: Targets, Methods And Needs (2025)0.00
• Redefining Counterfactual Explanations For Reinforcement Learning: Overview, Challenges And Opportunities (2022)0.00