Explaining Online Reinforcement Learning Decisions Of Self-adaptive Systems

Abstract

Design time uncertainty poses an important challenge when developing a self-adaptive system. As an example, defining how the system should adapt when facing a new environment state, requires understanding the precise effect of an adaptation, which may not be known at design time. Online reinforcement learning, i.e., employing reinforcement learning (RL) at runtime, is an emerging approach to realizing self-adaptive systems in the presence of design time uncertainty. By using Online RL, the self-adaptive system can learn from actual operational data and leverage feedback only available at runtime. Recently, Deep RL is gaining interest. Deep RL represents learned knowledge as a neural network whereby it can generalize over unseen inputs, as well as handle continuous environment states and adaptation actions. A fundamental problem of Deep RL is that learned knowledge is not explicitly represented. For a human, it is practically impossible to relate the parametrization of the neural networ

Stats

• citations18
• S2 citations—
• github stars0
• HF likes0
• heat score9.59
• arxiv keyfeit2022explaining

Related papers

• Demystifying Reinforcement Learning In Time-varying Systems (2022)0.00
• Learning A Subspace Of Policies For Online Adaptation In Reinforcement Learning (2021)0.00
• Automated Reinforcement Learning: An Overview (2022)0.00
• Deep Online Learning Via Meta-learning: Continual Adaptation For Model-based RL (2018)0.00
• Learning To Cope With Adversarial Attacks (2019)0.00
• Towards Data-driven Offline Simulations For Online Reinforcement Learning (2022)0.00
• Adapting The Function Approximation Architecture In Online Reinforcement Learning (2021)0.00
• Experiential Explanations For Reinforcement Learning (2022)2.26