Multi-objective Deep Reinforcement Learning For Optimisation In Autonomous Systems

Abstract

Reinforcement Learning (RL) is used extensively in Autonomous Systems (AS) as it enables learning at runtime without the need for a model of the environment or predefined actions. However, most applications of RL in AS, such as those based on Q-learning, can only optimize one objective, making it necessary in multi-objective systems to combine multiple objectives in a single objective function with predefined weights. A number of Multi-Objective Reinforcement Learning (MORL) techniques exist but they have mostly been applied in RL benchmarks rather than real-world AS systems. In this work, we use a MORL technique called Deep W-Learning (DWN) and apply it to the Emergent Web Servers exemplar, a self-adaptive server, to find the optimal configuration for runtime performance optimization. We compare DWN to two single-objective optimization implementations: \{\epsilon\}-greedy algorithm and Deep Q-Networks. Our initial evaluation shows that DWN optimizes multiple objectives simultaneously

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyrosero2024multi

Related papers

• Addressing The Issue Of Stochastic Environments And Local Decision-making In Multi-objective Reinforcement Learning (2022)0.00
• Control-optimized Deep Reinforcement Learning For Artificially Intelligent Autonomous Systems (2025)0.00
• Modular Multi-objective Deep Reinforcement Learning With Decision Values (2017)10.74
• Meta-gradient Reinforcement Learning With An Objective Discovered Online (2020)0.00
• Interpretability By Design For Efficient Multi-objective Reinforcement Learning (2025)0.00
• Multi-objective Reinforcement Learning Based On Decomposition: A Taxonomy And Framework (2023)9.92
• On Generalization Across Environments In Multi-objective Reinforcement Learning (2025)0.00
• Robust Model-free Reinforcement Learning With Multi-objective Bayesian Optimization (2019)11.08