Generalizing Across Multi-objective Reward Functions In Deep Reinforcement Learning

Abstract

Many reinforcement-learning researchers treat the reward function as a part of the environment, meaning that the agent can only know the reward of a state if it encounters that state in a trial run. However, we argue that this is an unnecessary limitation and instead, the reward function should be provided to the learning algorithm. The advantage is that the algorithm can then use the reward function to check the reward for states that the agent hasn't even encountered yet. In addition, the algorithm can simultaneously learn policies for multiple reward functions. For each state, the algorithm would calculate the reward using each of the reward functions and add the rewards to its experience replay dataset. The Hindsight Experience Replay algorithm developed by Andrychowicz et al. (2017) does just this, and learns to generalize across a distribution of sparse, goal-based rewards. We extend this algorithm to linearly-weighted, multi-objective rewards and learn a single policy that can g

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyfriedman2018generalizing

Related papers

• Dense And Diverse Goal Coverage In Multi Goal Reinforcement Learning (2025)0.00
• On Generalization Across Environments In Multi-objective Reinforcement Learning (2025)0.00
• Distributional Reinforcement Learning For Multi-dimensional Reward Functions (2021)0.00
• Reward Models In Deep Reinforcement Learning: A Survey (2025)0.00
• Scalable Agent Alignment Via Reward Modeling: A Research Direction (2018)0.00
• Coordinated Exploration Via Intrinsic Rewards For Multi-agent Reinforcement Learning (2019)0.00
• Reward Dimension Reduction For Scalable Multi-objective Reinforcement Learning (2025)0.00
• Distributional Reward Estimation For Effective Multi-agent Deep Reinforcement Learning (2022)0.00