Learning User-defined Sub-goals Using Memory Editing In Reinforcement Learning

Abstract

The aim of reinforcement learning (RL) is to allow the agent to achieve the final goal. Most RL studies have focused on improving the efficiency of learning to achieve the final goal faster. However, the RL model is very difficult to modify an intermediate route in the process of reaching the final goal. That is, the agent cannot be under control to achieve other sub-goals in the existing studies. If the agent can go through the sub-goals on the way to the destination, the RL can be applied and studied in various fields. In this study, I propose a methodology to achieve the user-defined sub-goals as well as the final goal using memory editing. The memory editing is performed to generate various sub-goals and give an additional reward to the agent. In addition, the sub-goals are separately learned from the final goal. I set two simple environments and various scenarios in the test environments. As a result, the agent almost successfully passed the sub-goals as well as the final goal und

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keylee2022learning

Related papers

• An Agent Design With Goal Reaching Guarantees For Enhancement Of Learning (2024)0.00
• Computational Benefits Of Intermediate Rewards For Goal-reaching Policy Learning (2021)0.00
• Subgoal-based Reward Shaping To Improve Efficiency In Reinforcement Learning (2021)0.00
• Learning To Reach Goals Via Iterated Supervised Learning (2019)0.00
• Learning With Amigo: Adversarially Motivated Intrinsic Goals (2020)0.00
• Userrl: Training Interactive User-centric Agent Via Reinforcement Learning (2025)0.00
• Unsupervised Predictive Memory In A Goal-directed Agent (2018)0.00
• Goal-driven Reward By Video Diffusion Models For Reinforcement Learning (2025)0.00