Meta-learning Within Projective Simulation

Abstract

Learning models of artificial intelligence can nowadays perform very well on a large variety of tasks. However, in practice different task environments are best handled by different learning models, rather than a single, universal, approach. Most non-trivial models thus require the adjustment of several to many learning parameters, which is often done on a case-by-case basis by an external party. Meta-learning refers to the ability of an agent to autonomously and dynamically adjust its own learning parameters, or meta-parameters. In this work we show how projective simulation, a recently developed model of artificial intelligence, can naturally be extended to account for meta-learning in reinforcement learning settings. The projective simulation approach is based on a random walk process over a network of clips. The suggested meta-learning scheme builds upon the same design and employs clip networks to monitor the agent's performance and to adjust its meta-parameters "on the fly". We d

Stats

• citations27
• S2 citations—
• github stars0
• HF likes0
• heat score10.85
• arxiv keymakmal2016meta

Related papers

• Metacontrol For Adaptive Imagination-based Optimization (2017)0.00
• Efficient Meta Reinforcement Learning For Preference-based Fast Adaptation (2022)0.00
• Context Meta-reinforcement Learning Via Neuromodulation (2021)6.34
• Procedural Generation Of Meta-reinforcement Learning Tasks (2023)0.00
• Meta-reinforcement Learning With Self-modifying Networks (2022)4.52
• Double Meta-learning For Data Efficient Policy Optimization In Non-stationary Environments (2020)0.00
• Deep Online Learning Via Meta-learning: Continual Adaptation For Model-based RL (2018)0.00
• Unsupervised Meta-learning For Reinforcement Learning (2018)0.00