Alpha MAML: Adaptive Model-agnostic Meta-learning

Abstract

Model-agnostic meta-learning (MAML) is a meta-learning technique to train a model on a multitude of learning tasks in a way that primes the model for few-shot learning of new tasks. The MAML algorithm performs well on few-shot learning problems in classification, regression, and fine-tuning of policy gradients in reinforcement learning, but comes with the need for costly hyperparameter tuning for training stability. We address this shortcoming by introducing an extension to MAML, called Alpha MAML, to incorporate an online hyperparameter adaptation scheme that eliminates the need to tune meta-learning and learning rates. Our results with the Omniglot database demonstrate a substantial reduction in the need to tune MAML training hyperparameters and improvement to training stability with less sensitivity to hyperparameter choice.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keybehl2019alpha

Related papers

• On The Convergence Theory Of Debiased Model-agnostic Meta-reinforcement Learning (2020)0.00
• Exploring The Similarity Of Representations In Model-agnostic Meta-learning (2021)0.00
• Model-based Adversarial Meta-reinforcement Learning (2020)0.00
• Online Meta-learning By Parallel Algorithm Competition (2017)8.35
• Metacontrol For Adaptive Imagination-based Optimization (2017)0.00
• Meta-learning Linear Quadratic Regulators: A Policy Gradient MAML Approach For Model-free LQR (2024)0.00
• Distributionally Adaptive Meta Reinforcement Learning (2022)2.26
• Deep Online Learning Via Meta-learning: Continual Adaptation For Model-based RL (2018)0.00