Bandit Social Learning With Exploration Episodes

Abstract

We study a stylized social learning dynamics where self-interested agents collectively follow a simple multi-armed bandit protocol. Each agent controls an ``episode": a short sequence of consecutive decisions. Motivating applications include users repeatedly interacting with an AI, or repeatedly shopping at a marketplace. While agents are incentivized to explore within their respective episodes, we show that the aggregate exploration fails: e.g., its Bayesian regret grows linearly over time. In fact, such failure is a (very) typical case, not just a worst-case scenario. This conclusion persists even if an agent's per-episode utility is some fixed function of the per-round outcomes: e.g., \(\min\) or \(\max\), not just the sum. Thus, externally driven exploration is needed even when some amount of exploration happens organically.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keybanihashem2026bandit

Related papers

• Bandit Social Learning: Exploration Under Myopic Behavior (2023)0.00
• Principal-agent Bandit Games With Self-interested And Exploratory Learning Agents (2024)0.00
• Near-optimal Collaborative Learning In Bandits (2022)0.00
• Exploiting Expertise Of Non-expert And Diverse Agents In Social Bandit Learning: A Free Energy Approach (2026)0.00
• Bayesian Bandits: Balancing The Exploration-exploitation Tradeoff Via Double Sampling (2017)0.00
• Efficient Reinforcement Learning Via Initial Pure Exploration (2017)0.00
• A New Bandit Setting Balancing Information From State Evolution And Corrupted Context (2020)0.00
• Online Learning With Costly Features In Non-stationary Environments (2023)0.00