Emergence Of Chemotactic Strategies With Multi-agent Reinforcement Learning

Abstract

Reinforcement learning (RL) is a flexible and efficient method for programming micro-robots in complex environments. Here we investigate whether reinforcement learning can provide insights into biological systems when trained to perform chemotaxis. Namely, whether we can learn about how intelligent agents process given information in order to swim towards a target. We run simulations covering a range of agent shapes, sizes, and swim speeds to determine if the physical constraints on biological swimmers, namely Brownian motion, lead to regions where reinforcement learners' training fails. We find that the RL agents can perform chemotaxis as soon as it is physically possible and, in some cases, even before the active swimming overpowers the stochastic environment. We study the efficiency of the emergent policy and identify convergence in agent size and swim speeds. Finally, we study the strategy adopted by the reinforcement learning algorithm to explain how the agents perform their tasks

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keytovey2024emergence

Related papers

• Learning Optimal Integration Of Spatial And Temporal Information In Noisy Chemotaxis (2023)6.77
• From Pheromones To Policies: Reinforcement Learning For Engineered Biological Swarms (2025)0.00
• Emergent Social Learning Via Multi-agent Reinforcement Learning (2020)0.00
• Pool: Pheromone-inspired Communication Framework Forlarge Scale Multi-agent Reinforcement Learning (2022)5.24
• Discovering Individual Rewards In Collective Behavior Through Inverse Multi-agent Reinforcement Learning (2023)0.00
• Multi-agent Reinforcement Learning: A Report On Challenges And Approaches (2018)0.00
• Deep Reinforcement Learning For Multi-agent Systems: A Review Of Challenges, Solutions And Applications (2018)22.57
• Reinforcement Learning With Brain-inspired Modulation Can Improve Adaptation To Environmental Changes (2022)0.00