Learning Optimal Integration Of Spatial And Temporal Information In Noisy Chemotaxis
2023 · Albert Alonso, Julius B. Kirkegaard
Abstract
We investigate the boundary between chemotaxis driven by spatial estimation of gradients and chemotaxis driven by temporal estimation. While it is well known that spatial chemotaxis becomes disadvantageous for small organisms at high noise levels, it is unclear whether there is a discontinuous switch of optimal strategies or a continuous transition exists. Here, we employ deep reinforcement learning to study the possible integration of spatial and temporal information in an a priori unconstrained manner. We parameterize such a combined chemotactic policy by a recurrent neural network and evaluate it using a minimal theoretical model of a chemotactic cell. By comparing with constrained variants of the policy, we show that it converges to purely temporal and spatial strategies at small and large cell sizes, respectively. We find that the transition between the regimes is continuous, with the combined strategy outperforming in the transition region both the constrained variants as well as
Authors
(none)
Tags
Stats
Related papers
- Emergence Of Chemotactic Strategies With Multi-agent Reinforcement Learning (2024)0.00
- Learning When To Switch: Adaptive Policy Selection Via Reinforcement Learning (2025)0.00
- Hybrid Belief Reinforcement Learning For Efficient Coordinated Spatial Exploration (2026)0.00
- Non-parametric Stochastic Policy Gradient With Strategic Retreat For Non-stationary Environment (2022)0.00
- RLOC: Neurobiologically Inspired Hierarchical Reinforcement Learning Algorithm For Continuous Control Of Nonlinear Dynamical Systems (2019)0.00
- Learning When To Act: Interval-aware Reinforcement Learning With Predictive Temporal Structure (2026)0.00
- Learning Robust And Adaptive Real-world Continuous Control Using Simulation And Transfer Learning (2018)0.00
- Policy Optimization In A Noisy Neighborhood: On Return Landscapes In Continuous Control (2023)0.00