Generalized Information Gathering Under Dynamics Uncertainty

Abstract

An agent operating in an unknown dynamical system must learn its dynamics from observations. Active information gathering accelerates this learning, but existing methods derive bespoke costs for specific modeling choices: dynamics models, belief update procedures, observation models, and planners. We present a unifying framework that decouples these choices from the information-gathering cost by explicitly exposing the causal dependencies between parameters, beliefs, and controls. Using this framework, we derive a general information-gathering cost based on Massey's directed information that assumes only Markov dynamics with additive noise and is otherwise agnostic to modeling choices. We prove that the mutual information cost used in existing literature is a special case of our cost. Then, we leverage our framework to establish an explicit connection between the mutual information cost and information gain in linearized Bayesian estimation, thereby providing theoretical justification

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keypalafox2026generalized

Related papers

• Modeling The Effects Of Environmental And Perceptual Uncertainty Using Deterministic Reinforcement Learning Dynamics With Partial Observability (2021)9.59
• Information-theoretic Methods For Planning And Learning In Partially Observable Markov Decision Processes (2016)0.00
• Learning Controllable Dynamics Through Informative Exploration (2025)0.00
• Cost Inference For Feedback Dynamic Games From Noisy Partial State Observations And Incomplete Trajectories (2023)0.00
• Peer-aware Cost Estimation In Nonlinear General-sum Dynamic Games For Mutual Learning And Intent Inference (2025)0.00
• Probabilistic Inverse Optimal Control For Non-linear Partially Observable Systems Disentangles Perceptual Uncertainty And Behavioral Costs (2023)0.00
• Uncertainty Maximization In Partially Observable Domains: A Cognitive Perspective (2021)0.00
• Where Do You Think You're Going?: Inferring Beliefs About Dynamics From Behavior (2018)0.00