Reasoning About Unforeseen Possibilities During Policy Learning

Abstract

Methods for learning optimal policies in autonomous agents often assume that the way the domain is conceptualised---its possible states and actions and their causal structure---is known in advance and does not change during learning. This is an unrealistic assumption in many scenarios, because new evidence can reveal important information about what is possible, possibilities that the agent was not aware existed prior to learning. We present a model of an agent which both discovers and learns to exploit unforeseen possibilities using two sources of evidence: direct interaction with the world and communication with a domain expert. We use a combination of probabilistic and symbolic reasoning to estimate all components of the decision problem, including its set of random variables and their causal dependencies. Agent simulations show that the agent converges on optimal polices even when it starts out unaware of factors that are critical to behaving optimally.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyinnes2018reasoning

Related papers

• Agent-pro: Learning To Evolve Via Policy-level Reflection And Optimization (2024)9.59
• Post-convergence Sim-to-real Policy Transfer: A Principled Alternative To Cherry-picking (2025)0.00
• Conservative Exploration For Policy Optimization Via Off-policy Policy Evaluation (2023)0.00
• Woulda, Coulda, Shoulda: Counterfactually-guided Policy Search (2018)0.00
• Dream To Explore: Adaptive Simulations For Autonomous Systems (2021)0.00
• An Empirical Study On The Practical Impact Of Prior Beliefs Over Policy Types (2019)5.24
• Modeling The Effects Of Environmental And Perceptual Uncertainty Using Deterministic Reinforcement Learning Dynamics With Partial Observability (2021)9.59
• Actor-critic Policy Optimization In Partially Observable Multiagent Environments (2018)0.00