Shared Control With Black Box Agents Using Oracle Queries

Abstract

Shared control problems involve a robot learning to collaborate with a human. When learning a shared control policy, short communication between the agents can often significantly reduce running times and improve the system's accuracy. We extend the shared control problem to include the ability to directly query a cooperating agent. We consider two types of potential responses to a query, namely oracles: one that can provide the learner with the best action they should take, even when that action might be myopically wrong, and one with a bounded knowledge limited to its part of the system. Given this additional information channel, this work further presents three heuristics for choosing when to query: reinforcement learning-based, utility-based, and entropy-based. These heuristics aim to reduce a system's overall learning cost. Empirical results on two environments show the benefits of querying to learn a better control policy and the tradeoffs between the proposed heuristics.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyavraham2024shared

Related papers

• To The Noise And Back: Diffusion For Shared Autonomy (2023)8.82
• Sa-matd3:self-attention-based Multi-agent Continuous Control Method In Cooperative Environments (2021)11.76
• Cautiously-optimistic Knowledge Sharing For Cooperative Multi-agent Reinforcement Learning (2023)5.84
• Exploiting Inter-agent Coupling Information For Efficient Reinforcement Learning Of Cooperative LQR (2025)0.00
• Some Supervision Required: Incorporating Oracle Policies In Reinforcement Learning Via Epistemic Uncertainty Metrics (2022)0.00
• Learning To Share: Selective Memory For Efficient Parallel Agentic Systems (2026)0.00
• Inverse Rational Control With Partially Observable Continuous Nonlinear Dynamics (2019)0.00
• Experience Sharing Between Cooperative Reinforcement Learning Agents (2019)0.00