Decision Transformer Under Random Frame Dropping

Abstract

Controlling agents remotely with deep reinforcement learning~(DRL) in the real world is yet to come. One crucial stepping stone is to devise RL algorithms that are robust in the face of dropped information from corrupted communication or malfunctioning sensors. Typical RL methods usually require considerable online interaction data that are costly and unsafe to collect in the real world. Furthermore, when applying to the frame dropping scenarios, they perform unsatisfactorily even with moderate drop rates. To address these issues, we propose Decision Transformer under Random Frame Dropping~(DeFog), an offline RL algorithm that enables agents to act robustly in frame dropping scenarios without online interaction. DeFog first randomly masks out data in the offline datasets and explicitly adds the time span of frame dropping as inputs. After that, a finetuning stage on the same offline dataset with a higher mask rate would further boost the performance. Empirical results show that DeFog o

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyhu2023decision

Related papers

• Distrl: An Asynchronous Distributed Reinforcement Learning Framework For On-device Control Agents (2024)0.00
• Belief-based Offline Reinforcement Learning For Delay-robust Policy Optimization (2025)0.00
• Federated Offline Policy Optimization With Dual Regularization (2024)3.58
• Streetwise Agents: Empowering Offline RL Policies To Outsmart Exogenous Stochastic Disturbances In RTC (2024)0.00
• DEFENDER: Dtw-based Episode Filtering Using Demonstrations For Enhancing RL Safety (2023)0.00
• Control-optimized Deep Reinforcement Learning For Artificially Intelligent Autonomous Systems (2025)0.00
• Solving Continual Offline Reinforcement Learning With Decision Transformer (2024)0.00
• When Should We Prefer Decision Transformers For Offline Reinforcement Learning? (2023)0.00