Language Is Power: Representing States Using Natural Language In Reinforcement Learning

Abstract

Recent advances in reinforcement learning have shown its potential to tackle complex real-life tasks. However, as the dimensionality of the task increases, reinforcement learning methods tend to struggle. To overcome this, we explore methods for representing the semantic information embedded in the state. While previous methods focused on information in its raw form (e.g., raw visual input), we propose to represent the state using natural language. Language can represent complex scenarios and concepts, making it a favorable candidate for representation. Empirical evidence, within the domain of ViZDoom, suggests that natural language based agents are more robust, converge faster and perform better than vision based agents, showing the benefit of using natural language representations for reinforcement learning.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyschwartz2019language

Related papers

• Enhancing Vision-language Model Training With Reinforcement Learning In Synthetic Worlds For Real-world Success (2025)0.00
• Mental Modeling Of Reinforcement Learning Agents By Language Models (2024)0.00
• Language Agents With Reinforcement Learning For Strategic Play In The Werewolf Game (2023)0.00
• Language-conditioned World Model Improves Policy Generalization By Reading Environmental Descriptions (2025)0.00
• Influencing Reinforcement Learning Through Natural Language Guidance (2021)0.00
• A Survey Of State Representation Learning For Deep Reinforcement Learning (2025)0.00
• From Laws To Motivation: Guiding Exploration Through Law-based Reasoning And Rewards (2024)0.00
• Zero-shot Model-based Reinforcement Learning Using Large Language Models (2024)0.00