Rltools: A Fast, Portable Deep Reinforcement Learning Library For Continuous Control

Abstract

Deep Reinforcement Learning (RL) can yield capable agents and control policies in several domains but is commonly plagued by prohibitively long training times. Additionally, in the case of continuous control problems, the applicability of learned policies on real-world embedded devices is limited due to the lack of real-time guarantees and portability of existing libraries. To address these challenges, we present RLtools, a dependency-free, header-only, pure C++ library for deep supervised and reinforcement learning. Its novel architecture allows RLtools to be used on a wide variety of platforms, from HPC clusters over workstations and laptops to smartphones, smartwatches, and microcontrollers. Specifically, due to the tight integration of the RL algorithms with simulation environments, RLtools can solve popular RL problems up to 76 times faster than other popular RL frameworks. We also benchmark the inference on a diverse set of microcontrollers and show that in most cases our optimiz

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyeschmann2023rltools

Related papers

• Lexci: A Framework For Reinforcement Learning With Embedded Systems (2023)6.34
• Rl_reach: Reproducible Reinforcement Learning Experiments For Robotic Reaching Tasks (2021)5.84
• Cleanrl: High-quality Single-file Implementations Of Deep Reinforcement Learning Algorithms (2021)0.00
• Rllib: Abstractions For Distributed Reinforcement Learning (2017)0.00
• Control-optimized Deep Reinforcement Learning For Artificially Intelligent Autonomous Systems (2025)0.00
• Toybox: A Suite Of Environments For Experimental Evaluation Of Deep Reinforcement Learning (2019)0.00
• Scilab-rl: A Software Framework For Efficient Reinforcement Learning And Cognitive Modeling Research (2024)0.00
• Braxlines: Fast And Interactive Toolkit For Rl-driven Behavior Engineering Beyond Reward Maximization (2021)0.00