Revisiting Rainbow: Promoting More Insightful And Inclusive Deep Reinforcement Learning Research

Abstract

Since the introduction of DQN, a vast majority of reinforcement learning research has focused on reinforcement learning with deep neural networks as function approximators. New methods are typically evaluated on a set of environments that have now become standard, such as Atari 2600 games. While these benchmarks help standardize evaluation, their computational cost has the unfortunate side effect of widening the gap between those with ample access to computational resources, and those without. In this work we argue that, despite the community's emphasis on large-scale environments, the traditional small-scale environments can still yield valuable scientific insights and can help reduce the barriers to entry for underprivileged communities. To substantiate our claims, we empirically revisit the paper which introduced the Rainbow algorithm [Hessel et al., 2018] and present some new insights into the algorithms used by Rainbow.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyobandoceron2020revisiting

Related papers

• Is Deep Reinforcement Learning Really Superhuman On Atari? Leveling The Playing Field (2019)0.00
• Learn To Interpret Atari Agents (2018)0.00
• Pg-rainbow: Using Distributional Reinforcement Learning In Policy Gradient Methods (2024)0.00
• Importance Of Using Appropriate Baselines For Evaluation Of Data-efficiency In Deep Reinforcement Learning For Atari (2020)0.00
• Faster Deep Reinforcement Learning With Slower Online Network (2021)0.00
• Evaluating The Progress Of Deep Reinforcement Learning In The Real World: Aligning Domain-agnostic And Domain-specific Research (2021)0.00
• Spectral Normalisation For Deep Reinforcement Learning: An Optimisation Perspective (2021)0.00
• A Comprehensive Survey Of Reinforcement Learning: From Algorithms To Practical Challenges (2024)0.00