Rsoccer: A Framework For Studying Reinforcement Learning In Small And Very Small Size Robot Soccer

Abstract

Reinforcement learning is an active research area with a vast number of applications in robotics, and the RoboCup competition is an interesting environment for studying and evaluating reinforcement learning methods. A known difficulty in applying reinforcement learning to robotics is the high number of experience samples required, being the use of simulated environments for training the agents followed by transfer learning to real-world (sim-to-real) a viable path. This article introduces an open-source simulator for the IEEE Very Small Size Soccer and the Small Size League optimized for reinforcement learning experiments. We also propose a framework for creating OpenAI Gym environments with a set of benchmarks tasks for evaluating single-agent and multi-agent robot soccer skills. We then demonstrate the learning capabilities of two state-of-the-art reinforcement learning methods as well as their limitations in certain scenarios introduced in this framework. We believe this will make i

Stats

• citations12
• S2 citations—
• github stars0
• HF likes0
• heat score8.35
• arxiv keymartins2021rsoccer

Related papers

• Scilab-rl: A Software Framework For Efficient Reinforcement Learning And Cognitive Modeling Research (2024)0.00
• Google Research Football: A Novel Reinforcement Learning Environment (2019)17.22
• Learning To Play Soccer From Scratch: Sample-efficient Emergent Coordination Through Curriculum-learning And Competition (2021)0.00
• The AI Arena: A Framework For Distributed Multi-agent Reinforcement Learning (2021)0.00
• Emergent Coordination Through Competition (2019)0.00
• Boosting Studies Of Multi-agent Reinforcement Learning On Google Research Football Environment: The Past, Present, And Future (2023)4.52
• Tizero: Mastering Multi-agent Football With Curriculum Learning And Self-play (2023)2.26
• Tikick: Towards Playing Multi-agent Football Full Games From Single-agent Demonstrations (2021)0.00