Dynode: Neural Ordinary Differential Equations For Dynamics Modeling In Continuous Control

Abstract

We present a novel approach (DyNODE) that captures the underlying dynamics of a system by incorporating control in a neural ordinary differential equation framework. We conduct a systematic evaluation and comparison of our method and standard neural network architectures for dynamics modeling. Our results indicate that a simple DyNODE architecture when combined with an actor-critic reinforcement learning (RL) algorithm that uses model predictions to improve the critic's target values, outperforms canonical neural networks, both in sample efficiency and predictive performance across a diverse range of continuous tasks that are frequently used to benchmark RL algorithms. This approach provides a new avenue for the development of models that are more suited to learn the evolution of dynamical systems, particularly useful in the context of model-based reinforcement learning. To assist related work, we have made code available at https://github.com/vmartinezalvarez/DyNODE .

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyalvarez2020dynode

Code

• vmartinezalvarez/DyNODE—

Related papers

• Model-based Reinforcement Learning For Semi-markov Decision Processes With Neural Odes (2020)0.00
• RLOC: Neurobiologically Inspired Hierarchical Reinforcement Learning Algorithm For Continuous Control Of Nonlinear Dynamical Systems (2019)0.00
• Hyperl: Hypernetwork-based Reinforcement Learning For Control Of Parametrized Dynamical Systems (2025)0.00
• Inverse Rational Control With Partially Observable Continuous Nonlinear Dynamics (2019)0.00
• Neural Architecture Evolution In Deep Reinforcement Learning For Continuous Control (2019)0.00
• Broad Critic Deep Actor Reinforcement Learning For Continuous Control (2024)0.00
• Dynamic Reinforcement Learning For Actors (2025)0.00
• Actor Critic Learning Algorithms For Mean-field Control With Moment Neural Networks (2023)0.00