Summarising And Comparing Agent Dynamics With Contrastive Spatiotemporal Abstraction

Abstract

We introduce a data-driven, model-agnostic technique for generating a human-interpretable summary of the salient points of contrast within an evolving dynamical system, such as the learning process of a control agent. It involves the aggregation of transition data along both spatial and temporal dimensions according to an information-theoretic divergence measure. A practical algorithm is outlined for continuous state spaces, and deployed to summarise the learning histories of deep reinforcement learning agents with the aid of graphical and textual communication methods. We expect our method to be complementary to existing techniques in the realm of agent interpretability.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keybewley2022summarising

Related papers

• Contrastive Abstraction For Reinforcement Learning (2024)0.00
• Interpretable Learning Dynamics In Unsupervised Reinforcement Learning (2025)0.00
• Temporal Abstractions-augmented Temporally Contrastive Learning: An Alternative To The Laplacian In RL (2022)0.00
• Multi-timescale, Gradient Descent, Temporal Difference Learning With Linear Options (2017)0.00
• Learning Dynamic Abstract Representations For Sample-efficient Reinforcement Learning (2022)0.00
• Dream To Explore: Adaptive Simulations For Autonomous Systems (2021)0.00
• Prediction And Control With Temporal Segment Models (2017)0.00
• Episodic Memory For Learning Subjective-timescale Models (2020)0.00