← authors · overview

• Finite-Sample Analysis of Nonlinear Stochastic Approximation with Applications in Reinforcement Learning
  2019 · 31 citations
• A Lyapunov Theory for Finite-Sample Guarantees of Asynchronous Q-Learning and TD-Learning Variants
  2021 · 17 citations
• Federated Stochastic Approximation under Markov Noise and Heterogeneity: Applications in Reinforcement Learning
  2022 · 13 citations
• Finite-Time Performance of Distributed Temporal Difference Learning with Linear Function Approximation
  2019 · 5 citations
• An Approximate Policy Iteration Viewpoint of Actor-Critic Algorithms
  2022 · 1 citations
• Convergence of Natural Policy Gradient for a Family of Infinite-State Queueing MDPs
  2024
• Tight Finite Time Bounds of Two-Time-Scale Linear Stochastic Approximation with Markovian Noise
  2024
• Finite Sample Analysis of Two-Time-Scale Natural Actor-Critic Algorithm
  2021
• Finite-Sample Analysis of Off-Policy Natural Actor-Critic with Linear Function Approximation
  2021
• Performance of NPG in Countable State-Space Average-Cost RL
  2024
• Markov Chain Variance Estimation: A Stochastic Approximation Approach
  2024
• Stochastic Approximation with Unbounded Markovian Noise: A General-Purpose Theorem
  2024