Alphaseq: Sequence Discovery With Deep Reinforcement Learning

Abstract

Sequences play an important role in many applications and systems. Discovering sequences with desired properties has long been an interesting intellectual pursuit. This paper puts forth a new paradigm, AlphaSeq, to discover desired sequences algorithmically using deep reinforcement learning (DRL) techniques. AlphaSeq treats the sequence discovery problem as an episodic symbol-filling game, in which a player fills symbols in the vacant positions of a sequence set sequentially during an episode of the game. Each episode ends with a completely-filled sequence set, upon which a reward is given based on the desirability of the sequence set. AlphaSeq models the game as a Markov Decision Process (MDP), and adapts the DRL framework of AlphaGo to solve the MDP. Sequences discovered improve progressively as AlphaSeq, starting as a novice, learns to become an expert game player through many episodes of game playing. Compared with traditional sequence construction by mathematical tools, AlphaSeq i

Stats

• citations21
• S2 citations—
• github stars0
• HF likes0
• heat score10.07
• arxiv keyshao2018alphaseq

Related papers

• Deterministic Sequencing Of Exploration And Exploitation For Reinforcement Learning (2022)5.84
• Sequential Anomaly Detection Using Inverse Reinforcement Learning (2020)0.00
• Reinforcement Learning In Strategy-based And Atari Games: A Review Of Google Deepminds Innovations (2025)0.00
• ACTER: Diverse And Actionable Counterfactual Sequences For Explaining And Diagnosing RL Policies (2024)0.00
• On Improving Deep Reinforcement Learning For Pomdps (2017)0.00
• State Sequences Prediction Via Fourier Transform For Representation Learning (2023)2.26
• Regret-guided Search Control For Efficient Learning In Alphazero (2026)0.00
• Deep Reinforcement Learning With Quantum-inspired Experience Replay (2021)0.00