← all papers · overview

Out Of The Memory Barrier: A Highly Memory Efficient Training System For Llms With Million-token Contexts

Abstract

Training Large Language Models (LLMs) on long contexts is severely constrained by prohibitive GPU memory overhead, not training time. The primary culprits are the activations, whose memory footprints scale linearly with sequence length. We introduce OOMB, a highly memory-efficient training system that directly confronts this barrier. Our approach employs a chunk-recurrent training framework with o

Related papers

Ranked by semantic similarity — how closely each paper's abstract matches this one (100% = near-identical topic).