← all papers · overview

Scaling Laws For Post Training Quantized Large Language Models

Abstract

Generalization abilities of well-trained large language models (LLMs) are known to scale predictably as a function of model size. In contrast to the existence of practical scaling laws governing pre-training, the quality of LLMs after post-training compression remains highly unpredictable, often requiring case-by-case validation in practice. In this work, we attempted to close this gap for post-tr

Related papers

Ranked by semantic similarity — how closely each paper's abstract matches this one (100% = near-identical topic).