← all papers · overview

Scaling Laws For Predicting Downstream Performance In Llms

Abstract

Precise estimation of downstream performance in large language models (LLMs) prior to training is essential for guiding their development process. Scaling laws analysis utilizes the statistics of a series of significantly smaller sampling language models (LMs) to predict the performance of the target LLM. For downstream performance prediction, the critical challenge lies in the emergent abilities

Related papers

Ranked by semantic similarity — how closely each paper's abstract matches this one (100% = near-identical topic).