← all papers · overview

Balancing Speed And Stability: The Trade-offs Of FP8 Vs. BF16 Training In Llms

Abstract

Large Language Models (LLMs) have attracted significant attention due to their human-like language understanding and generation capabilities, as well as their applicability across various domains. These models, characterized by their massive scale and extensive training data, continue to push the boundaries of what is possible in natural language processing. The Llama 3 series, for instance, exe

Related papers

Ranked by semantic similarity — how closely each paper's abstract matches this one (100% = near-identical topic).