← all papers · overview

Outliers And Calibration Sets Have Diminishing Effect On Quantization Of Modern Llms

Abstract

Post-Training Quantization (PTQ) enhances the efficiency of Large Language Models (LLMs) by enabling faster operation and compatibility with more accessible hardware through reduced memory usage, at the cost of small performance drops. We explore the role of calibration sets in PTQ, specifically their effect on hidden activations in various notable open-source LLMs. Calibration sets are crucial fo

Related papers

Ranked by semantic similarity — how closely each paper's abstract matches this one (100% = near-identical topic).