Abstract
The speed of open-weights large language models (LLMs) and its dependency on the task at hand, when run on GPUs, is studied to present a comparative analysis of the speed of the most popular open LLMs.
Speed and Conversational Large Language Models: Not All Is About Tokens per Second
Related papers
Ranked by semantic similarity — how closely each paper's abstract matches this one (100% = near-identical topic).
- Speed Always Wins: A Survey on Efficient Architectures for Large Language Models (2025)67% match
- A Primer on Large Language Models and their Limitations (2024)65% match
- Multilingual Machine Translation with Large Language Models: Empirical Results and Analysis (2023)65% match
- Achieving Peak Performance for Large Language Models: A Systematic Review (2024)65% match
- Performance Law of Large Language Models (2024)65% match
- Vectors from Larger Language Models Predict Human Reading Time and fMRI Data More Poorly when Dimensionality Expansion is Controlled (2025)64% match
- Large Language Model Programs (2023)64% match
- A Survey on Large Language Models with some Insights on their Capabilities and Limitations (2025)64% match