← authors · overview

• Infllm: Training-free Long-context Extrapolation For Llms With An Efficient Context Memory
  2024 · 141 citations
• Relu\(^2\) Wins: Discovering Efficient Activation Functions For Sparse Llms
  2024 · 56 citations
• Densing Law Of Llms
  2024 · 30 citations
• Ouroboros: Generating Longer Drafts Phrase By Phrase For Faster Speculative Decoding
  2024 · 25 citations
• Sparsing Law: Towards Large Language Models With Greater Activation Sparsity
  2024 · 19 citations