← authors · overview

• Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce For Pruning Llms To High Sparsity
  2023 · 176 citations
• Dynamic Sparse No Training: Training-free Fine-tuning For Sparse Llms
  2023 · 77 citations
• Found In The Middle: How Language Models Use Long Contexts Better Via Plug-and-play Positional Encoding
  2024 · 76 citations
• Mix-ln: Unleashing The Power Of Deeper Layers By Combining Pre-ln And Post-ln
  2024 · 30 citations
• Visual Prompting Upgrades Neural Network Sparsification: A Data-model Perspective
  2023 · 30 citations