← authors · overview

• ERNIE: Enhanced Language Representation with Informative Entities
  2019
• Train No Evil: Selective Masking for Task-Guided Pre-Training
  2020
• Know What You Don't Need: Single-Shot Meta-Pruning for Attention Heads
  2020
• CPM: A Large-scale Generative Chinese Pre-trained Language Model
  2020
• Knowledge Inheritance for Pre-trained Language Models
  2021
• Prompt Tuning for Discriminative Pre-trained Language Models
  2022
• Finding Skill Neurons in Pre-trained Transformer-based Language Models
  2022
• READIN: A Chinese Multi-Task Benchmark with Realistic and Diverse Input Noises
  2023
• Variator: Accelerating Pre-trained Models with Plug-and-Play Compression Modules
  2023
• Turbo Sparse: Achieving LLM SOTA Performance with Minimal Activated Parameters
  2024