← authors · overview

• Dissecting Contextual Word Embeddings: Architecture and Representation
  2018
• Dense Passage Retrieval for Open-Domain Question Answering
  2020
• Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
  2020
• On the Influence of Masking Policies in Intermediate Pre-training
  2021
• Simple Local Attentions Remain Competitive for Long-Context Tasks
  2021
• DiffCSE: Difference-based Contrastive Learning for Sentence Embeddings
  2022
• Nonparametric Masked Language Modeling
  2022
• Large Language Model Programs
  2023
• Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Models
  2024