← all papers · overview

Data-centric AI In The Age Of Large Language Models

Abstract

This position paper proposes a data-centric viewpoint of AI research, focusing on large language models (LLMs). We start by making the key observation that data is instrumental in the developmental (e.g., pretraining and fine-tuning) and inferential stages (e.g., in-context learning) of LLMs, and yet it receives disproportionally low attention from the research community. We identify four specific

Related papers

Ranked by semantic similarity — how closely each paper's abstract matches this one (100% = near-identical topic).