WikiText-2

WikiText-2 is a benchmark dataset that contains a collection of over 2 million tokens extracted from Wikipedia articles, used to evaluate the performance of language models in terms of their ability to generate coherent and contextually relevant text.

Papers using WikiText-2 (1)

From Local to Global: Revisiting Structured Pruning Paradigms for Large Language Models2025