enwiki-8

'enwiki-8' is a dataset that contains a subset of English Wikipedia text, used to evaluate the performance and efficiency of language models, particularly in the context of resource-efficient architectures like sparse Mixtures of Experts.

Papers using enwiki-8 (1)

Approximating Two-Layer Feedforward Networks for Efficient Transformers2023 · 6 cites