← all papers · overview

Attention-based representations for multi-task computation

Abstract

Multi-head attention layers produce vector representations that support multiple downstream tasks. We establish bounds on the number of heads required in two simple and concrete multi-task scenarios. In the first scenario, a vector representation is sought so that linear predictors can compute both the smallest and largest numbers in a given list. In this case, it is known two attention heads with small embedding dimension and bit precision level suffice. We prove that a single attention head requires exponentially higher embedding dimension or precision level. In the second scenario, a vector representation is sought so that a polynomial threshold function can compute the XOR of a given string of bits. This scenario is analogous to the first one for , since XOR is readily computed by a linear function using a vector representation that encodes both the AND and the OR of the two bits. We observe that -bit XOR requires the product of the number of heads and the polynomial degree to be at least , and we construct multi-head attention layers that match this lower bound. These results generalize to arbitrary (symmetric) Boolean functions, where the bound is given in terms of the threshold degree.

Related papers

Ranked by semantic similarity — how closely each paper's abstract matches this one (100% = near-identical topic).