Abstract
We construct exact eigenstates of quantum many-body systems with Hamiltonians that are not frustration-free in matrix product form, based on a local error cancellation ansatz motivated by the Derrida-Evans-Hakim-Pasquier method for finding the stationary state of the asymmetric simple exclusion process. We demonstrate the approach with explicit examples in both one and two spatial dimensions.