Can Llms Simulate Personas With Reversed Performance? A Systematic Investigation For Counterfactual Instruction Following In Math Reasoning Context

Abstract

Large Language Models (LLMs) are now increasingly widely used to simulate personas in virtual environments, leveraging their instruction-following capability. However, we discovered that even state-of-the-art LLMs cannot simulate personas with reversed performance (e.g., student personas with low proficiency in educational settings), which impairs the simulation diversity and limits the practical