Converging To A Lingua Franca: Evolution Of Linguistic Regions And Semantics Alignment In Multilingual Large Language Models

Abstract

Large language models (LLMs) have demonstrated remarkable performance, particularly in multilingual contexts. While recent studies suggest that LLMs can transfer skills learned in one language to others, the internal mechanisms behind this ability remain unclear. We observed that the neuron activation patterns of LLMs exhibit similarities when processing the same language, revealing the existence