← all papers · overview

Towards Measuring Representational Similarity Of Large Language Models

Abstract

Understanding the similarity of the numerous released large language models (LLMs) has many uses, e.g., simplifying model selection, detecting illegal model reuse, and advancing our understanding of what makes LLMs perform well. In this work, we measure the similarity of representations of a set of LLMs with 7B parameters. Our results suggest that some LLMs are substantially different from others.

Related papers

Ranked by semantic similarity — how closely each paper's abstract matches this one (100% = near-identical topic).