Lossless Prompt Compression Via Dictionary-encoding And In-context Learning: Enabling Cost-effective LLM Analysis Of Repetitive Data

Abstract

In-context learning has established itself as an important learning paradigm for Large Language Models (LLMs). In this paper, we demonstrate that LLMs can learn encoding keys in-context and perform analysis directly on encoded representations. This finding enables lossless prompt compression via dictionary encoding without model fine-tuning: frequen