RepoBench

RepoBench is a dataset that benchmarks repository-level code auto-completion systems. RepoBench-R denotes RepoBench for Retrieval, which is a sub-task of RepoBench, aiming to evaluate the ability of code auto-completion systems to retrieve relevant code snippets for next-line code completion.

Papers using RepoBench (3)

Renaissance of Literate Programming in the Era of LLMs: Enhancing LLM-Based Code Generation in Large-Scale Projects2025Can Language Models Replace Programmers for Coding? REPOCOD Says 'Not Yet'2024RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems2023 · 12 cites