RepoExec

RepoExec: Evaluate Code Generation with a Repository-Level Executable Benchmark Dataset Summary RepoExec is a novel benchmark designed to evaluate code generation at the repository level with a focus on executability and correctness. This benchmark addresses the gaps in existing systems by emphasizing real-world applic

Papers using RepoExec (6)

On the Impacts of Contexts on Repository-Level Code Generation2024 · 2 citesWhat to Retrieve for Effective Retrieval-Augmented Code Generation? An Empirical Study and Beyond2025 · 1 citesHyperAgent: Generalist Software Engineering Agents to Solve Coding Tasks at Scale2024 · 1 citesDo Not Treat Code as Natural Language: Implications for Repository-Level Code Generation and Beyond2026HyperAgent: Generalist Software Engineering Agents to Solve Coding Tasks at Scale2024 · 1 citesREPOEXEC: Evaluate Code Generation with a Repository-Level Executable Benchmark2024