REPOCOD

Can Language Models Replace Programmers? REPOCOD Says 'Not Yet' Large language models (LLMs) have achieved high accuracy, i.e., more than 90 pass@1, in solving Python coding problems in HumanEval and MBPP. Thus, a natural question is, whether LLMs achieve comparable code completion performance compared to human develop

Papers using REPOCOD (3)

Unified Software Engineering Agent as AI Software Engineer2025Can Language Models Replace Programmers for Coding? REPOCOD Says 'Not Yet'2024Can Language Models Replace Programmers? REPOCOD Says 'Not Yet'2024