MBPP

Dataset Card for Mostly Basic Python Problems (mbpp) Dataset Summary The benchmark consists of around 1,000 crowd-sourced Python programming problems, designed to be solvable by entry level programmers, covering programming fundamentals, standard library functionality, and so on. Each problem consists of a task descrip

Papers using MBPP (7)

SePO: Self-Evolving Prompt Agent for System Prompt Optimization2026Evoagentx: An Automated Framework For Evolving Agentic Workflows2025 · 1 citesWho Grades the Grader? Co-Evolving Evaluation Metrics and Skills for Self-Improving LLM Agents2026TDPGen: Optimizing Agentic Code Generation via Test-Driven Planning and Hierarchical ReAct2026Guided Collaboration in Heterogeneous LLM-Based Multi-Agent Systems via Entropy-Based Understanding Assessment and Experience Retrieval2026Adaptive Confidence Gating In Multi-agent Collaboration For Efficient And Optimized Code Generation2026Q*: Improving Multi-step Reasoning for LLMs with Deliberative Planning2024 · 9 cites