MBPP
Emerging15papers using it
2024first seen
Dataset Card for Mostly Basic Python Problems (mbpp) Dataset Summary The benchmark consists of around 1,000 crowd-sourced Python programming problems, designed to be solvable by entry level programmers, covering programming fundamentals, standard library functionality, and so on. Each problem consists of a task descrip
Papers using MBPP (7)
- SePO: Self-Evolving Prompt Agent for System Prompt OptimizationEvoagentx: An Automated Framework For Evolving Agentic WorkflowsWho Grades the Grader? Co-Evolving Evaluation Metrics and Skills for Self-Improving LLM AgentsTDPGen: Optimizing Agentic Code Generation via Test-Driven Planning and Hierarchical ReActGuided Collaboration in Heterogeneous LLM-Based Multi-Agent Systems via Entropy-Based Understanding Assessment and Experience RetrievalAdaptive Confidence Gating In Multi-agent Collaboration For Efficient And Optimized Code GenerationQ*: Improving Multi-step Reasoning for LLMs with Deliberative Planning