SciCode

The 'SciCode' benchmark is a dataset used to evaluate the performance of code generation models specifically for scientific workflows, focusing on accuracy, executability, and numerical precision without relying on traditional input/output test cases.

Papers using SciCode (3)

Scaling the Horizon, Not the Parameters: Reaching Trillion-Parameter Performance with a 35B Agent2026AutoResearch: An Execution-Grounded Multi-Agent Framework for Reliable Research Workflow Automation2026No Test Cases, No Problem: Distillation-driven Code Generation For Scientific Workflows2026