Arcade

The 'Arcade' dataset is a benchmark used to evaluate the ability of large language models to generate executable code that aligns with natural language prompts and explicit input-output specifications in the context of data science programming.

Papers using Arcade (2)

Natural Language to Code Generation in Interactive Data Science Notebooks2022 · 3 citesGrounding Data Science Code Generation with Input-Output Specifications2024 · 2 cites