AutoCodeArena

BigCodeArena Dataset BigCodeArena is an open human evaluation platform for code generation, built on top of Chatbot Arena with a comprehensive and on-the-fly execution environment. Unlike traditional evaluation platforms, BigCodeArena enables the execution of LLM-generated code and allows humans to interact with execut

Papers using AutoCodeArena (2)

BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution2025BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution2025