KernelBench

KernelBench A benchmark designed to evaluate the ability of LLMs to generate efficient GPU kernels for optimizing neural network performance Version [07-21-2025] This HF dataset version has been updated to v0.1 Citation @misc{ouyang2024kernelbench, title={KernelBench: Can LLMs Write GPU Kernels?}, author={Anne Ouyang a

Papers using KernelBench (8)

The Correctness Illusion in LLM-Generated GPU Kernels2026Optimizing CUDA like a Human: Micro-Profiling Tools as Expert Surrogates for LLM-Based GPU Kernel Optimization2026EGG: An Expert-Guided Agent Framework for Kernel Generation2026CUDA-L1: Improving CUDA Optimization via Contrastive Reinforcement Learning2025 · 1 citesPACEvolve: Enabling Long-Horizon Progress-Aware Consistent Evolution2026Making LLMs Optimize Multi-Scenario CUDA Kernels Like Experts2026Surprisal-Guided Selection: Compute-Optimal Test-Time Strategies for Execution-Grounded Code Generation2026KernelBench-X: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernels2026