Code Generation code-generation Leaderboard
Auto-discovered from papers reporting Code Generation (pass@1). · Metric: pass@1 (higher is better) · 🟢 Updated 8h ago
| # | Model | pass@1 | Paper |
|---|---|---|---|
| 1 | GPT-4o | 90.20 | link |
| 2 | DeepSeek-V3 | 87.20 | link |
| 3 | Claude-3-Haiku | 73.10 | link |
| 4 | GPT-3.5-Turbo | 70.70 | link |
| 5 | Complexity | 62.98 | link |
| 6 | Algorithm | 59.13 | link |
| 7 | Author Andrey Petrov | 54.82 | link |
| 8 | Shebang | 54.39 | link |
| 9 | Author Guido von Rossum | 53.96 | link |
| 10 | Author Jean-Baptiste Doderlein | 52.93 | link |
| 11 | Original | 50.15 | link |
| 12 | Masked function signature | 47.84 | link |
| 13 | Keyword Cut 20% | 47.27 | link |
| 14 | Keyword Cut 40% | 46.81 | link |
| 15 | Keyword Cut 60% | 44.21 | link |
| 16 | Let's think step by step | 43.07 | link |
| 17 | No Example | 41.82 | link |
| 18 | Isotopic Replacement | 41.07 | link |
| 19 | Quick | 40.90 | link |
| 20 | Keyword Cut 80% | 40.03 | link |
| 21 | French | 38.85 | link |
| 22 | Masked function name | 29.42 | link |
| 23 | Original t = 1.0 | 22.44 | link |
| 24 | No Documentation | 20.23 | link |