CodeXGLUE

CodeXGLUE is a benchmark that contains a variety of code-related tasks used to evaluate the performance of models in code generation and summarization.

Papers using CodeXGLUE (27)

Code vs Serialized AST Inputs for LLM-Based Code Summarization: An Empirical Study2026Multi-task Code LLMs: Data Mix or Model Merge?2026Syntax Is Not Enough: An Empirical Study of Small Transformer Models for Neural Code Repair2025Assessing Small Language Models for Code Generation: An Empirical Study with Benchmarks2025Automated Code Review Using Large Language Models with Symbolic Reasoning2025Enhancing Code LLM Training with Programmer Attention2025Should Code Models Learn Pedagogically? A Preliminary Evaluation of Curriculum Learning for Real-World Software Engineering Tasks2025CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation2021 · 415 citesVulBERTa: Simplified Source Code Pre-Training for Vulnerability Detection2022 · 135 citesCoTexT: Multi-task Learning with Code-Text Transformer2021 · 98 citesCoSQA: 20,000+ Web Queries for Code Search and Question Answering2021 · 65 citesA Deep Dive into Large Language Models for Automated Bug Localization and Repair2024 · 57 citesImproving ChatGPT Prompt for Code Generation2023 · 38 citesOn The Cross-Modal Transfer from Natural Language to Code through Adapter Modules2022 · 17 citesOn using distributed representations of source code for the detection of C security vulnerabilities2021 · 15 citesLong-Range Modeling of Source Code Files with eWASH: Extended Window Access by Syntax Hierarchy2021 · 11 citesFix Bugs with Transformer through a Neural-Symbolic Edit Grammar2022 · 7 citesStructCoder: Structure-Aware Transformer for Code Generation2022 · 7 citesLongCoder: A Long-Range Pre-trained Language Model for Code Completion2023 · 7 citesProgram Translation via Code Distillation2023 · 7 citesAST-T5: Structure-Aware Pretraining for Code Generation and Understanding2024 · 7 citesReGVD: Revisiting Graph Neural Networks for Vulnerability Detection2021 · 3 citesSyntax-Aware On-the-Fly Code Completion2022 · 2 citesMultiCoder: Multi-Programming-Lingual Pre-Training for Low-Resource Code Completion2022 · 2 citesBetter Language Models of Code through Self-Improvement2023 · 2 citesDocChecker: Bootstrapping Code Large Language Model for Detecting and Resolving Code-Comment Inconsistencies2023 · 2 citesImproving Automated Program Repair with Domain Adaptation2022 · 1 cites