← all papers · overview

Chartm: Benchmarking Chart Editing With Multimodal Instructions

Abstract

Charts are a fundamental visualization format widely used in data analysis across research and industry. While enabling users to edit charts based on high-level intentions is of great practical value, existing methods primarily rely on natural language instructions, which are often too ambiguous to support fine-grained editing. In this work, we introduce a novel paradigm for multimodal chart editing, where user intent is expressed through a combination of natural language and visual indicators that explicitly highlight the elements to be modified. To support this paradigm, we present Chart, a new benchmark for Multimodal chart editing with Multi-level complexity and Multi-perspective evaluation. Chart contains 1,000 samples spanning four levels of editing difficulty. Each sample includes triplets in the form of (chart, code, multimodal instructions). To comprehensively evaluate chart editing models, Chart provides metrics that assess both

Related papers

Ranked by semantic similarity — how closely each paper's abstract matches this one (100% = near-identical topic).