paper-with-me

Papers

ChartReformer: Natural Language-Driven Chart Image Editing

2024-03-01 · Pengyu Yan, Mahesh Bhosale, Jay Lal, Bikhyat Adhikari, David Doermann

Chart visualizations are essential for data interpretation and communication; however, most charts are only accessible in image format and lack the corresponding data tables and supplementary information, making it difficult to alter their appearance for different application scenarios. To eliminate the need for original underlying data and information to perform chart editing, we propose ChartReformer, a natural language-driven chart image editing solution that directly edits the charts from the input images with the given instruction prompts. The key in this method is that we allow the model to comprehend the chart and reason over the prompt to generate the corresponding underlying data table and visual attributes for new charts, enabling precise edits. Additionally, to generalize ChartReformer, we define and standardize various types of chart editing, covering style, layout, format, and data-centric edits. The experiments show promising results for the natural language-driven chart image editing.

📄 PDF Abstract BibTeX arXiv:2403.00209

Code (1)

pengyu965/chartreformer 공식 구현 pytorch

Similar Papers 제목 키워드 기반

PlotEdit: Natural Language-Driven Accessible Chart Editing in PDFs via Multimodal LLM Agents

2025-01-20 · Kanika Goswami, Puneet Mathur, Ryan Rossi, Franck Dernoncourt

Chart visualizations, while essential for data interpretation and communication, are predominantly accessible only as images in PDFs, lacking source data tables and stylistic information. To enable effective editing of c…

AttributeTable Extraction

ChartREG++: Towards Benchmarking and Improving Chart Referring Expression Grounding under Diverse referring clues and Multi-Target Referring

2026-05-08 · Tianhao Niu, Ziyu Han, Xuan Dong, Qingfu Zhu 외 arxiv

Referring expression grounding is a core problem in visual grounding and is widely used as a diagnostic of spatial grounding and reasoning in vision and language models, yet most prior work focuses on natural images. In …

Instance SegmentationReferring ExpressionVisual Grounding

ChArtist: Generating Pictorial Charts with Unified Spatial and Subject Control

2026-03-15 · Shishi Xiao, Tongyu Zhou, David Laidlaw, Gromit Yeuk-Yin Chan arxiv

A pictorial chart is an effective medium for visual storytelling, seamlessly integrating visual elements with data charts. However, creating such images is challenging because the flexibility of visual elements often con…

Visual Storytelling

ChartSumm: A Comprehensive Benchmark for Automatic Chart Summarization of Long and Short Summaries

2023-04-26 · Raian Rahman, Rizvi Hasan, Abdullah Al Farhad, Md Tahmid Rahman Laskar 외

Automatic chart to text summarization is an effective tool for the visually impaired people along with providing precise insights of tabular data in natural language to the user. A large and well-structured dataset is al…

Data SummarizationHallucination

ChartNet: A Million-Scale, High-Quality Multimodal Dataset for Robust Chart Understanding

2026-03-28 · Jovana Kondic, Pengyuan Li, Dhiraj Joshi, Isaac Sanchez 외 arxiv

Understanding charts requires models to jointly reason over geometric visual patterns, structured numerical data, and natural language -- a capability where current vision-language models (VLMs) remain limited. We introd…