paper-with-me

Papers

Charts Are Not Images: On the Challenges of Scientific Chart Editing

2025-11-30 · Shawn Li, Ryan Rossi, Sungchul Kim, Sunav Choudhary, Franck Dernoncourt, Puneet Mathur, Zhengzhong Tu, Yue Zhao arxiv

Generative models, such as diffusion and autoregressive approaches, have demonstrated impressive capabilities in editing natural images. However, applying these tools to scientific charts rests on a flawed assumption: a chart is not merely an arrangement of pixels but a visual representation of structured data governed by a graphical grammar. Consequently, chart editing is not a pixel-manipulation task but a structured transformation problem. To address this fundamental mismatch, we introduce \textit{FigEdit}, a large-scale benchmark for scientific figure editing comprising over 30,000 samples. Grounded in real-world data, our benchmark is distinguished by its diversity, covering 10 distinct chart types and a rich vocabulary of complex editing instructions. The benchmark is organized into five distinct and progressively challenging tasks: single edits, multi edits, conversational edits, visual-guidance-based edits, and style transfer. Our evaluation of a range of state-of-the-art models on this benchmark reveals their poor performance on scientific figures, as they consistently fail to handle the underlying structured transformations required for valid edits. Furthermore, our analysis indicates that traditional evaluation metrics (e.g., SSIM, PSNR) have limitations in capturing the semantic correctness of chart edits. Our benchmark demonstrates the profound limitations of pixel-level manipulation and provides a robust foundation for developing and evaluating future structure-aware models. By releasing \textit{FigEdit} (https://github.com/adobe-research/figure-editing), we aim to enable systematic progress in structure-aware figure editing, provide a common ground for fair comparison, and encourage future research on models that understand both the visual and semantic layers of scientific charts.

📄 PDF Abstract BibTeX arXiv:2512.00752

Code (0)

등록된 구현이 없습니다.

Tasks

Style Transfer

Similar Papers 제목 키워드 기반

ChartReformer: Natural Language-Driven Chart Image Editing

2024-03-01 · Pengyu Yan, Mahesh Bhosale, Jay Lal, Bikhyat Adhikari 외

Chart visualizations are essential for data interpretation and communication; however, most charts are only accessible in image format and lack the corresponding data tables and supplementary information, making it diffi…

Enhancing Scientific Figure Captioning Through Cross-modal Learning

2024-06-24 · Mateo Alejandro Rojas, Rafael Carranza

Scientific charts are essential tools for effectively communicating research findings, serving as a vital medium for conveying information and revealing data patterns. With the rapid advancement of science and technology…

DiversityImage CaptioningInformation RetrievalText Summarization

What Lies Beneath: A Call for Distribution-based Visual Question & Answer Datasets

2026-01-29 · Jill P. Naiman, Daniel J. Evans, JooYoung Seo arxiv

Visual Question Answering (VQA) has become an important benchmark for assessing how large multimodal models (LMMs) interpret images. However, most VQA datasets focus on real-world images or simple diagrammatic analysis, …

Visual Question Answering

LineEX: Data Extraction from Scientific Line Charts

2023-02-06 · Winter Conference on Applications of Computer Vision 2023 2 · Shivasankaran V P, Muhammad Yusuf Hassan, Mayank Singh

In this paper, we introduce LINEEX that extracts data from scientific line charts. We adapt existing vision transformers and pose detection methods and showcase significant performance gains over existing SOTA baselines.…

Semantic-Structural Alignment for Generative Pictorial Charts

2026-05-05 · Zhida Sun, Yulin Zhang, Zheng Gu, Min Lu 외 arxiv

Traditional statistical graphics are precise but often lack the visual appeal, memorability, and engagement of pictorial charts. We present a generative framework for the automated synthesis of pictorial charts that brid…

Visual StorytellingImage Editing