paper-with-me

Papers

StarVector: Generating Scalable Vector Graphics Code from Images and Text

2023-12-17 · CVPR 2025 1 · Juan A. Rodriguez, Abhay Puri, Shubham Agarwal, Issam H. Laradji, Pau Rodriguez, Sai Rajeswar, David Vazquez, Christopher Pal, Marco Pedersoli

Scalable Vector Graphics (SVGs) are vital for modern image rendering due to their scalability and versatility. Previous SVG generation methods have focused on curve-based vectorization, lacking semantic understanding, often producing artifacts, and struggling with SVG primitives beyond path curves. To address these issues, we introduce StarVector, a multimodal large language model for SVG generation. It performs image vectorization by understanding image semantics and using SVG primitives for compact, precise outputs. Unlike traditional methods, StarVector works directly in the SVG code space, leveraging visual understanding to apply accurate SVG primitives. To train StarVector, we create SVG-Stack, a diverse dataset of 2M samples that enables generalization across vectorization tasks and precise use of primitives like ellipses, polygons, and text. We address challenges in SVG evaluation, showing that pixel-based metrics like MSE fail to capture the unique qualities of vector graphics. We introduce SVG-Bench, a benchmark across 10 datasets, and 3 tasks: Image-to-SVG, Text-to-SVG generation, and diagram generation. Using this setup, StarVector achieves state-of-the-art performance, producing more compact and semantically rich SVGs.

📄 PDF Abstract BibTeX arXiv:2312.11556

Code (1)

visioncortex/vtracer 공식 구현

Tasks

Code GenerationLanguage ModelingLanguage ModellingLarge Language ModelMultimodal Large Language ModelVector Graphics

Methods 이 논문이 사용한 방법론

CLIP Contrastive Language-Image Pre-training (CLIP), consisting of a simplified version of ConVIRT trained from scratch, is an efficient method of image representation learning…
ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…
Adapter 설명 없음

Similar Papers 제목 키워드 기반

Leveraging Large Language Models For Scalable Vector Graphics Processing: A Review

2025-03-06 · Boris Malashenko, Ivan Jarsky, Valeria Efimova

In recent years, rapid advances in computer vision have significantly improved the processing and generation of raster images. However, vector graphics, which is essential in digital design, due to its scalability and ea…

Vector Graphics

DeepIcon: A Hierarchical Network for Layer-wise Icon Vectorization

2024-10-21 · Qi Bing, Chaoyi Zhang, Weidong Cai

In contrast to the well-established technique of rasterization, vectorization of images poses a significant challenge in the field of computer graphics. Recent learning-based methods for converting raster images to vecto…

Vector Graphics

Leveraging Large Language Models for Scalable Vector Graphics-Driven Image Understanding

2023-06-09 · Mu Cai, Zeyi Huang, Yuheng Li, Utkarsh Ojha 외

Large language models (LLMs) have made significant advancements in natural language understanding. However, through that enormous semantic representation that the LLM has learnt, is it somehow possible for it to understa…

Few-Shot Learningimage-classificationImage ClassificationIn-Context Learning+5

BézierSketch: A generative model for scalable vector sketches

2020-07-04 · ECCV 2020 8 · Ayan Das, Yongxin Yang, Timothy Hospedales, Tao Xiang 외

The study of neural generative models of human sketches is a fascinating contemporary modeling problem due to the links between sketch image generation and the human drawing process. The landmark SketchRNN provided break…

Image Generationmodel

SVGDreamer++: Advancing Editability and Diversity in Text-Guided SVG Generation

2024-11-26 · XiMing Xing, Qian Yu, Chuang Wang, Haitao Zhou 외

Recently, text-guided scalable vector graphics (SVG) synthesis has demonstrated significant potential in domains such as iconography and sketching. However, SVGs generated from existing Text-to-SVG methods often lack edi…

DiversityImage SegmentationSemantic SegmentationVector Graphics