paper-with-me

홈 › Papers

SketchGNN: Semantic Sketch Segmentation with Graph Neural Networks

2020-03-02 · Lumin Yang, Jiajie Zhuang, Hongbo Fu, Xiangzhi Wei, Kun Zhou, Youyi Zheng

We introduce SketchGNN, a convolutional graph neural network for semantic segmentation and labeling of freehand vector sketches. We treat an input stroke-based sketch as a graph, with nodes representing the sampled points along input strokes and edges encoding the stroke structure information. To predict the per-node labels, our SketchGNN uses graph convolution and a static-dynamic branching network architecture to extract the features at three levels, i.e., point-level, stroke-level, and sketch-level. SketchGNN significantly improves the accuracy of the state-of-the-art methods for semantic sketch segmentation (by 11.2% in the pixel-based metric and 18.2% in the component-based metric over a large-scale challenging SPG dataset) and has magnitudes fewer parameters than both image-based and sequence-based methods.

📄 PDF Abstract BibTeX arXiv:2003.00678

Code (1)

sYeaLumin/SketchGNN 공식 구현 pytorch

Tasks

Graph Neural NetworkSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Graph Neural Network 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

One Sketch for All: One-Shot Personalized Sketch Segmentation

2021-12-20 · Anran Qi, Yulia Gryaditskaya, Tao Xiang, Yi-Zhe Song

We present the first one-shot personalized sketch segmentation method. We aim to segment all sketches belonging to the same category provisioned with a single sketch with a given part annotation while (i) preserving the …

AllSegmentation

Class-Agnostic Visio-Temporal Scene Sketch Semantic Segmentation

2024-09-30 · Aleyna Kütük, Tevfik Metin Sezgin

Scene sketch semantic segmentation is a crucial task for various applications including sketch-to-image retrieval and scene understanding. Existing sketch segmentation methods treat sketches as bitmap images, leading to …

Image RetrievalScene UnderstandingSegmentationSemantic Segmentation

SFSegNet: Parse Freehand Sketches using Deep Fully Convolutional Networks

2019-08-15 · Junkun Jiang, Ruomei Wang, Shujin Lin, Fei Wang

Parsing sketches via semantic segmentation is attractive but challenging, because (i) free-hand drawings are abstract with large variances in depicting objects due to different drawing styles and skills; (ii) distorting …

Image SegmentationSegmentationSemantic Segmentation

Open Vocabulary Semantic Scene Sketch Understanding

2023-12-18 · CVPR 2024 1 · Ahmed Bourouis, Judith Ellen Fan, Yulia Gryaditskaya

We study the underexplored but fundamental vision problem of machine understanding of abstract freehand scene sketches. We introduce a sketch encoder that results in semantically-aware feature space, which we evaluate by…

DisentanglementVisual Prompt Tuning

Linking Sketch Patches by Learning Synonymous Proximity for Graphic Sketch Representation

2022-11-30 · Sicong Zang, Shikui Tu, Lei Xu

Graphic sketch representations are effective for representing sketches. Existing methods take the patches cropped from sketches as the graph nodes, and construct the edges based on sketch's drawing order or Euclidean dis…

Denoising