SketchGNN: Semantic Sketch Segmentation with Graph Neural Networks
We introduce SketchGNN, a convolutional graph neural network for semantic segmentation and labeling of freehand vector sketches. We treat an input stroke-based sketch as a graph, with nodes representing the sampled points along input strokes and edges encoding the stroke structure information. To predict the per-node labels, our SketchGNN uses graph convolution and a static-dynamic branching network architecture to extract the features at three levels, i.e., point-level, stroke-level, and sketch-level. SketchGNN significantly improves the accuracy of the state-of-the-art methods for semantic sketch segmentation (by 11.2% in the pixel-based metric and 18.2% in the component-based metric over a large-scale challenging SPG dataset) and has magnitudes fewer parameters than both image-based and sequence-based methods.
Code (1)
Tasks
Graph Neural NetworkSegmentationSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
One Sketch for All: One-Shot Personalized Sketch Segmentation
We present the first one-shot personalized sketch segmentation method. We aim to segment all sketches belonging to the same category provisioned with a single sketch with a given part annotation while (i) preserving the …
AllSegmentationClass-Agnostic Visio-Temporal Scene Sketch Semantic Segmentation
Scene sketch semantic segmentation is a crucial task for various applications including sketch-to-image retrieval and scene understanding. Existing sketch segmentation methods treat sketches as bitmap images, leading to …
Image RetrievalScene UnderstandingSegmentationSemantic SegmentationSFSegNet: Parse Freehand Sketches using Deep Fully Convolutional Networks
Parsing sketches via semantic segmentation is attractive but challenging, because (i) free-hand drawings are abstract with large variances in depicting objects due to different drawing styles and skills; (ii) distorting …
Image SegmentationSegmentationSemantic SegmentationOpen Vocabulary Semantic Scene Sketch Understanding
We study the underexplored but fundamental vision problem of machine understanding of abstract freehand scene sketches. We introduce a sketch encoder that results in semantically-aware feature space, which we evaluate by…
DisentanglementVisual Prompt TuningLinking Sketch Patches by Learning Synonymous Proximity for Graphic Sketch Representation
Graphic sketch representations are effective for representing sketches. Existing methods take the patches cropped from sketches as the graph nodes, and construct the edges based on sketch's drawing order or Euclidean dis…
Denoising