paper-with-me

홈 › Papers

SFSegNet: Parse Freehand Sketches using Deep Fully Convolutional Networks

2019-08-15 · Junkun Jiang, Ruomei Wang, Shujin Lin, Fei Wang

Parsing sketches via semantic segmentation is attractive but challenging, because (i) free-hand drawings are abstract with large variances in depicting objects due to different drawing styles and skills; (ii) distorting lines drawn on the touchpad make sketches more difficult to be recognized; (iii) the high-performance image segmentation via deep learning technologies needs enormous annotated sketch datasets during the training stage. In this paper, we propose a Sketch-target deep FCN Segmentation Network(SFSegNet) for automatic free-hand sketch segmentation, labeling each sketch in a single object with multiple parts. SFSegNet has an end-to-end network process between the input sketches and the segmentation results, composed of 2 parts: (i) a modified deep Fully Convolutional Network(FCN) using a reweighting strategy to ignore background pixels and classify which part each pixel belongs to; (ii) affine transform encoders that attempt to canonicalize the shaking strokes. We train our network with the dataset that consists of 10,000 annotated sketches, to find an extensively applicable model to segment stokes semantically in one ground truth. Extensive experiments are carried out and segmentation results show that our method outperforms other state-of-the-art networks.

📄 PDF Abstract BibTeX arXiv:1908.05389

Code (0)

등록된 구현이 없습니다.

Tasks

Image SegmentationSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
FCN Fully Convolutional Networks, or FCNs, are an architecture used mainly for semantic segmentation. They employ solely locally connected layers, such as…

Similar Papers 제목 키워드 기반

Freehand Sketch Recognition Using Deep Features

2015-02-01 · Ravi Kiran Sarvadevabhatla, R. Venkatesh Babu

Freehand sketches often contain sparse visual detail. In spite of the sparsity, they are easily and consistently recognized by humans across cultures, languages and age groups. Therefore, analyzing such sparse sketches c…

Image RetrievalRetrievalSketch-Based Image RetrievalSketch Recognition

SketchParse : Towards Rich Descriptions for Poorly Drawn Sketches using Multi-Task Hierarchical Deep Networks

2017-09-05 · Ravi Kiran Sarvadevabhatla, Isht Dwivedi, Abhijat Biswas, Sahil Manocha 외

The ability to semantically interpret hand-drawn line sketches, although very challenging, can pave way for novel applications in multimedia. We propose SketchParse, the first deep-network architecture for fully automati…

Image RetrievalObjectPose PredictionRetrieval+1

Category-Epitomes : Discriminatively Minimalist Representations for Object Categories

2015-01-31 · Ravi Kiran Sarvadevabhatla, R. Venkatesh Babu

Freehand line sketches are an interesting and unique form of visual representation. Typically, such sketches are studied and utilized as an end product of the sketching process. However, we have found it instructive to s…

Object

SketchBodyNet: A Sketch-Driven Multi-faceted Decoder Network for 3D Human Reconstruction

2023-10-10 · Fei Wang, Kongzhang Tang, Hefeng Wu, Baoquan Zhao 외

Reconstructing 3D human shapes from 2D images has received increasing attention recently due to its fundamental support for many high-level 3D applications. Compared with natural images, freehand sketches are much more f…

3D Human Reconstruction3D ReconstructionDecoder

SketchyCOCO: Image Generation from Freehand Scene Sketches

2020-03-05 · CVPR 2020 6 · Chengying Gao, Qi Liu, Qi Xu, Li-Min Wang 외

We introduce the first method for automatic image generation from scene-level freehand sketches. Our model allows for controllable image generation by specifying the synthesis goal via freehand sketches. The key contribu…

AttributeGenerative Adversarial NetworkImage GenerationObject+1