paper-with-me

Papers

SketchDesc: Learning Local Sketch Descriptors for Multi-view Correspondence

2020-01-16 · Deng Yu, Lei LI, Youyi Zheng, Manfred Lau, Yi-Zhe Song, Chiew-Lan Tai, Hongbo Fu

In this paper, we study the problem of multi-view sketch correspondence, where we take as input multiple freehand sketches with different views of the same object and predict as output the semantic correspondence among the sketches. This problem is challenging since the visual features of corresponding points at different views can be very different. To this end, we take a deep learning approach and learn a novel local sketch descriptor from data. We contribute a training dataset by generating the pixel-level correspondence for the multi-view line drawings synthesized from 3D shapes. To handle the sparsity and ambiguity of sketches, we design a novel multi-branch neural network that integrates a patch-based representation and a multi-scale strategy to learn the pixel-level correspondence among multi-view sketches. We demonstrate the effectiveness of our proposed approach with extensive experiments on hand-drawn sketches and multi-view line drawings rendered from multiple 3D shape datasets.

📄 PDF Abstract BibTeX arXiv:2001.05744

Code (0)

등록된 구현이 없습니다.

Tasks

Semantic correspondence

Similar Papers 제목 키워드 기반

SketchZooms: Deep multi-view descriptors for matching line drawings

2019-11-29 · Pablo Navarro, José Ignacio Orlando, Claudio Delrieux, Emmanuel Iarussi

Finding point-wise correspondences between images is a long-standing problem in image analysis. This becomes particularly challenging for sketch images, due to the varying nature of human drawing style, projection distor…

Multi-view Convolutional Neural Networks for 3D Shape Recognition

2015-05-05 · ICCV 2015 12 · Hang Su, Subhransu Maji, Evangelos Kalogerakis, Erik Learned-Miller

A longstanding question in computer vision concerns the representation of 3D shapes for recognition: should 3D shapes be represented with descriptors operating on their native 3D formats, such as voxel grid or polygon me…

3D Point Cloud Classification3D Shape Recognition

End-to-End Learning Local Multi-view Descriptors for 3D Point Clouds

2020-03-12 · CVPR 2020 6 · Lei Li, Siyu Zhu, Hongbo Fu, Ping Tan 외

In this work, we propose an end-to-end framework to learn local multi-view descriptors for 3D point clouds. To adopt a similar multi-view representation, existing studies use hand-crafted viewpoints for rendering in a pr…

Point Cloud Registration

Compact Tensor Pooling for Visual Question Answering

2017-06-20 · Yang Shi, Tommaso Furlanello, Anima Anandkumar

Performing high level cognitive tasks requires the integration of feature maps with drastically different structure. In Visual Question Answering (VQA) image descriptors have spatial structures, while lexical inputs inhe…

Question AnsweringVisual Question AnsweringVisual Question Answering (VQA)

Online Invariance Selection for Local Feature Descriptors

2020-07-17 · ECCV 2020 8 · Rémi Pautrat, Viktor Larsson, Martin R. Oswald, Marc Pollefeys

To be invariant, or not to be invariant: that is the question formulated in this work about local descriptors. A limitation of current feature descriptors is the trade-off between generalization and discriminative power:…

DisentanglementHomography Estimation