Improved Descriptors for Patch Matching and Reconstruction
We propose a convolutional neural network (ConvNet) based approach for learning local image descriptors which can be used for significantly improved patch matching and 3D reconstructions. A multi-resolution ConvNet is used for learning keypoint descriptors. We also propose a new dataset consisting of an order of magnitude more number of scenes, images, and positive and negative correspondences compared to the currently available Multi-View Stereo (MVS) [18] dataset. The new dataset also has better coverage of the overall viewpoint, scale, and lighting changes in comparison to the MVS dataset. We evaluate our approach on publicly available datasets, such as Oxford Affine Covariant Regions Dataset (ACRD) [12], MVS [18], Synthetic [6] and Strecha [15] datasets to quantify the image descriptor performance. Scenes from the Oxford ACRD, MVS and Synthetic datasets are used for evaluating the patch matching performance of the learnt descriptors while the Strecha dataset is used to evaluate the 3D reconstruction task. Experiments show that the proposed descriptor outperforms the current state-of-the-art descriptors in both the evaluation tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
3D ReconstructionPatch MatchingSimilar Papers 제목 키워드 기반
Pore-scale Image Patch Dataset and A Comparative Evaluation of Pore-scale Facial Features
The weak-texture nature of facial skin regions presents significant challenges for local descriptor matching in applications such as facial motion analysis and 3D face reconstruction. Although deep learning-based descrip…
3D Face Reconstruction3D ReconstructionA Large Dataset for Improving Patch Matching
We propose a new dataset for learning local image descriptors which can be used for significantly improved patch matching. Our proposed dataset consists of an order of magnitude more number of scenes, images, and positiv…
Patch MatchingRetrievalPN-Net: Conjoined Triple Deep Network for Learning Local Image Descriptors
In this paper we propose a new approach for learning local descriptors for matching image patches. It has recently been demonstrated that descriptors based on convolutional neural networks (CNN) can significantly improve…
GPUDescriptor-Free Multi-View Region Matching for Instance-Wise 3D Reconstruction
This paper proposes a multi-view extension of instance segmentation without relying on texture or shape descriptor matching. Multi-view instance segmentation becomes challenging for scenes with repetitive textures and sh…
3D ReconstructionInstance SegmentationSegmentationSemantic SegmentationThe CUDA LATCH Binary Descriptor: Because Sometimes Faster Means Better
Accuracy, descriptor size, and the time required for extraction and matching are all important factors when selecting local image descriptors. To optimize over all these requirements, this paper presents a CUDA port for …
GPU