paper-with-me

Papers

Image Patch Matching Using Convolutional Descriptors with Euclidean Distance

2017-10-31 · Iaroslav Melekhov, Juho Kannala, Esa Rahtu

In this work we propose a neural network based image descriptor suitable for image patch matching, which is an important task in many computer vision applications. Our approach is influenced by recent success of deep convolutional neural networks (CNNs) in object detection and classification tasks. We develop a model which maps the raw input patch to a low dimensional feature vector so that the distance between representations is small for similar patches and large otherwise. As a distance metric we utilize L2 norm, i.e. Euclidean distance, which is fast to evaluate and used in most popular hand-crafted descriptors, such as SIFT. According to the results, our approach outperforms state-of-the-art L2-based descriptors and can be considered as a direct replacement of SIFT. In addition, we conducted experiments with batch normalization and histogram equalization as a preprocessing method of the input data. The results confirm that these techniques further improve the performance of the proposed descriptor. Finally, we show promising preliminary results by appending our CNNs with recently proposed spatial transformer networks and provide a visualisation and interpretation of their impact.

📄 PDF Abstract BibTeX arXiv:1710.11359

Code (0)

등록된 구현이 없습니다.

Tasks

object-detectionObject DetectionPatch Matching

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Spatial Transformer A Spatial Transformer is an image model block that explicitly allows the spatial manipulation of data within a [convolutional neural…
Residual Connection 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

TCDesc: Learning Topology Consistent Descriptors

2020-06-05 · Honghu Pan, Fanyang Meng, Zhenyu He, Yongsheng Liang 외

Triplet loss is widely used for learning local descriptors from image patch. However, triplet loss only minimizes the Euclidean distance between matching descriptors and maximizes that between the non-matching descriptor…

Triplet

Local Convolutional Features With Unsupervised Training for Image Retrieval

2015-12-01 · ICCV 2015 12 · Mattis Paulin, Matthijs Douze, Zaid Harchaoui, Julien Mairal 외

Patch-level descriptors underlie several important computer vision tasks, such as stereo-matching or content-based image retrieval. We introduce a deep convolutional architecture that yields patch-level descriptors, a…

Content-Based Image RetrievalImage RetrievalRetrievalStereo Matching+1

Heavy-tailed Distances for Gradient Based Image Descriptors

2011-12-01 · NeurIPS 2011 12 · Yangqing Jia, Trevor Darrell

Many applications in computer vision measure the similarity between images or image patches based on some statistics such as oriented gradients. These are often modeled implicitly or explicitly with a Gaussian noise assu…

Discriminative Learning of Deep Convolutional Feature Point Descriptors

2015-12-01 · ICCV 2015 12 · Edgar Simo-Serra, Eduard Trulls, Luis Ferraz, Iasonas Kokkinos 외

Deep learning has revolutionalized image-level tasks such as classification, but patch-level tasks, such as correspondence, still rely on hand-crafted features, e.g. SIFT. In this paper we use Convolutional Neural Networ…

Satellite Image Classification

Improved Descriptors for Patch Matching and Reconstruction

2017-01-24 · Rahul Mitra, Jiakai Zhang, Sanath Narayan, Shuaib Ahmed 외

We propose a convolutional neural network (ConvNet) based approach for learning local image descriptors which can be used for significantly improved patch matching and 3D reconstructions. A multi-resolution ConvNet is us…

3D ReconstructionPatch Matching