Efficient High-Resolution Template Matching with Vector Quantized Nearest Neighbour Fields
Template matching is a fundamental problem in computer vision with applications in fields including object detection, image registration, and object tracking. Current methods rely on nearest-neighbour (NN) matching, where the query feature space is converted to NN space by representing each query pixel with its NN in the template. NN-based methods have been shown to perform better in occlusions, appearance changes, and non-rigid transformations; however, they scale poorly with high-resolution data and high feature dimensions. We present an NN-based method which efficiently reduces the NN computations and introduces filtering in the NN fields (NNFs). A vector quantization step is introduced before the NN calculation to represent the template with $k$ features, and the filter response over the NNFs is used to compare the template and query distributions over the features. We show that state-of-the-art performance is achieved in low-resolution data, and our method outperforms previous methods at higher resolution.
Code (1)
Tasks
Image Registrationobject-detectionObject DetectionObject TrackingQuantizationTemplate MatchingSimilar Papers 제목 키워드 기반
Vector Quantized Contrastive Predictive Coding for Template-based Music Generation
In this work, we propose a flexible method for generating variations of discrete sequences in which tokens can be grouped into basic units, like sentences in a text or bars in music. More precisely, given a template sequ…
Music GenerationOne-Dimensional Vector based Pattern Matching
Template matching is a basic method in image analysis to extract useful information from images. In this paper, we suggest a new method for pattern matching. Our method transform the template image from two dimensional i…
Template MatchingUnleashing Transformers: Parallel Token Prediction with Discrete Absorbing Diffusion for Fast High-Resolution Image Generation from Vector-Quantized Codes
Whilst diffusion probabilistic models can generate high quality image content, key limitations remain in terms of both generating high-resolution imagery and their associated high computational requirements. Recent Vecto…
Image GenerationPurrception: Variational Flow Matching for Vector-Quantized Image Generation
We introduce Purrception, a variational flow matching approach for vector-quantized image generation that provides explicit categorical supervision while maintaining continuous transport dynamics. Our method adapts Varia…
Image GenerationReal-World Blind Super-Resolution via Feature Matching with Implicit High-Resolution Priors
A key challenge of real-world image super-resolution (SR) is to recover the missing details in low-resolution (LR) images with complex unknown degradations (e.g., downsampling, noise and compression). Most previous works…
Blind Super-ResolutionDecoderGenerative Adversarial NetworkImage Super-Resolution+2