Adaptive Aspect Ratios with Patch-Mixup-ViT-based Vehicle ReID
Vision Transformers (ViTs) have shown exceptional performance in vehicle re-identification (ReID) tasks. However, non-square aspect ratios of image or video inputs can negatively impact re-identification accuracy. To address this challenge, we propose a novel, human perception driven, and general ViT-based ReID framework that fuses models trained on various aspect ratios. Our key contributions are threefold: (i) We analyze the impact of aspect ratios on performance using the VeRi-776 and VehicleID datasets, providing guidance for input settings based on the distribution of original image aspect ratios. (ii) We introduce patch-wise mixup strategy during ViT patchification (guided by spatial attention scores) and implement uneven stride for better alignment with object aspect ratios. (iii) We propose a dynamic feature fusion ReID network to enhance model robustness. Our method outperforms state-of-the-art transformer-based approaches on both datasets, with only a minimal increase in inference time per image.
Code (1)
Tasks
Vehicle Re-IdentificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Study on Aspect Ratio Variability toward Robustness of Vision Transformer-based Vehicle Re-identification
Vision Transformers (ViTs) have excelled in vehicle re-identification (ReID) tasks. However, non-square aspect ratios of image or video input might significantly affect the re-identification performance. To address this …
Vehicle Re-Identification$S^{2}$-FracMix: Label-Preserving Self-Saliency Mixup Augmentation
Data augmentation is known to improve generalization of deep visual models. Recent methods favor mixup strategies that generate interpolated samples to improve model performance. However, these techniques not only incur …
Transfer LearningData AugmentationObject DetectionImage Aesthetics Prediction Using Multiple Patches Preserving the Original Aspect Ratio of Contents
The spread of social networking services has created an increasing demand for selecting, editing, and generating impressive images. This trend increases the importance of evaluating image aesthetics as a complementary fu…
PredictionMixup Model Merge: Enhancing Model Merging Performance through Randomized Linear Interpolation
Model merging integrates the parameters of multiple models into a unified model, combining their diverse capabilities. Existing model merging methods are often constrained by fixed parameter merging ratios. In this study…
Adversarial RobustnessData AugmentationmodelPatch-level Neighborhood Interpolation: A General and Effective Graph-based Regularization Strategy
Regularization plays a crucial role in machine learning models, especially for deep neural networks. The existing regularization techniques mainly rely on the i.i.d. assumption and only consider the knowledge from the cu…
Computational Efficiency