Semantic Jitter: Dense Supervision for Visual Comparisons via Synthetic Images
Distinguishing subtle differences in attributes is valuable, yet learning to make visual comparisons remains non-trivial. Not only is the number of possible comparisons quadratic in the number of training images, but also access to images adequately spanning the space of fine-grained visual differences is limited. We propose to overcome the sparsity of supervision problem via synthetically generated images. Building on a state-of-the-art image generation engine, we sample pairs of training images exhibiting slight modifications of individual attributes. Augmenting real training image pairs with these examples, we then train attribute ranking models to predict the relative strength of an attribute in novel pairs of real images. Our results on datasets of faces and fashion images show the great promise of bootstrapping imperfect image generators to counteract sample sparsity for learning to rank.
Code (0)
등록된 구현이 없습니다.
Tasks
AttributeImage GenerationLearning-To-RankSimilar Papers 제목 키워드 기반
From Dense Prediction to Visual Editing: Structured Supervision for Unified Image and Video Creation
Unified image and video creation requires a model to follow diverse instructions while preserving identity, geometry, and temporal structure from visual context. However, semantic-only conditioning and creation-only trai…
Enhancing 3D LiDAR Segmentation by Shaping Dense and Accurate 2D Semantic Predictions
Semantic segmentation of 3D LiDAR point clouds is important in urban remote sensing for understanding real-world street environments. This task, by projecting LiDAR point clouds and 3D semantic labels as sparse maps, can…
Semantic SegmentationPoint CloudsSeparating the "Chirp" from the "Chat": Self-supervised Visual Grounding of Sound and Language
We present DenseAV, a novel dual encoder grounding architecture that learns high-resolution, semantically meaningful, and audio-visually aligned features solely through watching videos. We show that DenseAV can discover …
Contrastive LearningCross-Modal RetrievalSemantic SegmentationSound Prompted Semantic Segmentation+2Learning Multi-Modal Prototypes for Cross-Domain Few-Shot Object Detection
Cross-Domain Few-Shot Object Detection (CD-FSOD) aims to detect novel classes in unseen target domains given only a few labeled examples. While open-vocabulary detectors built on vision-language models (VLMs) transfer we…
Cross-Domain Few-Shot Object DetectionRevisiting Multi-Task Visual Representation Learning
Current visual representation learning remains bifurcated: vision-language models (e.g., CLIP) excel at global semantic alignment but lack spatial precision, while self-supervised methods (e.g., MAE, DINO) capture intric…
Representation LearningMulti-Task LearningSpatial Reasoning