Combining Texture and Shape Cues for Object Recognition With Minimal Supervision
We present a novel approach to object classification and detection which requires minimal supervision and which combines visual texture cues and shape information learned from freely available unlabeled web search results. The explosion of visual data on the web can potentially make visual examples of almost any object easily accessible via web search. Previous unsupervised methods have utilized either large scale sources of texture cues from the web, or shape information from data such as crowdsourced CAD models. We propose a two-stream deep learning framework that combines these cues, with one stream learning visual texture cues from image search data, and the other stream learning rich shape information from 3D CAD models. To perform classification or detection for a novel image, the predictions of the two streams are combined using a late fusion scheme. We present experiments and visualizations for both tasks on the standard benchmark PASCAL VOC 2007 to demonstrate that texture and shape provide complementary information in our model. Our method outperforms previous web image based models, 3D CAD model based approaches, and weakly supervised models.
Code (0)
등록된 구현이 없습니다.
Tasks
General ClassificationImage RetrievalObject RecognitionSimilar Papers 제목 키워드 기반
DreamTexture: Shape from Virtual Texture with Analysis by Augmentation
DreamFusion established a new paradigm for unsupervised 3D reconstruction from virtual views by combining advances in generative models and differentiable rendering. However, the underlying multi-view rendering, along wi…
3D ReconstructionMonocular ReconstructionShift from Texture-bias to Shape-bias: Edge Deformation-based Augmentation for Robust Object Recognition
Recent studies have shown the vulnerability of CNNs under perturbation noises, which is partially caused by the reason that the well-trained CNNs are too biased toward the object texture, i.e., they make predictions …
Object RecognitionUnderstanding Segment Anything Model: SAM is Biased Towards Texture Rather than Shape
In contrast to the human vision that mainly depends on the shape for recognizing the objects, deep image recognition models are widely known to be biased toward texture. Recently, Meta research team has released the firs…
Image SegmentationSemantic SegmentationShapeY: A Principled Framework for Measuring Shape Recognition Capacity via Nearest-Neighbor Matching
Object recognition (OR) in humans relies heavily on shape cues and the ability to recognize objects across varying 3D viewpoints. Unlike humans, deep networks often rely on non-shape cues such as texture and background, …
Object RecognitionShape-Texture Debiased Neural Network Training
Shape and texture are two prominent and complementary cues for recognizing objects. Nonetheless, Convolutional Neural Networks are often biased towards either texture or shape, depending on the training dataset. Our abla…
Adversarial RobustnessData AugmentationImage ClassificationRepresentation Learning