Learning Canonical 3D Object Representation for Fine-Grained Recognition
We propose a novel framework for fine-grained object recognition that learns to recover object variation in 3D space from a single image, trained on an image collection without using any ground-truth 3D annotation. We accomplish this by representing an object as a composition of 3D shape and its appearance, while eliminating the effect of camera viewpoint, in a canonical configuration. Unlike conventional methods modeling spatial variation in 2D images only, our method is capable of reconfiguring the appearance feature in a canonical 3D space, thus enabling the subsequent object classifier to be invariant under 3D geometric variation. Our representation also allows us to go beyond existing methods, by incorporating 3D shape variation as an additional cue for object recognition. To learn the model without ground-truth 3D annotation, we deploy a differentiable renderer in an analysis-by-synthesis framework. By incorporating 3D shape and appearance jointly in a deep representation, our method learns the discriminative representation of the object and achieves competitive performance on fine-grained image recognition and vehicle re-identification. We also demonstrate that the performance of 3D shape reconstruction is improved by learning fine-grained shape deformation in a boosting manner.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Shape ReconstructionFine-Grained Image RecognitionObjectObject RecognitionVehicle Re-IdentificationSimilar Papers 제목 키워드 기반
LoDisc: Learning Global-Local Discriminative Features for Self-Supervised Fine-Grained Visual Recognition
Self-supervised contrastive learning strategy has attracted remarkable attention due to its exceptional ability in representation learning. However, current contrastive learning tends to learn global coarse-grained repre…
Contrastive LearningFine-Grained Visual RecognitionObjectObject Recognition+1Learning Canonical View Representation for 3D Shape Recognition with Arbitrary Views
In this paper, we focus on recognizing 3D shapes from arbitrary views, i.e., arbitrary numbers and positions of viewpoints. It is a challenging and realistic setting for view-based 3D shape recognition. We propose a cano…
3D Shape Recognition3D Shape RepresentationMaximum Entropy Regularization and Chinese Text Recognition
Chinese text recognition is more challenging than Latin text due to the large amount of fine-grained Chinese characters and the great imbalance over classes, which causes a serious overfitting problem. We propose to appl…
Fine-Grained Image Classificationimage-classificationImage ClassificationAdversarial Learning for Fine-grained Image Search
Fine-grained image search is still a challenging problem due to the difficulty in capturing subtle differences regardless of pose variations of objects from fine-grained categories. In practice, a dynamic inventory with …
Generative Adversarial NetworkImage RetrievalAligned to the Object, not to the Image: A Unified Pose-aligned Representation for Fine-grained Recognition
Dramatic appearance variation due to pose constitutes a great challenge in fine-grained recognition, one which recent methods using attention mechanisms or second-order statistics fail to adequately address. Modern CNNs …
Fine-Grained Image ClassificationObjectPose Estimation