Variable-Viewpoint Representations for 3D Object Recognition
For the problem of 3D object recognition, researchers using deep learning methods have developed several very different input representations, including "multi-view" snapshots taken from discrete viewpoints around an object, as well as "spherical" representations consisting of a dense map of essentially ray-traced samples of the object from all directions. These representations offer trade-offs in terms of what object information is captured and to what degree of detail it is captured, but it is not clear how to measure these information trade-offs since the two types of representations are so different. We demonstrate that both types of representations in fact exist at two extremes of a common representational continuum, essentially choosing to prioritize either the number of views of an object or the pixels (i.e., field of view) allotted per view. We identify interesting intermediate representations that lie at points in between these two extremes, and we show, through systematic empirical experiments, how accuracy varies along this continuum as a function of input information as well as the particular deep learning architecture that is used.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Object RecognitionObjectObject RecognitionSimilar Papers 제목 키워드 기반
Time-Conditioned Generative Modeling of Object-Centric Representations for Video Decomposition and Prediction
When perceiving the world from multiple viewpoints, humans have the ability to reason about the complete objects in a compositional manner even when an object is completely occluded from certain viewpoints. Meanwhile, hu…
DisentanglementGaussian ProcessesObjectVideo GenerationOn the robustness of self-supervised representations for multi-view object classification
It is known that representations from self-supervised pre-training can perform on par, and often better, on various downstream tasks than representations from fully-supervised pre-training. This has been shown in a host …
Image RetrievalObjectRetrievalSemantic SegmentationDeep Convolutional Neural Networks in the Face of Caricature: Identity and Image Revealed
Real-world face recognition requires an ability to perceive the unique features of an individual face across multiple, variable images. The primate visual system solves the problem of image invariance using cascades of n…
CaricatureFace RecognitionImage-VariationNetwork IdentificationViewFool: Evaluating the Robustness of Visual Recognition to Adversarial Viewpoints
Recent studies have demonstrated that visual recognition models lack robustness to distribution shift. However, current work mainly considers model robustness to 2D image transformations, leaving viewpoint changes in the…
Autonomous DrivingBenchmarkingData AugmentationNeRFConvolutional Neural Networks for joint object detection and pose estimation: A comparative study
In this paper we study the application of convolutional neural networks for jointly detecting objects depicted in still images and estimating their 3D pose. We identify different feature representations of oriented objec…
General ClassificationObjectobject-detectionObject Detection+1