Orientation Matters: Making 3D Generative Models Orientation-Aligned
Humans intuitively perceive object shape and orientation from a single image, guided by strong priors about canonical poses. However, existing 3D generative models often produce misaligned results due to inconsistent training data, limiting their usability in downstream tasks. To address this gap, we introduce the task of orientation-aligned 3D object generation: producing 3D objects from single images with consistent orientations across categories. To facilitate this, we construct Objaverse-OA, a dataset of 14,832 orientation-aligned 3D models spanning 1,008 categories. Leveraging Objaverse-OA, we fine-tune two representative 3D generative models based on multi-view diffusion and 3D variational autoencoder frameworks to produce aligned objects that generalize well to unseen objects across various categories. Experimental results demonstrate the superiority of our method over post-hoc alignment approaches. Furthermore, we showcase downstream applications enabled by our aligned object generation, including zero-shot object orientation estimation via analysis-by-synthesis and efficient arrow-based object rotation manipulation.
Code (0)
등록된 구현이 없습니다.
Tasks
ObjectMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Symmetry-Robust 3D Orientation Estimation
Orientation estimation is a fundamental task in 3D shape analysis which consists of estimating a shape's orientation axes: its side-, up-, and front-axes. Using this data, one can rotate a shape into canonical orientatio…
Learning Orientation-Estimation Convolutional Neural Network for Building Detection in Optical Remote Sensing Image
Benefiting from the great success of deep learning in computer vision, CNN-based object detection methods have drawn significant attentions. Various frameworks have been proposed which show awesome and robust performance…
GPUobject-detectionObject DetectionregressionDirection Matters: Depth Estimation With a Surface Normal Classifier
In this work we make use of recent advances in data driven classification to improve standard approaches for binocular stereo matching and single view depth estimation. Surface normal direction estimation has become feas…
Depth EstimationStereo MatchingStereo Matching HandOrientation Invariant Feature Embedding and Spatial Temporal Regularization for Vehicle Re-Identification
In this paper, we tackle the vehicle Re-identification (ReID) problem which is of great importance in urban surveillance and can be used for multiple applications. In our vehicle ReID framework, an orientation invariant …
RetrievalVehicle Re-IdentificationExamining Different Placement Strategies for Indoor Environmental Quality Sensors in Office Environments
Collecting Indoor Environmental Quality (IEQ) data from an occupant's immediate surroundings can provide personalized insights for healthy environmental conditions aligned with occupant preferences, but effective sensor …
Position