paper-with-me

홈 › Papers

NeRD++: Improved 3D-mirror symmetry learning from a single image

2021-12-23 · Yancong Lin, Silvia-Laura Pintea, Jan van Gemert

Many objects are naturally symmetric, and this symmetry can be exploited to infer unseen 3D properties from a single 2D image. Recently, NeRD is proposed for accurate 3D mirror plane estimation from a single image. Despite the unprecedented accuracy, it relies on large annotated datasets for training and suffers from slow inference. Here we aim to improve its data and compute efficiency. We do away with the computationally expensive 4D feature volumes and instead explicitly compute the feature correlation of the pixel correspondences across depth, thus creating a compact 3D volume. We also design multi-stage spherical convolutions to identify the optimal mirror plane on the hemisphere, whose inductive bias offers gains in data-efficiency. Experiments on both synthetic and real-world datasets show the benefit of our proposed changes for improved data efficiency and inference speed.

📄 PDF Abstract BibTeX arXiv:2112.12579

Code (0)

등록된 구현이 없습니다.

Tasks

Feature CorrelationInductive BiasSymmetry Detection

Similar Papers 제목 키워드 기반

NeRD: Neural 3D Reflection Symmetry Detector

2021-04-19 · CVPR 2021 1 · Yichao Zhou, Shichen Liu, Yi Ma

Recent advances have shown that symmetry, a structural prior that most objects exhibit, can support a variety of single-view 3D understanding tasks. However, detecting 3D symmetry from an image remains a challenging task…

Pose Estimationregression

Reconstructing 3D Human Pose by Watching Humans in the Mirror

2021-04-01 · CVPR 2021 1 · Qi Fang, Qing Shuai, Junting Dong, Hujun Bao 외

In this paper, we introduce the new task of reconstructing 3D human pose from a single image in which we can see the person and the person's image through a mirror. Compared to general scenarios of 3D pose estimation fro…

3D Pose EstimationPose Estimation

PixNerd: Pixel Neural Field Diffusion

2025-07-31 · Shuai Wang, Ziteng Gao, Chenhui Zhu, Weilin Huang 외 arxiv

The current success of diffusion transformers heavily depends on the compressed latent space shaped by the pre-trained variational autoencoder(VAE). However, this two-stage training paradigm inevitably introduces accumul…

Symmetry-Aware Transformer-based Mirror Detection

2022-07-13 · Tianyu Huang, Bowen Dong, Jiaying Lin, Xiaohui Liu 외

Mirror detection aims to identify the mirror regions in the given input image. Existing works mainly focus on integrating the semantic features and structural features to mine specific relations between mirror and non-mi…

DecoderMirror Detection

NeRD: a Neural Response Divergence Approach to Visual Salience Detection

2016-02-04 · M. J. Shafiee, P. Siva, C. Scharfenberger, P. Fieguth 외

In this paper, a novel approach to visual salience detection via Neural Response Divergence (NeRD) is proposed, where synaptic portions of deep neural networks, previously trained for complex object recognition, are leve…

Object Recognition