Is Single-View Mesh Reconstruction Ready for Robotics?
This paper evaluates single-view mesh reconstruction models for creating digital twin environments in robot manipulation. Recent advances in computer vision for 3D reconstruction from single viewpoints present a potential breakthrough for efficiently creating virtual replicas of physical environments for robotics contexts. However, their suitability for physics simulations and robotics applications remains unexplored. We establish benchmarking criteria for 3D reconstruction in robotics contexts, including handling typical inputs, producing collision-free and stable reconstructions, managing occlusions, and meeting computational constraints. Our empirical evaluation using realistic robotics datasets shows that despite success on computer vision benchmarks, existing approaches fail to meet robotics-specific requirements. We quantitively examine limitations of single-view reconstruction for practical robotics implementation, in contrast to prior work that focuses on multi-view approaches. Our findings highlight critical gaps between computer vision advances and robotics needs, guiding future research at this intersection.
Code (0)
등록된 구현이 없습니다.
Tasks
3D ReconstructionBenchmarkingRobot ManipulationSimilar Papers 제목 키워드 기반
PixARMesh: Autoregressive Mesh-Native Single-View Scene Reconstruction
We introduce PixARMesh, a method to autoregressively reconstruct complete 3D indoor scene meshes directly from a single RGB image. Unlike prior methods that rely on implicit signed distance fields and post-hoc layout opt…
Spatial ReasoningCity-Mesh3R: Simulation-Ready City-Scale 3D Mesh Reconstruction from Multi-View Images
City-scale 3D surface reconstruction from multiview images for downstream 3D simulation, poses highly challenging problems due to the scale and complexity of urban scenes. Existing city-scale 3D reconstruction methods ba…
3D ReconstructionImage ClusteringTriSplat: Simulation-Ready Feed-Forward 3D Scene Reconstruction
Sparse-view 3D reconstruction is increasingly addressed with feed-forward splatting networks that predict explicit primitives directly from images. Yet most existing methods remain centered on Gaussian primitives and exp…
3D ReconstructionHoloTetSphere: Unified TetSphere Mesh Reconstruction for Physical Simulations
Standard pipelines for physics-ready 3D reconstruction rely on a decoupled two-stage paradigm: extracting surface geometry followed by an error-prone tetrahedralization process. While recent Lagrangian methods like TetSp…
Physical Simulations3D Reconstruction3DCaricShop: A Dataset and A Baseline Method for Single-view 3D Caricature Face Reconstruction
Caricature is an artistic representation that deliberately exaggerates the distinctive features of a human face to convey humor or sarcasm. However, reconstructing a 3D caricature from a 2D caricature image remains a cha…
CaricatureFace Reconstruction