Neural Implicit Representation for Building Digital Twins of Unknown Articulated Objects
We address the problem of building digital twins of unknown articulated objects from two RGBD scans of the object at different articulation states. We decompose the problem into two stages, each addressing distinct aspects. Our method first reconstructs object-level shape at each state, then recovers the underlying articulation model including part segmentation and joint articulations that associate the two states. By explicitly modeling point-level correspondences and exploiting cues from images, 3D reconstructions, and kinematics, our method yields more accurate and stable results compared to prior work. It also handles more than one movable part and does not rely on any object shape or structure priors. Project page: https://github.com/NVlabs/DigitalTwinArt
Code (1)
Tasks
Articulated Object modellingSimilar Papers 제목 키워드 기반
Ditto: Building Digital Twins of Articulated Objects from Interaction
Digitizing physical objects into the virtual world has the potential to unlock new research and applications in embodied AI and mixed reality. This work focuses on recreating interactive digital twins of real-world artic…
3D geometryMixed RealityObjectEdge-based Parametric Digital Twins for Intelligent Building Indoor Climate Modeling
Digital transformation in the built environment generates vast data for developing data-driven models to optimize building operations. This study presents an integrated solution utilizing edge computing, digital twins, a…
Deep LearningEdge-computingTime SeriesLeveraging Deep Learning and Digital Twins to Improve Energy Performance of Buildings
Digital transformation in buildings accumulates massive operational data, which calls for smart solutions to utilize these data to improve energy performance. This study has proposed a solution, namely Deep Energy Twin, …
Deep LearningVideoArtGS: Building Digital Twins of Articulated Objects from Monocular Video
Building digital twins of articulated objects from monocular video presents an essential challenge in computer vision, which requires simultaneous reconstruction of object geometry, part segmentation, and articulation pa…
Graph Learning for Cognitive Digital Twins in Manufacturing Systems
Future manufacturing requires complex systems that connect simulation platforms and virtualization with physical data from industrial processes. Digital twins incorporate a physical twin, a digital twin, and the connecti…
Graph Learning