Stereo 3D Object Trajectory Reconstruction
We present a method to reconstruct the three-dimensional trajectory of a moving instance of a known object category using stereo video data. We track the two-dimensional shape of objects on pixel level exploiting instance-aware semantic segmentation techniques and optical flow cues. We apply Structure from Motion (SfM) techniques to object and background images to determine for each frame initial camera poses relative to object instances and background structures. We refine the initial SfM results by integrating stereo camera constraints exploiting factor graphs. We compute the object trajectory by combining object and background camera pose information. In contrast to stereo matching methods, our approach leverages temporal adjacent views for object point triangulation. As opposed to monocular trajectory reconstruction approaches, our method shows no degenerated cases. We evaluate our approach using publicly available video data of vehicles in urban scenes.
Code (0)
등록된 구현이 없습니다.
Tasks
ObjectOptical Flow EstimationSemantic SegmentationStereo MatchingStereo Matching HandSimilar Papers 제목 키워드 기반
Reconstructing 3D Motion Trajectory of Large Swarm of Flying Objects
This paper addresses the problem of reconstructing the motion trajectories of the individuals in a large collection of flying objects using two temporally synchronized and geometrically calibrated cameras. The 3D traject…
Stereo MatchingSAMP: Shape and Motion Priors for 4D Vehicle Reconstruction
Inferring the pose and shape of vehicles in 3D from a movable platform still remains a challenging task due to the projective sensing principle of cameras, difficult surface properties e.g. reflections or transparency, a…
Pose EstimationStereo Hand-Object Reconstruction for Human-to-Robot Handover
Jointly estimating hand and object shape facilitates the grasping task in human-to-robot handovers. However, relying on hand-crafted prior knowledge about the geometric structure of the object fails when generalising to …
ObjectObject ReconstructionTransparent objectsToward 3D Object Reconstruction from Stereo Images
Inferring the 3D shape of an object from an RGB image has shown impressive results, however, existing methods rely primarily on recognizing the most similar 3D model from the training set to solve the problem. These meth…
3D Object ReconstructionBenchmarkingObjectObject ReconstructionPolka Lines: Learning Structured Illumination and Reconstruction for Active Stereo
Active stereo cameras that recover depth from structured light captures have become a cornerstone sensor modality for 3D scene reconstruction and understanding tasks across application domains. Existing active stereo cam…
3D Scene Reconstruction