paper-with-me

Papers

Efficient Hierarchical Graph-Based Segmentation of RGBD Videos

2018-01-26 · CVPR 2014 6 · Steven Hickson, Stan Birchfield, Irfan Essa, Henrik Christensen

We present an efficient and scalable algorithm for segmenting 3D RGBD point clouds by combining depth, color, and temporal information using a multistage, hierarchical graph-based approach. Our algorithm processes a moving window over several point clouds to group similar regions over a graph, resulting in an initial over-segmentation. These regions are then merged to yield a dendrogram using agglomerative clustering via a minimum spanning tree algorithm. Bipartite graph matching at a given level of the hierarchical tree yields the final segmentation of the point clouds by maintaining region identities over arbitrarily long periods of time. We show that a multistage segmentation with depth then color yields better results than a linear combination of depth and color. Due to its incremental processing, our algorithm can process videos of any length and in a streaming pipeline. The algorithm's ability to produce robust, efficient segmentation is demonstrated with numerous experimental results on challenging sequences from our own as well as public RGBD data sets.

📄 PDF Abstract BibTeX arXiv:1801.08981

Code (1)

StevenHickson/4D_Segmentation 공식 구현

Tasks

ClusteringGraph MatchingSegmentationVideo Segmentation

Similar Papers 제목 키워드 기반

Object-Based RGBD Image Co-Segmentation With Mutex Constraint

2015-06-01 · CVPR 2015 6 · Huazhu Fu, Dong Xu, Stephen Lin, Jiang Liu

We present an object-based co-segmentation method that takes advantage of depth data and is able to correctly handle noisy images in which the common foreground object is missing. With RGBD images, our method utilizes th…

ObjectSegmentation

Total-Recon: Deformable Scene Reconstruction for Embodied View Synthesis

2023-04-24 · ICCV 2023 1 · Chonghyuk Song, Gengshan Yang, Kangle Deng, Jun-Yan Zhu 외

We explore the task of embodied view synthesis from monocular videos of deformable scenes. Given a minute-long RGBD video of people interacting with their pets, we render the scene from novel camera trajectories derived …

HI-GAN: Hierarchical Inpainting GAN with Auxiliary Inputs for Combined RGB and Depth Inpainting

2024-02-15 · Ankan Dash, Jingyi Gu, Guiling Wang

Inpainting involves filling in missing pixels or areas in an image, a crucial technique employed in Mixed Reality environments for various applications, particularly in Diminished Reality (DR) where content is removed fr…

Mixed Reality

3D Graph Neural Networks for RGBD Semantic Segmentation

2017-10-01 · ICCV 2017 10 · Xiaojuan Qi, Renjie Liao, Jiaya Jia, Sanja Fidler 외

RGBD semantic segmentation requires joint reasoning about 2D appearance and 3D geometric information. In this paper we propose a 3D graph neural network (3DGNN) that builds a k-nearest neighbor graph on top of 3D point c…

Graph Neural NetworkRGBD Semantic SegmentationSemantic Segmentation

Pose2RGBD. Generating Depth and RGB images from absolute positions

2020-07-14 · Mihai Cristian Pîrvu

We propose a method at the intersection of Computer Vision and Computer Graphics fields, which automatically generates RGBD images using neural networks, based on previously seen and synchronized video, depth and pose si…

NavigateNeural Rendering