paper-with-me

Papers

Continuous Conditional Random Field Convolution for Point Cloud Segmentation

2021-10-12 · Fei Yang, Franck Davoine, Huan Wang, Zhong Jin

Point cloud segmentation is the foundation of 3D environmental perception for modern intelligent systems. To solve this problem and image segmentation, conditional random fields (CRFs) are usually formulated as discrete models in label space to encourage label consistency, which is actually a kind of postprocessing. In this paper, we reconsider the CRF in feature space for point cloud segmentation because it can capture the structure of features well to improve the representation ability of features rather than simply smoothing. Therefore, we first model the point cloud features with a continuous quadratic energy model and formulate its solution process as a message-passing graph convolution, by which it can be easily integrated into a deep network. We theoretically demonstrate that the message passing in the graph convolution is equivalent to the mean-field approximation of a continuous CRF model. Furthermore, we build an encoder-decoder network based on the proposed continuous CRF graph convolution (CRFConv), in which the CRFConv embedded in the decoding layers can restore the details of high-level features that were lost in the encoding stage to enhance the location ability of the network, thereby benefiting segmentation. Analogous to the CRFConv, we show that the classical discrete CRF can also work collaboratively with the proposed network via another graph convolution to further improve the segmentation results. Experiments on various point cloud benchmarks demonstrate the effectiveness and robustness of the proposed method. Compared with the state-of-the-art methods, the proposed method can also achieve competitive segmentation performance.

📄 PDF Abstract BibTeX arXiv:2110.06085

Code (1)

yangfei1223/crfconv 공식 구현 pytorch

Tasks

Image SegmentationPoint Cloud SegmentationSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

CRF Conditional Random Fields or CRFs are a type of probabilistic graph model that take neighboring sample context into account for tasks like classification. Prediction is…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

What's the point? Frame-wise Pointing Gesture Recognition with Latent-Dynamic Conditional Random Fields

2015-10-20 · Christian Wittner, Boris Schauerte, Rainer Stiefelhagen

We use Latent-Dynamic Conditional Random Fields to perform skeleton-based pointing gesture classification at each time instance of a video sequence, where we achieve a frame-wise pointing accuracy of roughly 83%. Subsequ…

General ClassificationGesture Recognition

Learning Depth from Single Monocular Images Using Deep Convolutional Neural Fields

2015-02-26 · Fayao Liu, Chunhua Shen, Guosheng Lin, Ian Reid

In this article, we tackle the problem of depth estimation from single monocular images. Compared with depth estimation using multiple images such as stereo depth perception, depth from monocular images is much more chal…

Depth Estimation

Face Parsing via a Fully-Convolutional Continuous CRF Neural Network

2017-08-12 · Lei Zhou, Zhi Liu, Xiangjian He

In this work, we address the face parsing task with a Fully-Convolutional continuous CRF Neural Network (FC-CNN) architecture. In contrast to previous face parsing methods that apply region-based subnetwork hundreds of t…

Face Parsing

Multi-Scale Continuous CRFs as Sequential Deep Networks for Monocular Depth Estimation

2017-04-07 · CVPR 2017 7 · Dan Xu, Elisa Ricci, Wanli Ouyang, Xiaogang Wang 외

This paper addresses the problem of depth estimation from a single still image. Inspired by recent works on multi- scale convolutional neural networks (CNN), we propose a deep model which fuses complementary information …

Depth EstimationMonocular Depth Estimation

Global Ranking Using Continuous Conditional Random Fields

2008-12-01 · NeurIPS 2008 12 · Tao Qin, Tie-Yan Liu, Xu-Dong Zhang, De-Sheng Wang 외

This paper studies global ranking problem by learning to rank methods. Conventional learning to rank methods are usually designed for `local ranking', in the sense that the ranking model is defined on a single object, fo…

Information RetrievalLearning-To-RankRetrieval