paper-with-me

Papers

Primal-Dual Mesh Convolutional Neural Networks

2020-10-23 · NeurIPS 2020 12 · Francesco Milano, Antonio Loquercio, Antoni Rosinol, Davide Scaramuzza, Luca Carlone

Recent works in geometric deep learning have introduced neural networks that allow performing inference tasks on three-dimensional geometric data by defining convolution, and sometimes pooling, operations on triangle meshes. These methods, however, either consider the input mesh as a graph, and do not exploit specific geometric properties of meshes for feature aggregation and downsampling, or are specialized for meshes, but rely on a rigid definition of convolution that does not properly capture the local topology of the mesh. We propose a method that combines the advantages of both types of approaches, while addressing their limitations: we extend a primal-dual framework drawn from the graph-neural-network literature to triangle meshes, and define convolutions on two types of graphs constructed from an input mesh. Our method takes features for both edges and faces of a 3D mesh as input and dynamically aggregates them using an attention mechanism. At the same time, we introduce a pooling operation with a precise geometric interpretation, that allows handling variations in the mesh connectivity by clustering mesh faces in a task-driven fashion. We provide theoretical insights of our approach using tools from the mesh-simplification literature. In addition, we validate experimentally our method in the tasks of shape classification and shape segmentation, where we obtain comparable or superior performance to the state of the art.

📄 PDF Abstract BibTeX arXiv:2010.12455

Code (1)

MIT-SPARK/PD-MeshNet 공식 구현 pytorch

Tasks

ClusteringGraph Neural Network

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Dual Mesh Convolutional Networks for Human Shape Correspondence

2021-03-23 · Nitika Verma, Adnane Boukhayma, Jakob Verbeek, Edmond Boyer

Convolutional networks have been extremely successful for regular data structures such as 2D images and 3D voxel grids. The transposition to meshes is, however, not straight-forward due to their irregular structure. We e…

3D Shape Representation

Accelerated primal-dual methods with enlarged step sizes and operator learning for nonsmooth optimal control problems

2023-07-01 · Yongcun Song, Xiaoming Yuan, Hangrui Yue

We consider a general class of nonsmooth optimal control problems with partial differential equation (PDE) constraints, which are very challenging due to its nonsmooth objective functionals and the resulting high-dimensi…

Operator learning

Smooth Mesh Estimation from Depth Data using Non-Smooth Convex Optimization

2021-08-06 · Antoni Rosinol, Luca Carlone

Meshes are commonly used as 3D maps since they encode the topology of the scene while being lightweight. Unfortunately, 3D meshes are mathematically difficult to handle directly because of their combinatorial and discret…

Visual Odometry

STPDnet: Spatial-temporal convolutional primal dual network for dynamic PET image reconstruction

2023-03-08 · Rui Hu, Jianan Cui, Chengjin Yu, YunMei Chen 외

Dynamic positron emission tomography (dPET) image reconstruction is extremely challenging due to the limited counts received in individual frame. In this paper, we propose a spatial-temporal convolutional primal dual net…

Image Reconstruction

PDNet: Semantic Segmentation integrated with a Primal-Dual Network for Document binarization

2018-01-26 · Kalyan Ram Ayyalasomayajula, Filip Malmberg, Anders Brun

Binarization of digital documents is the task of classifying each pixel in an image of the document as belonging to the background (parchment/paper) or foreground (text/ink). Historical documents are often subjected to d…

BinarizationSemantic Segmentation