paper-with-me

Papers

Point2SpatialCapsule: Aggregating Features and Spatial Relationships of Local Regions on Point Clouds using Spatial-aware Capsules

2019-08-29 · Xin Wen, Zhizhong Han, Xinhai Liu, Yu-Shen Liu

Learning discriminative shape representation directly on point clouds is still challenging in 3D shape analysis and understanding. Recent studies usually involve three steps: first splitting a point cloud into some local regions, then extracting corresponding feature of each local region, and finally aggregating all individual local region features into a global feature as shape representation using simple max pooling. However, such pooling-based feature aggregation methods do not adequately take the spatial relationships between local regions into account, which greatly limits the ability to learn discriminative shape representation. To address this issue, we propose a novel deep learning network, named Point2SpatialCapsule, for aggregating features and spatial relationships of local regions on point clouds, which aims to learn more discriminative shape representation. Compared with traditional max-pooling based feature aggregation networks, Point2SpatialCapsule can explicitly learn not only geometric features of local regions but also spatial relationships among them. It consists of two modules. To resolve the disorder problem of local regions, the first module, named geometric feature aggregation, is designed to aggregate the local region features into the learnable cluster centers, which explicitly encodes the spatial locations from the original 3D space. The second module, named spatial relationship aggregation, is proposed for further aggregating clustered features and the spatial relationships among them in the feature space using the spatial-aware capsules developed in this paper. Compared to the previous capsule network based methods, the feature routing on the spatial-aware capsules can learn more discriminative spatial relationships among local regions for point clouds, which establishes a direct mapping between log priors and the spatial locations through feature clusters.

📄 PDF Abstract BibTeX arXiv:1908.11026

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Capsule Network A capsule is an activation vector that basically executes on its inputs some complex internal computations. Length of these activation vectors signifies the probability of…

Similar Papers 제목 키워드 기반

SCR-Graph: Spatial-Causal Relationships based Graph Reasoning Network for Human Action Prediction

2019-11-22 · Bo Chen, Decai Li, Yuqing He, Chunsheng Hua

Technologies to predict human actions are extremely important for applications such as human robot cooperation and autonomous driving. However, a majority of the existing algorithms focus on exploiting visual features of…

Autonomous DrivingGraph AttentionRelational Reasoning

Spectral-Spatial Global Graph Reasoning for Hyperspectral Image Classification

2021-06-26 · Di Wang, Bo Du, Liangpei Zhang

Convolutional neural networks have been widely applied to hyperspectral image classification. However, traditional convolutions can not effectively extract features for objects with irregular distributions. Recent method…

ClassificationHyperspectral Image Classificationimage-classificationImage Classification

Context-PIPs: Persistent Independent Particles Demands Spatial Context Features

2023-06-03 · Weikang Bian, Zhaoyang Huang, Xiaoyu Shi, Yitong Dong 외

We tackle the problem of Persistent Independent Particles (PIPs), also called Tracking Any Point (TAP), in videos, which specifically aims at estimating persistent long-term trajectories of query points in videos. Previo…

Point Tracking

Efficient Point Transformer with Dynamic Token Aggregating for LiDAR Point Cloud Processing

2024-05-23 · Dening Lu, Jun Zhou, Kyle, Gao 외

Recently, LiDAR point cloud processing and analysis have made great progress due to the development of 3D Transformers. However, existing 3D Transformer methods usually are computationally expensive and inefficient due t…

Combining Graph Neural Network and Mamba to Capture Local and Global Tissue Spatial Relationships in Whole Slide Images

2024-06-05 · Ruiwen Ding, Kha-Dinh Luong, Erika Rodriguez, Ana Cristina Araujo Lemos da Silva 외

In computational pathology, extracting spatial features from gigapixel whole slide images (WSIs) is a fundamental task, but due to their large size, WSIs are typically segmented into smaller tiles. A critical aspect of t…

Graph Neural NetworkMambaMultiple Instance Learningwhole slide images