paper-with-me

홈 › Papers

Spherical Transformer for LiDAR-based 3D Recognition

2023-03-22 · CVPR 2023 1 · Xin Lai, Yukang Chen, Fanbin Lu, Jianhui Liu, Jiaya Jia

LiDAR-based 3D point cloud recognition has benefited various applications. Without specially considering the LiDAR point distribution, most current methods suffer from information disconnection and limited receptive field, especially for the sparse distant points. In this work, we study the varying-sparsity distribution of LiDAR points and present SphereFormer to directly aggregate information from dense close points to the sparse distant ones. We design radial window self-attention that partitions the space into multiple non-overlapping narrow and long windows. It overcomes the disconnection issue and enlarges the receptive field smoothly and dramatically, which significantly boosts the performance of sparse distant points. Moreover, to fit the narrow and long windows, we propose exponential splitting to yield fine-grained position encoding and dynamic feature selection to increase model representation ability. Notably, our method ranks 1st on both nuScenes and SemanticKITTI semantic segmentation benchmarks with 81.9% and 74.8% mIoU, respectively. Also, we achieve the 3rd place on nuScenes object detection benchmark with 72.8% NDS and 68.5% mAP. Code is available at https://github.com/dvlab-research/SphereFormer.git.

📄 PDF Abstract BibTeX arXiv:2303.12766

Code (2)

dvlab-research/sphereformer 공식 구현 pytorch
dvlab-research/mask-attention-free-transformer pytorch

Tasks

3D Object Detection3D Semantic Segmentationfeature selectionLIDAR Semantic Segmentationobject-detectionObject DetectionSemantic Segmentation

Methods 이 논문이 사용한 방법론

Feature Selection Feature selection, also known as variable selection, attribute selection or variable subset selection, is the process of selecting a subset of relevant features (variables,…

Similar Papers 제목 키워드 기반

MinkLoc3D-SI: 3D LiDAR place recognition with sparse convolutions, spherical coordinates, and intensity

2021-12-13 · Kamil Żywanowski, Adam Banaszczyk, Michał R. Nowicki, Jacek Komorowski

The 3D LiDAR place recognition aims to estimate a coarse localization in a previously seen environment based on a single scan from a rotating 3D LiDAR sensor. The existing solutions to this problem include hand-crafted p…

3D Place RecognitionAutonomous Vehicles

SpheriGait: Enriching Spatial Representation via Spherical Projection for LiDAR-based Gait Recognition

2024-09-18 · Yanxi Wang, Zhigang Chang, Chen Wu, Zihao Cheng 외

Gait recognition is a rapidly progressing technique for the remote identification of individuals. Prior research predominantly employing 2D sensors to gather gait data has achieved notable advancements; nonetheless, they…

Gait Recognition

Spherical Frustum Sparse Convolution Network for LiDAR Point Cloud Semantic Segmentation

2023-11-29 · Yu Zheng, Guangming Wang, Jiuming Liu, Marc Pollefeys 외

LiDAR point cloud semantic segmentation enables the robots to obtain fine-grained semantic information of the surrounding environment. Recently, many works project the point cloud onto the 2D image and adopt the 2D Convo…

PositionSegmentationSemantic Segmentation

TransUPR: A Transformer-based Uncertain Point Refiner for LiDAR Point Cloud Semantic Segmentation

2023-02-16 · Zifan Yu, Meida Chen, Zhikang Zhang, Suya You 외

Common image-based LiDAR point cloud semantic segmentation (LiDAR PCSS) approaches have bottlenecks resulting from the boundary-blurring problem of convolution neural networks (CNNs) and quantitation loss of spherical pr…

Image SegmentationSegmentationSemantic Segmentation

MinkUNeXt-SI: Improving point cloud-based place recognition including spherical coordinates and LiDAR intensity

2025-05-23 · Judith Vilella-Cantos, Juan José Cabrera, Luis Payá, Mónica Ballesta 외

In autonomous navigation systems, the solution of the place recognition problem is crucial for their safe functioning. But this is not a trivial solution, since it must be accurate regardless of any changes in the scene,…

Autonomous Navigation