paper-with-me

홈 › Papers

RangeSAM: On the Potential of Visual Foundation Models for Range-View represented LiDAR segmentation

2025-09-19 · Paul Julius Kühn, Duc Anh Nguyen, Arjan Kuijper, Saptarshi Neil Sinha arxiv

Point cloud segmentation is central to autonomous driving and 3D scene understanding. While voxel- and point-based methods dominate recent research due to their compatibility with deep architectures and ability to capture fine-grained geometry, they often incur high computational cost, irregular memory access, and limited real-time efficiency. In contrast, range-view methods, though relatively underexplored - can leverage mature 2D semantic segmentation techniques for fast and accurate predictions. Motivated by the rapid progress in Visual Foundation Models (VFMs) for captioning, zero-shot recognition, and multimodal tasks, we investigate whether SAM2, the current state-of-the-art VFM for segmentation tasks, can serve as a strong backbone for LiDAR point cloud segmentation in the range view. We present , to our knowledge, the first range-view framework that adapts SAM2 to 3D segmentation, coupling efficient 2D feature extraction with standard projection/back-projection to operate on point clouds. To optimize SAM2 for range-view representations, we implement several architectural modifications to the encoder: (1) a novel module that emphasizes horizontal spatial dependencies inherent in LiDAR range images, (2) a customized configuration of tailored to the geometric properties of spherical projections, and (3) an adapted mechanism in the encoder backbone specifically designed to capture the unique spatial patterns and discontinuities present in range-view pseudo-images. Our approach achieves competitive performance on SemanticKITTI while benefiting from the speed, scalability, and deployment simplicity of 2D-centric pipelines. This work highlights the viability of VFMs as general-purpose backbones for 3D perception and opens a path toward unified, foundation-model-driven LiDAR segmentation. Results lets us conclude that range-view segmentation methods using VFMs leads to promising results.

📄 PDF Abstract BibTeX arXiv:2509.15886

Code (0)

등록된 구현이 없습니다.

Tasks

Point Cloud Segmentation2D Semantic SegmentationScene UnderstandingAutonomous Driving

Similar Papers 제목 키워드 기반

SplatR : Experience Goal Visual Rearrangement with 3D Gaussian Splatting and Dense Feature Matching

2024-11-21 · Arjun P S, Andrew Melnik, Gora Chand Nandi

Experience Goal Visual Rearrangement task stands as a foundational challenge within Embodied AI, requiring an agent to construct a robust world model that accurately captures the goal state. The agent uses this world mod…

Visual Mamba: A Survey and New Outlooks

2024-04-29 · Rui Xu, Shu Yang, Yihui Wang, Yu Cai 외

Mamba, a recent selective structured state space model, excels in long sequence modeling, which is vital in the large model era. Long sequence modeling poses significant challenges, including capturing long-range depende…

MambaSurvey

OverlapMamba: Novel Shift State Space Model for LiDAR-based Place Recognition

2024-05-13 · Qiuchi Xiang, Jintao Cheng, Jiehao Luo, Jin Wu 외

Place recognition is the foundation for enabling autonomous systems to achieve independent decision-making and safe operations. It is also crucial in tasks such as loop closure detection and global localization within SL…

Decision MakingLoop Closure DetectionMambaState Space Models

Scaling Spatial Intelligence with Multimodal Foundation Models

2025-11-17 · Zhongang Cai, Ruisi Wang, Chenyang Gu, Fanyi Pu 외 arxiv

Despite remarkable progress, multimodal foundation models still exhibit surprising deficiencies in spatial intelligence. In this work, we explore scaling up multimodal foundation models to cultivate spatial intelligence …

MAVias: Mitigate any Visual Bias

2024-12-09 · Ioannis Sarridis, Christos Koutlis, Symeon Papadopoulos, Christos Diou

Mitigating biases in computer vision models is an essential step towards the trustworthiness of artificial intelligence models. Existing bias mitigation methods focus on a small set of predefined biases, limiting their a…

Language ModelingLanguage ModellingLarge Language Model