paper-with-me

홈 › Papers

LiOn-XA: Unsupervised Domain Adaptation via LiDAR-Only Cross-Modal Adversarial Training

2024-10-21 · Thomas Kreutz, Jens Lemke, Max Mühlhäuser, Alejandro Sanchez Guinea

In this paper, we propose LiOn-XA, an unsupervised domain adaptation (UDA) approach that combines LiDAR-Only Cross-Modal (X) learning with Adversarial training for 3D LiDAR point cloud semantic segmentation to bridge the domain gap arising from environmental and sensor setup changes. Unlike existing works that exploit multiple data modalities like point clouds and RGB image data, we address UDA in scenarios where RGB images might not be available and show that two distinct LiDAR data representations can learn from each other for UDA. More specifically, we leverage 3D voxelized point clouds to preserve important geometric structure in combination with 2D projection-based range images that provide information such as object orientations or surfaces. To further align the feature space between both domains, we apply adversarial training using both features and predictions of both 2D and 3D neural networks. Our experiments on 3 real-to-real adaptation scenarios demonstrate the effectiveness of our approach, achieving new state-of-the-art performance when compared to previous uni- and multi-model UDA methods. Our source code is publicly available at https://github.com/JensLe97/lion-xa.

📄 PDF Abstract BibTeX arXiv:2410.15833

Code (1)

jensle97/lion-xa 공식 구현 pytorch

Tasks

Domain AdaptationSemantic SegmentationUnsupervised Domain Adaptation

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

SF-UDA$^{3D}$: Source-Free Unsupervised Domain Adaptation for LiDAR-Based 3D Object Detection

2020-10-16 · Cristiano Saltori, Stéphane Lathuiliére, Nicu Sebe, Elisa Ricci 외

3D object detectors based only on LiDAR point clouds hold the state-of-the-art on modern street-view benchmarks. However, LiDAR-based detectors poorly generalize across domains due to domain shift. In the case of LiDAR, …

3D Object DetectionDomain AdaptationObjectobject-detection+2

Unsupervised Domain Adaptation in LiDAR Semantic Segmentation with Self-Supervision and Gated Adapters

2021-07-20 · Mrigank Rochan, Shubhra Aich, Eduardo R. Corral-Soto, Amir Nabatchian 외

In this paper, we focus on a less explored, but more realistic and complex problem of domain adaptation in LiDAR semantic segmentation. There is a significant drop in performance of an existing segmentation model when tr…

Domain AdaptationLIDAR Semantic SegmentationSegmentationSemantic Segmentation+1

SALUDA: Surface-based Automotive Lidar Unsupervised Domain Adaptation

2023-04-06 · Björn Michele, Alexandre Boulch, Gilles Puy, Tuan-Hung Vu 외

Learning models on one labeled dataset that generalize well on another domain is a difficult task, as several shifts might happen between the data domains. This is notably the case for lidar data, for which models can ex…

3D Unsupervised Domain AdaptationDomain AdaptationSemantic SegmentationUnsupervised Domain Adaptation

Fake it, Mix it, Segment it: Bridging the Domain Gap Between Lidar Sensors

2022-12-19 · Frederik Hasecke, Pascal Colling, Anton Kummert

Segmentation of lidar data is a task that provides rich, point-wise information about the environment of robots or autonomous vehicles. Currently best performing neural networks for lidar segmentation are fine-tuned to s…

Autonomous VehiclesDomain AdaptationSegmentationSemantic Segmentation+2

Enhanced Prototypical Learning for Unsupervised Domain Adaptation in LiDAR Semantic Segmentation

2022-05-23 · Eojindl Yi, JuYoung Yang, Junmo Kim

Despite its importance, unsupervised domain adaptation (UDA) on LiDAR semantic segmentation is a task that has not received much attention from the research community. Only recently, a completion-based 3D method has been…

Domain AdaptationLIDAR Semantic SegmentationPseudo LabelSegmentation+2