Simulation-to-Reality domain adaptation for offline 3D object annotation on pointclouds with correlation alignment

2022-02-06 · Weishuang Zhang, B Ravi Kiran, Thomas Gauthier, Yanis Mazouz, Theo Steger

Annotating objects with 3D bounding boxes in LiDAR pointclouds is a costly human driven process in an autonomous driving perception system. In this paper, we present a method to semi-automatically annotate real-world pointclouds collected by deployment vehicles using simulated data. We train a 3D object detector model on labeled simulated data from CARLA jointly with real world pointclouds from our target vehicle. The supervised object detection loss is augmented with a CORAL loss term to reduce the distance between labeled simulated and unlabeled real pointcloud feature representations. The goal here is to learn representations that are invariant to simulated (labeled) and real-world (unlabeled) target domains. We also provide an updated survey on domain adaptation methods for pointclouds.

📄 PDF Abstract BibTeX arXiv:2202.02666

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous Driving Domain AdaptationObjectobject-detection Object Detection

Methods 이 논문이 사용한 방법론

CORAL 설명 없음

Entropy Regularization 설명 없음

PPO Proximal Policy Optimization, or PPO, is a policy gradient method for reinforcement learning. The motivation was to have an algorithm with the data efficiency and reliable…

CARLA CARLA is an open-source simulator for autonomous driving research. CARLA has been developed from the ground up to support development, training, and validation of autonomous urban…

CTS: Sim-to-Real Unsupervised Domain Adaptation on 3D Detection

2024-06-26 · Meiying Zhang, Weiyuan Peng, Guangyao Ding, Chenyang Lei 외

Simulation data can be accurately labeled and have been expected to improve the performance of data-driven algorithms, including object detection. However, due to the various domain inconsistencies from simulation to rea…

3D Object Detection Domain Adaptation Object object-detection+3

What Robot do I Need? Fast Co-Adaptation of Morphology and Control using Graph Neural Networks

2021-11-03 · Kevin Sebastian Luck, Roberto Calandra, Michael Mistry

The co-adaptation of robot morphology and behaviour becomes increasingly important with the advent of fast 3D-manufacturing methods and efficient deep reinforcement learning algorithms. A major challenge for the applicat…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

BIFROST: Bridging Invariant Feature Representation for Observation-space Sim2Real Transfer

2026-07-01 · Yunfu Deng, Josiah P. Hanna arxiv

Sim2real transfer for robot policy learning suffers due to mismatch between simulation and reality. Existing methods typically address each gap in isolation through separate adaptation modules, which are composed or laye…

Domain Adaptation Visual Navigation

AdaptSim: Task-Driven Simulation Adaptation for Sim-to-Real Transfer

2023-02-09 · Allen Z. Ren, Hongkai Dai, Benjamin Burchfiel, Anirudha Majumdar

Simulation parameter settings such as contact models and object geometry approximations are critical to training robust robotic policies capable of transferring from simulation to real-world deployment. Previous approach…

S2R-ViT for Multi-Agent Cooperative Perception: Bridging the Gap from Simulation to Reality

2023-07-16 · Jinlong Li, Runsheng Xu, Xinyu Liu, Baolu Li 외

Due to the lack of enough real multi-agent data and time-consuming of labeling, existing multi-agent cooperative perception algorithms usually select the simulated sensor data for training and validating. However, the pe…

3D Object Detection object-detection Object Detection Transfer Learning