CMDA: Cross-Modality Domain Adaptation for Nighttime Semantic Segmentation

2023-07-29 · ICCV 2023 1 · Ruihao Xia, Chaoqiang Zhao, Meng Zheng, Ziyan Wu, Qiyu Sun, Yang Tang

Most nighttime semantic segmentation studies are based on domain adaptation approaches and image input. However, limited by the low dynamic range of conventional cameras, images fail to capture structural details and boundary information in low-light conditions. Event cameras, as a new form of vision sensors, are complementary to conventional cameras with their high dynamic range. To this end, we propose a novel unsupervised Cross-Modality Domain Adaptation (CMDA) framework to leverage multi-modality (Images and Events) information for nighttime semantic segmentation, with only labels on daytime images. In CMDA, we design the Image Motion-Extractor to extract motion information and the Image Content-Extractor to extract content information from images, in order to bridge the gap between different modalities (Images to Events) and domains (Day to Night). Besides, we introduce the first image-event nighttime semantic segmentation dataset. Extensive experiments on both the public image dataset and the proposed image-event dataset demonstrate the effectiveness of our proposed approach. We open-source our code, models, and dataset at https://github.com/XiaRho/CMDA.

📄 PDF Abstract BibTeX arXiv:2307.15942

Code (1)

xiarho/cmda 공식 구현 pytorch

Tasks

Domain Adaptation Segmentation Semantic Segmentation

Methods 이 논문이 사용한 방법론

fail 설명 없음

CMDA: Cross-Modal and Domain Adversarial Adaptation for LiDAR-Based 3D Object Detection

2024-03-06 · Gyusam Chang, Wonseok Roh, Sujin Jang, Dongwook Lee 외

Recent LiDAR-based 3D Object Detection (3DOD) methods show promising results, but they often do not generalize well to target domains outside the source (or training) data distribution. To reduce such domain gaps and thu…

3D Object Detection Domain Adaptation object-detection Object Detection+1

Unsupervised Cross-Modality Domain Adaptation for Vestibular Schwannoma Segmentation and Koos Grade Prediction based on Semi-Supervised Contrastive Learning

2022-10-09 · Luyi Han, Yunzhi Huang, Tao Tan, Ritse Mann

Domain adaptation has been widely adopted to transfer styles across multi-vendors and multi-centers, as well as to complement the missing modalities. In this challenge, we proposed an unsupervised domain adaptation frame…

Contrastive Learning Domain Adaptation Segmentation Unsupervised Domain Adaptation

Domain-Shared Learning and Gradual Alignment for Unsupervised Domain Adaptation Visible-Infrared Person Re-Identification

2025-11-20 · Nianchang Huang, Yi Xu, Ruida Xi, Ruida Xi 외 arxiv

Recently, Visible-Infrared person Re-Identification (VI-ReID) has achieved remarkable performance on public datasets. However, due to the discrepancies between public datasets and real-world data, most existing VI-ReID a…

Unsupervised Domain Adaptation Person Re-Identification

Exploring the Common Appearance-Boundary Adaptation for Nighttime Optical Flow

2024-01-31 · Hanyu Zhou, Yi Chang, Haoyue Liu, Wending Yan 외

We investigate a challenging task of nighttime optical flow, which suffers from weakened texture and amplified noise. These degradations weaken discriminative visual features, thus causing invalid motion feature matching…

Domain Adaptation Intrinsic Image Decomposition Optical Flow Estimation

BCMDA: Bidirectional Correlation Maps Domain Adaptation for Mixed Domain Semi-Supervised Medical Image Segmentation

2026-03-25 · Bentao Song, Jun Huang, Qingfeng Wang arxiv

In mixed domain semi-supervised medical image segmentation (MiDSS), achieving superior performance under domain shift and limited annotations is challenging. This scenario presents two primary issues: (1) distributional …

Semi-supervised Medical Image Segmentation Domain Adaptation