paper-with-me

Papers

Attention-based Class-Conditioned Alignment for Multi-Source Domain Adaptation of Object Detectors

2024-03-14 · Atif Belal, Akhil Meethal, Francisco Perdigon Romero, Marco Pedersoli, Eric Granger

Domain adaptation methods for object detection (OD) strive to mitigate the impact of distribution shifts by promoting feature alignment across source and target domains. Multi-source domain adaptation (MSDA) allows leveraging multiple annotated source datasets and unlabeled target data to improve the accuracy and robustness of the detection model. Most state-of-the-art MSDA methods for OD perform feature alignment in a class-agnostic manner. This is challenging since the objects have unique modality information due to variations in object appearance across domains. A recent prototype-based approach proposed a class-wise alignment, yet it suffers from error accumulation caused by noisy pseudo-labels that can negatively affect adaptation with imbalanced data. To overcome these limitations, we propose an attention-based class-conditioned alignment method for MSDA, designed to align instances of each object category across domains. In particular, an attention module combined with an adversarial domain classifier allows learning domain-invariant and class-specific instance representations. Experimental results on multiple benchmarking MSDA datasets indicate that our method outperforms state-of-the-art methods and exhibits robustness to class imbalance, achieved through a conceptually simple class-conditioning strategy. Our code is available at: https://github.com/imatif17/ACIA.

📄 PDF Abstract BibTeX arXiv:2403.09918

Code (1)

imatif17/acia 공식 구현 pytorch

Tasks

BenchmarkingDomain AdaptationObjectobject-detectionObject Detection

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

Mask-Align: Self-Supervised Neural Word Alignment

2020-12-13 · ACL 2021 5 · Chi Chen, Maosong Sun, Yang Liu

Word alignment, which aims to align translationally equivalent words between source and target sentences, plays an important role in many natural language processing tasks. Current unsupervised neural alignment methods f…

Machine TranslationTranslationWord Alignment

SAMUeL: Efficient Vocal-Conditioned Music Generation via Soft Alignment Attention and Latent Diffusion

2025-07-26 · Hei Shing Cheung, Boya Zhang, Jonathan H. Chan arxiv

We present a lightweight latent diffusion model for vocal-conditioned musical accompaniment generation that addresses critical limitations in existing music AI systems. Our approach introduces a novel soft alignment atte…

Music Generation

Improving Attention Modeling with Implicit Distortion and Fertility for Machine Translation

2016-12-01 · COLING 2016 12 · Shi Feng, Shujie Liu, Nan Yang, Mu Li 외

In neural machine translation, the attention mechanism facilitates the translation process by producing a soft alignment between the source sentence and the target sentence. However, without dedicated distortion and fert…

DecoderMachine TranslationSentenceTranslation

Hear What Matters! Text-conditioned Selective Video-to-Audio Generation

2025-12-02 · Junwon Lee, Juhan Nam, Jiyoung Lee arxiv

This work introduces a new task, text-conditioned selective video-to-audio (V2A) generation, which produces only the user-intended sound from a multi-object video. This capability is especially crucial in multimedia prod…

Audio Generation

Maximizing Conditional Independence for Unsupervised Domain Adaptation

2022-03-07 · Yi-Ming Zhai, You-Wei Luo

Unsupervised domain adaptation studies how to transfer a learner from a labeled source domain to an unlabeled target domain with different distributions. Existing methods mainly focus on matching the marginal distributio…

Domain AdaptationUnsupervised Domain Adaptation