Domain Adaptation in Multi-View Embedding for Cross-Modal Video Retrieval
Given a gallery of uncaptioned video sequences, this paper considers the task of retrieving videos based on their relevance to an unseen text query. To compensate for the lack of annotations, we rely instead on a related video gallery composed of video-caption pairs, termed the source gallery, albeit with a domain gap between its videos and those in the target gallery. We thus introduce the problem of Unsupervised Domain Adaptation for Cross-modal Video Retrieval, along with a new benchmark on fine-grained actions. We propose a novel iterative domain alignment method by means of pseudo-labelling target videos and cross-domain (i.e. source-target) ranking. Our approach adapts the embedding space to the target gallery, consistently outperforming source-only as well as marginal and conditional alignment methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationRetrievalUnsupervised Domain AdaptationVideo RetrievalSimilar Papers 제목 키워드 기반
Multiview Contrastive Learning for Unsupervised Domain Adaptation in Brain–Computer Interfaces
Domain adaptation has gained significant attention to address the nonstationarity problem in electroencephalography (EEG) data in motor imagery (MI) classification. In MI classification, domain adaptation addresses cross…
ClassificationContrastive LearningDomain AdaptationEEG+3Leveraging Auxiliary Tasks for Document-Level Cross-Domain Sentiment Classification
In this paper, we study domain adaptation with a state-of-the-art hierarchical neural network for document-level sentiment classification. We first design a new auxiliary task based on sentiment scores of domain-independ…
ClassificationDenoisingDomain AdaptationGeneral Classification+5BEVUDA++: Geometric-aware Unsupervised Domain Adaptation for Multi-View 3D Object Detection
Vision-centric Bird's Eye View (BEV) perception holds considerable promise for autonomous driving. Recent studies have prioritized efficiency or accuracy enhancements, yet the issue of domain shift has been overlooked, l…
Unsupervised Domain Adaptation3D Object DetectionAutonomous DrivingIs Domain Adaptation Always Helpful? A Frozen-Backbone Study of Cross-Domain Sentiment Transfer
Sentiment analysis with frozen pre-trained language model (PLM) backbones has become a common paradigm, yet the practical benefit of explicit domain adaptation remains unclear, particularly when backbones encode varying …
Contrastive LearningSentiment AnalysisDomain AdaptationAdaptation Algorithms for Neural Network-Based Speech Recognition: An Overview
We present a structured overview of adaptation algorithms for neural network-based speech recognition, considering both hybrid hidden Markov model / neural network systems and end-to-end neural network systems, with a fo…
Data AugmentationDomain Adaptationspeech-recognitionSpeech Recognition