paper-with-me

홈 › Papers

Memory Efficient Temporal & Visual Graph Model for Unsupervised Video Domain Adaptation

2022-08-13 · Xinyue Hu, Lin Gu, Liangchen Liu, Ruijiang Li, Chang Su, Tatsuya Harada, Yingying Zhu

Existing video domain adaption (DA) methods need to store all temporal combinations of video frames or pair the source and target videos, which are memory cost expensive and can't scale up to long videos. To address these limitations, we propose a memory-efficient graph-based video DA approach as follows. At first our method models each source or target video by a graph: nodes represent video frames and edges represent the temporal or visual similarity relationship between frames. We use a graph attention network to learn the weight of individual frames and simultaneously align the source and target video into a domain-invariant graph feature space. Instead of storing a large number of sub-videos, our method only constructs one graph with a graph attention mechanism for one video, reducing the memory cost substantially. The extensive experiments show that, compared with the state-of-art methods, we achieved superior performance while reducing the memory cost significantly.

📄 PDF Abstract BibTeX arXiv:2208.06554

Code (0)

등록된 구현이 없습니다.

Tasks

Domain AdaptationGraph Attention

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

Jointly Visual- and Semantic-Aware Graph Memory Networks for Temporal Sentence Localization in Videos

2023-03-02 · Daizong Liu, Pan Zhou

Temporal sentence localization in videos (TSLV) aims to retrieve the most interested segment in an untrimmed video according to a given sentence query. However, almost of existing TSLV approaches suffer from the same lim…

Representation LearningSentenceVisual Reasoning

Memory Storyboard: Leveraging Temporal Segmentation for Streaming Self-Supervised Learning from Egocentric Videos

2025-01-21 · Yanlai Yang, Mengye Ren

Self-supervised learning holds the promise to learn good representations from real-world continuous uncurated data streams. However, most existing works in visual self-supervised learning focus on static images or artifi…

Continual LearningContrastive LearningEvent SegmentationSelf-Supervised Learning

Language-guided Recursive Spatiotemporal Graph Modeling for Video Summarization

2025-09-06 · Jungin Park, Jiyoung Lee, Kwanghoon Sohn arxiv

Video summarization aims to select keyframes that are visually diverse and can represent the whole story of a given video. Previous approaches have focused on global interlinkability between frames in a video by temporal…

Video Summarization

Unsupervised Incremental Learning of Deep Descriptors From Video Streams

2017-08-11 · Federico Pernici, Alberto del Bimbo

We present a novel unsupervised method for face identity learning from video sequences. The method exploits the ResNet deep network for face detection and VGGface fc7 face descriptors together with a smart learning mecha…

Face DetectionIncremental Learning

Temporally-Weighted Hierarchical Clustering for Unsupervised Action Segmentation

2021-03-20 · CVPR 2021 1 · M. Saquib Sarfraz, Naila Murray, Vivek Sharma, Ali Diba 외

Action segmentation refers to inferring boundaries of semantically consistent visual concepts in videos and is an important requirement for many video understanding tasks. For this and other video understanding tasks, su…

Action SegmentationClusteringSegmentationUnsupervised Action Segmentation+1