Graph Neural Network for Video Relocalization
In this paper, we focus on video relocalization task, which uses a query video clip as input to retrieve a semantic relative video clip in another untrimmed long video. we find that in video relocalization datasets, there exists a phenomenon showing that there does not exist consistent relationship between feature similarity by frame and feature similarity by video, which affects the feature fusion among frames. However, existing video relocalization methods do not fully consider it. Taking this phenomenon into account, in this article, we treat video features as a graph by concatenating the query video feature and proposal video feature along time dimension, where each timestep is treated as a node, each row of the feature matrix is treated as feature of each node. Then, with the power of graph neural networks, we propose a Multi-Graph Feature Fusion Module to fuse the relation feature of this graph. After evaluating our method on ActivityNet v1.2 dataset and Thumos14 dataset, we find that our proposed method outperforms the state of art methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Graph Neural NetworkMoment RetrievalSimilar Papers 제목 키워드 기반
Generating Adjacency Matrix for Video Relocalization
In this paper, we continue our work on video relocalization task. Based on using graph convolution to extract intra-video and inter-video frame features, we improve the method by using similarity-metric based graph convo…
Moment RetrievalKFNet: Learning Temporal Camera Relocalization using Kalman Filtering
Temporal camera relocalization estimates the pose with respect to each video frame in sequence, as opposed to one-shot relocalization which focuses on a still image. Even though the time dependency has been taken into ac…
Camera RelocalizationS3E-GNN: Sparse Spatial Scene Embedding with Graph Neural Networks for Camera Relocalization
Camera relocalization is the key component of simultaneous localization and mapping (SLAM) systems. This paper proposes a learning-based approach, named Sparse Spatial Scene Embedding with Graph Neural Networks (S3E-GNN)…
Camera RelocalizationSimultaneous Localization and MappingGOReloc: Graph-based Object-Level Relocalization for Visual SLAM
This article introduces a novel method for object-level relocalization of robotic systems. It determines the pose of a camera sensor by robustly associating the object detections in the current frame with 3D objects in a…
Objectobject-detectionObject DetectionObjects Matter: Learning Object Relation Graph for Robust Camera Relocalization
Visual relocalization aims to estimate the pose of a camera from one or more images. In recent years deep learning based pose regression methods have attracted many attentions. They feature predicting the absolute poses …
Camera RelocalizationregressionRelation