Keyframe Segmentation and Positional Encoding for Video-guided Machine Translation Challenge 2020
Video-guided machine translation as one of multimodal neural machine translation tasks targeting on generating high-quality text translation by tangibly engaging both video and text. In this work, we presented our video-guided machine translation system in approaching the Video-guided Machine Translation Challenge 2020. This system employs keyframe-based video feature extractions along with the video feature positional encoding. In the evaluation phase, our system scored 36.60 corpus-level BLEU-4 and achieved the 1st place on the Video-guided Machine Translation Challenge 2020.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationTranslationVideo-Guided Machine TranslationSimilar Papers 제목 키워드 기반
GSVNet: Guided Spatially-Varying Convolution for Fast Semantic Segmentation on Video
This paper addresses fast semantic segmentation on video.Video segmentation often calls for real-time, or even fasterthan real-time, processing. One common recipe for conserving computation arising from feature extractio…
Image SegmentationSegmentationSemantic SegmentationVideo Segmentation+1Less Is More, but Where? Dynamic Token Compression via LLM-Guided Keyframe Prior
Recent advances in Video Large Language Models (VLLMs) have achieved remarkable video understanding capabilities, yet face critical efficiency bottlenecks due to quadratic computational growth with lengthy visual token s…
Scalable Neural Video Representations with Learnable Positional Features
Succinct representation of complex signals using coordinate-based neural representations (CNRs) has seen great progress, and several recent efforts focus on extending them for handling videos. Here, the main challenge is…
Video CompressionVideo Frame InterpolationVideo InpaintingVideo Super-ResolutionControllable Generative Video Compression
Perceptual video compression adopts generative video modeling to improve perceptual realism but frequently sacrifices signal fidelity, diverging from the goal of video compression to faithfully reproduce visual signal. T…
Video GenerationM3-CVC: Controllable Video Compression with Multimodal Generative Models
Traditional and neural video codecs commonly encounter limitations in controllability and generality under ultra-low-bitrate coding scenarios. To overcome these challenges, we propose M3-CVC, a controllable video compres…
Video Compression