Papers Referring Video Object Segmentation
“Referring Video Object Segmentation” 태그가 달린 논문 106편 · 필터 해제
Unlocking Motion in Expressions: Temporal Calibration for Referring Video Object Segmentation
Referring Video Object Segmentation (RVOS) aims to segment referred objects at the pixel level in video sequences based on natural language descriptions. Existing methods typically introduce motion information within a u…
Referring Video Object SegmentationDecision MakingFeVOS: Foresight Expression Video Object Segmentation
Existing Referring Video Object Segmentation tasks focus on referring expressions describing events, actions or appearances of relevant objects within the observed frames, lacking evaluation in scenarios that require pre…
Referring Video Object SegmentationReinforcement LearningBoosting Text-Driven Video Segmentation via Geometry-Aware Distillation
Text-driven Referring Video Object Segmentation (RVOS) aims to locate and segment target objects in videos given natural language. However, existing models are typically trained on 2D image or video datasets with naive s…
Referring Video Object SegmentationZero-shot GeneralizationImage SegmentationVideo SegmentationDon't Guess, Just Ask: Resolving Ambiguity in Referring Segmentation via Multi-turn Clarification
Referring segmentation aims to segment the target objects in images or videos based on the textual query. Despite remarkable progress over the past years, existing works always assume that the user-provided queries are a…
Referring Video Object SegmentationWeakly-Supervised Referring Video Object Segmentation through Text Supervision
Referring video object segmentation (RVOS) aims to segment the target instance in a video, referred by a text expression. Conventional approaches are mostly supervised learning, requiring expensive pixel-level mask annot…
Referring Video Object SegmentationReferring ExpressionThe 1st Winner for 5th PVUW MeViS-Text Challenge: Strong MLLMs Meet SAM3 for Referring Video Object Segmentation
This report presents our winning solution to the 5th PVUW MeViS-Text Challenge. The track studies referring video object segmentation under motion-centric language expressions, where the model must jointly understand app…
Referring Video Object SegmentationVIRST: Video-Instructed Reasoning Assistant for SpatioTemporal Segmentation
Referring Video Object Segmentation (RVOS) aims to segment target objects in videos based on natural language descriptions. However, fixed keyframe-based approaches that couple a vision language model with a separate pro…
Referring Video Object SegmentationSaSaSaSa2VA: 2nd Place of the 5th PVUW MeViS-Text Track
Referring video object segmentation (RVOS) commonly grounds targets in videos based on static textual cues. MeViS benchmark extends this by incorporating motion-centric expressions (referring & reasoning motion expressio…
Referring Video Object Segmentation3rd Place of MeViS-Audio Track of the 5th PVUW: VIRST-Audio
Audio-based Referring Video Object Segmentation (ARVOS) requires grounding audio queries into pixel-level object masks over time, posing challenges in bridging acoustic signals with spatio-temporal visual representations…
Referring Video Object SegmentationVideo SegmentationAgentRVOS: Reasoning over Object Tracks for Zero-Shot Referring Video Object Segmentation
Referring Video Object Segmentation (RVOS) aims to segment a target object throughout a video given a natural language query. Training-free methods for this task follow a common pipeline: a MLLM selects keyframes, ground…
Referring Video Object SegmentationVideo SegmentationShow Me When and Where: Towards Referring Video Object Segmentation in the Wild
Referring video object segmentation (RVOS) has recently generated great popularity in computer vision due to its widespread applications. Existing RVOS setting contains elaborately trimmed videos, with text-referred obje…
Referring Video Object SegmentationSTVG-R1: Incentivizing Instance-Level Reasoning and Grounding in Videos via Reinforcement Learning
In vision-language models (VLMs), misalignment between textual descriptions and visual coordinates often induces hallucinations. This issue becomes particularly severe in dense prediction tasks such as spatial-temporal v…
Referring Video Object SegmentationZero-shot GeneralizationReinforcement LearningVideo GroundingRefer-Agent: A Collaborative Multi-Agent System with Reasoning and Reflection for Referring Video Object Segmentation
Referring Video Object Segmentation (RVOS) aims to segment objects in videos based on textual queries. Current methods mainly rely on large-scale supervised fine-tuning (SFT) of Multi-modal Large Language Models (MLLMs).…
Referring Video Object SegmentationCroBIM-V: Memory-Quality Controlled Remote Sensing Referring Video Object Segmentation
Remote sensing video referring object segmentation (RS-RVOS) is challenged by weak target saliency and severe visual information truncation in dynamic scenes, making it extremely difficult to maintain discriminative targ…
Referring Video Object SegmentationVideoLoom: A Video Large Language Model for Joint Spatial-Temporal Understanding
This paper presents VideoLoom, a unified Video Large Language Model (Video LLM) for joint spatial-temporal understanding. To facilitate the development of fine-grained spatial and temporal localization capabilities, we c…
Referring Video Object SegmentationRobust Egocentric Referring Video Object Segmentation via Dual-Modal Causal Intervention
Egocentric Referring Video Object Segmentation (Ego-RVOS) aims to segment the specific object actively involved in a human action, as described by a language query, within first-person videos. This task is critical for u…
Referring Video Object SegmentationMeViS: A Multi-Modal Dataset for Referring Motion Expression Video Segmentation
This paper proposes a large-scale multi-modal dataset for referring motion expression video segmentation, focusing on segmenting and tracking target objects in videos based on language description of objects' motions. Ex…
Referring Video Object SegmentationMulti-Object TrackingVideo SegmentationVideo CaptioningReferring Video Object Segmentation with Cross-Modality Proxy Queries
Referring video object segmentation (RVOS) is an emerging cross-modality task that aims to generate pixel-level maps of the target objects referred by given textual expressions. The main concept involves learning an accu…
Referring Video Object SegmentationObject TrackingTowards High-Consistency Embodied World Model with Multi-View Trajectory Videos
Embodied world models aim to predict and interact with the physical world through visual observations and actions. However, existing models struggle to accurately translate low-level actions (e.g., joint positions) into …
Referring Video Object SegmentationMomentSeg: Moment-Centric Sampling for Enhanced Video Pixel Understanding
Referring Video Object Segmentation (RefVOS) seeks to segment target objects in videos guided by natural language descriptions, demanding both temporal reasoning and fine-grained visual comprehension. Existing sampling s…
Referring Video Object SegmentationTemporal Sentence Grounding