The 1st Solution for 7th LSVOS RVOS Track: SaSaSa2VA
Referring video object segmentation (RVOS) requires segmenting and tracking objects in videos conditioned on natural-language expressions, demanding fine-grained understanding of both appearance and motion. Building on Sa2VA, which couples a Multi-modal Large Language Model (MLLM) with the video segmentation model SAM2, we identify two key bottlenecks that limit segmentation performance: sparse frame sampling and reliance on a single [SEG] token for an entire video. We propose Segmentation Augmented and Selective Averaged Sa2VA (SaSaSa2VA) to address these issues. On the 7th LSVOS Challenge (RVOS track), SaSaSa2VA achieves a $\mathcal{J\&F}$ of 67.45, ranking first and surpassing the runner-up by 2.80 points. This result and ablation studies demonstrate that efficient segmentation augmentation and test-time ensembling substantially enhance grounded MLLMs for RVOS. The code is released in Sa2VA repository: https://github.com/bytedance/Sa2VA.
Code (0)
등록된 구현이 없습니다.
Tasks
Referring Video Object SegmentationVideo SegmentationSimilar Papers 제목 키워드 기반
UNINEXT-Cutie: The 1st Solution for LSVOS Challenge RVOS Track
Referring video object segmentation (RVOS) relies on natural language expressions to segment target objects in video. In this year, LSVOS Challenge RVOS Track replaced the origin YouTube-RVOS benchmark with MeViS. MeViS …
Referring Video Object SegmentationSemantic SegmentationVideo Object SegmentationVideo Semantic SegmentationSaSaSaSa2VA: 2nd Place of the 5th PVUW MeViS-Text Track
Referring video object segmentation (RVOS) commonly grounds targets in videos based on static textual cues. MeViS benchmark extends this by incorporating motion-centric expressions (referring & reasoning motion expressio…
Referring Video Object SegmentationThe 2nd Solution for LSVOS Challenge RVOS Track: Spatial-temporal Refinement for Consistent Semantic Segmentation
Referring Video Object Segmentation (RVOS) is a challenging task due to its requirement for temporal understanding. Due to the obstacle of computational complexity, many state-of-the-art models are trained on short time …
Referring Video Object SegmentationSegmentationSemantic SegmentationVideo Object Segmentation+1Enhancing Sa2VA for Referent Video Object Segmentation: 2nd Solution for 7th LSVOS RVOS Track
Referential Video Object Segmentation (RVOS) aims to segment all objects in a video that match a given natural language description, bridging the gap between vision and language understanding. Recent work, such as Sa2VA,…
Video Object SegmentationVideo SegmentationThe Instance-centric Transformer for the RVOS Track of LSVOS Challenge: 3rd Place Solution
Referring Video Object Segmentation is an emerging multi-modal task that aims to segment objects in the video given a natural language expression. In this work, we build two instance-centric models and fuse predicted res…
Referring Video Object SegmentationRetrievalSemantic SegmentationVideo Object Segmentation+1