OmniShotCut: Holistic Relational Shot Boundary Detection with Shot-Query Transformer
Shot Boundary Detection (SBD) aims to automatically identify shot changes and divide a video into coherent shots. While SBD was widely studied in the literature, existing methods often produce non-interpretable boundaries on transitions, miss subtle yet harmful discontinuities, and rely on noisy, low-diversity annotations and outdated benchmarks. To alleviate these limitations, we propose OmniShotCut to formulate SBD as structured relational prediction, jointly estimating shot ranges with intra-shot relations and inter-shot relations, by a shot query-based dense video Transformer. To avoid imprecise manual labeling, we adopt a fully synthetic transition synthesis pipeline that automatically reproduces major transition families with precise boundaries and parameterized variants. We also introduce OmniShotCutBench, a modern wide-domain benchmark enabling holistic and diagnostic evaluation. Experiments on the benchmarks demonstrate the effectiveness and generality of our method.
Code (0)
등록된 구현이 없습니다.
Tasks
Boundary DetectionSimilar Papers 제목 키워드 기반
UniVAD v2: Unified Visual Anomaly Detection via Support-Conditioned Boundary Construction
Unified visual anomaly detection seeks to train a single detector that can be deployed across categories, domains, and application scenarios. In the few-shot transfer regime, the key challenge is to estimate an episode-s…
Domain GeneralizationAnomaly DetectionRLIP: Relational Language-Image Pre-training for Human-Object Interaction Detection
The task of Human-Object Interaction (HOI) detection targets fine-grained visual parsing of humans interacting with their environment, enabling a broad range of applications. Prior work has demonstrated the benefits of e…
Human-Object Interaction DetectionRelationSynthetic Data GenerationFROB: Few-shot ROBust Model for Classification and Out-of-Distribution Detection
Nowadays, classification and Out-of-Distribution (OoD) detection in the few-shot setting remain challenging aims due to rarity and the limited samples in the few-shot setting, and because of adversarial attacks. Accompli…
One-Class ClassificationOut-of-Distribution DetectionOut of Distribution (OOD) DetectionSelf-Supervised LearningHolistically-Nested Edge Detection
We develop a new edge detection algorithm that tackles two important issues in this long-standing vision problem: (1) holistic image training and prediction; and (2) multi-scale and multi-level feature learning. Our prop…
Boundary DetectionEdge DetectionFROB: Few-shot ROBust Model for Classification with Out-of-Distribution Detection
Nowadays, classification and Out-of-Distribution (OoD) detection in the few-shot setting remain challenging aims mainly due to rarity and the limited samples in the few-shot setting, and because of adversarial attacks. A…
One-Class ClassificationOut-of-Distribution DetectionOut of Distribution (OOD) DetectionSelf-Supervised Learning