SAIL-VOS: Semantic Amodal Instance Level Video Object Segmentation - A Synthetic Dataset and Baselines

2019-06-01 · CVPR 2019 6 · Yuan-Ting Hu, Hong-Shuo Chen, Kexin Hui, Jia-Bin Huang, Alexander G. Schwing

We introduce SAIL-VOS (Semantic Amodal Instance Level Video Object Segmentation), a new dataset aiming to stimulate semantic amodal segmentation research. Humans can effortlessly recognize partially occluded objects and reliably estimate their spatial extent beyond the visible. However, few modern computer vision techniques are capable of reasoning about occluded parts of an object. This is partly due to the fact that very few image datasets and no video dataset exist which permit development of those methods. To address this issue, we present a synthetic dataset extracted from the photo-realistic game GTA-V. Each frame is accompanied with densely annotated, pixel-accurate visible and amodal segmentation masks with semantic labels. More than 1.8M objects are annotated resulting in 100 times more annotations than existing datasets. We demonstrate the challenges of the dataset by quantifying the performance of several baselines. Data and additional material is available at http://sailvos.web.illinois.edu.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Segmentation Semantic Segmentation Video Object Segmentation Video Semantic Segmentation

Foundation Models for Amodal Video Instance Segmentation in Automated Driving

2024-09-21 · Jasmin Breitenstein, Franz Jünger, Andreas Bär, Tim Fingscheidt

In this work, we study amodal video instance segmentation for automated driving. Previous works perform amodal video instance segmentation relying on methods trained on entirely labeled video data with techniques borrowe…

Amodal Instance Segmentation Instance Segmentation Point Tracking Segmentation+2

A2VIS: Amodal-Aware Approach to Video Instance Segmentation

2024-12-02 · Minh Tran, Thang Pham, Winston Bounsavy, Tri Nguyen 외

Handling occlusion remains a significant challenge for video instance-level tasks like Multiple Object Tracking (MOT) and Video Instance Segmentation (VIS). In this paper, we propose a novel framework, Amodal-Aware Video…

Instance Segmentation Multiple Object Tracking Object Object Tracking+3

Learning Semantics-aware Distance Map with Semantics Layering Network for Amodal Instance Segmentation

2019-05-30 · Ziheng Zhang, Anpei Chen, Ling Xie, Jingyi Yu 외

In this work, we demonstrate yet another approach to tackle the amodal segmentation problem. Specifically, we first introduce a new representation, namely a semantics-aware distance map (sem-dist map), to serve as our ta…

Amodal Instance Segmentation Instance Segmentation Segmentation Semantic Segmentation

Learning to See the Invisible: End-to-End Trainable Amodal Instance Segmentation

2018-04-24 · Patrick Follmann, Rebecca König, Philipp Härtinger, Michael Klostermann

Semantic amodal segmentation is a recently proposed extension to instance-aware segmentation that includes the prediction of the invisible region of each object instance. We present the first all-in-one end-to-end traina…

Amodal Instance Segmentation Data Augmentation Instance Segmentation Segmentation+1

Perceiving the Invisible: Proposal-Free Amodal Panoptic Segmentation

2022-05-29 · Rohit Mohan, Abhinav Valada

Amodal panoptic segmentation aims to connect the perception of the world to its cognitive understanding. It entails simultaneously predicting the semantic labels of visible scene regions and the entire shape of traffic p…

Amodal Panoptic Segmentation Decoder Panoptic Segmentation