paper-with-me

홈 › Papers

U-Net Based Multi-instance Video Object Segmentation

2019-05-19 · Heguang Liu, Jingle Jiang

Multi-instance video object segmentation is to segment specific instances throughout a video sequence in pixel level, given only an annotated first frame. In this paper, we implement an effective fully convolutional networks with U-Net similar structure built on top of OSVOS fine-tuned layer. We use instance isolation to transform this multi-instance segmentation problem into binary labeling problem, and use weighted cross entropy loss and dice coefficient loss as our loss function. Our best model achieves F mean of 0.467 and J mean of 0.424 on DAVIS dataset, which is a comparable performance with the State-of-the-Art approach. But case analysis shows this model can achieve a smoother contour and better instance coverage, meaning it better for recall focused segmentation scenario. We also did experiments on other convolutional neural networks, including Seg-Net, Mask R-CNN, and provide insightful comparison and discussion.

📄 PDF Abstract BibTeX arXiv:1905.07826

Code (0)

등록된 구현이 없습니다.

Tasks

Instance SegmentationObjectSegmentationSemantic SegmentationVideo Object SegmentationVideo Semantic Segmentation

Methods 이 논문이 사용한 방법론

RPN A Region Proposal Network, or RPN, is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained…
Concatenated Skip Connection A Concatenated Skip Connection is a type of skip connection that seeks to reuse features by concatenating them to new layers, allowing more information to be retained from…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
U-Net 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
RoIAlign Region of Interest Align, or RoIAlign, is an operation for extracting a small feature map from each RoI in detection and segmentation based tasks. It removes the harsh…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Instance-Level Video Segmentation From Object Tracks

2016-06-01 · CVPR 2016 6 · Guillaume Seguin, Piotr Bojanowski, Remi Lajugie, Ivan Laptev

We address the problem of segmenting multiple object instances in complex videos. Our method does not require manual pixel-level annotation for training, and relies instead on readily-available object detectors or visual…

ClusteringObjectObject TrackingSegmentation+4

Consistent Video Instance Segmentation with Inter-Frame Recurrent Attention

2022-06-14 · Quanzeng You, Jiang Wang, Peng Chu, Andre Abrantes 외

Video instance segmentation aims at predicting object segmentation masks for each frame, as well as associating the instances across multiple frames. Recent end-to-end video instance segmentation methods are capable of p…

Instance SegmentationObjectSegmentationSemantic Segmentation+1

LIP: Learning Instance Propagation for Video Object Segmentation

2019-09-30 · Ye Lyu, George Vosselman, Gui-Song Xia, Michael Ying Yang

In recent years, the task of segmenting foreground objects from background in a video, i.e. video object segmentation (VOS), has received considerable attention. In this paper, we propose a single end-to-end trainable de…

Data AugmentationInstance SegmentationObjectSegmentation+3

A2VIS: Amodal-Aware Approach to Video Instance Segmentation

2024-12-02 · Minh Tran, Thang Pham, Winston Bounsavy, Tri Nguyen 외

Handling occlusion remains a significant challenge for video instance-level tasks like Multiple Object Tracking (MOT) and Video Instance Segmentation (VIS). In this paper, we propose a novel framework, Amodal-Aware Video…

Instance SegmentationMultiple Object TrackingObjectObject Tracking+3

Few-Shot Referring Video Single- and Multi-Object Segmentation via Cross-Modal Affinity with Instance Sequence Matching

2025-04-18 · Heng Liu, Guanghui Li, Mingqi Gao, XianTong Zhen 외

Referring video object segmentation (RVOS) aims to segment objects in videos guided by natural language descriptions. We propose FS-RVOS, a Transformer-based model with two key components: a cross-modal affinity module a…

ObjectReferring Video Object SegmentationSegmentationSemantic Segmentation+2