paper-with-me

Papers

A Simple and Powerful Global Optimization for Unsupervised Video Object Segmentation

2022-09-19 · Georgy Ponimatkin, Nermin Samet, Yang Xiao, Yuming Du, Renaud Marlet, Vincent Lepetit

We propose a simple, yet powerful approach for unsupervised object segmentation in videos. We introduce an objective function whose minimum represents the mask of the main salient object over the input sequence. It only relies on independent image features and optical flows, which can be obtained using off-the-shelf self-supervised methods. It scales with the length of the sequence with no need for superpixels or sparsification, and it generalizes to different datasets without any specific training. This objective function can actually be derived from a form of spectral clustering applied to the entire video. Our method achieves on-par performance with the state of the art on standard benchmarks (DAVIS2016, SegTrack-v2, FBMS59), while being conceptually and practically much simpler. Code is available at https://ponimatkin.github.io/ssl-vos.

📄 PDF Abstract BibTeX arXiv:2209.09341

Code (1)

ponimatkin/ssl-vos 공식 구현 pytorch

Tasks

Clusteringglobal-optimizationObjectSemantic SegmentationSuperpixelsUnsupervised Object SegmentationUnsupervised Video Object SegmentationVideo Object SegmentationVideo Semantic Segmentation

Methods 이 논문이 사용한 방법론

Spectral Clustering Spectral clustering has attracted increasing attention due to the promising ability in dealing with nonlinearly separable datasets [15], [16]. In spectral clustering, the…

Similar Papers 제목 키워드 기반

Global Optimality Guarantees for Nonconvex Unsupervised Video Segmentation

2019-07-09 · Brendon G. Anderson, Somayeh Sojoudi

In this paper, we consider the problem of unsupervised video object segmentation via background subtraction. Specifically, we pose the nonsemantic extraction of a video's moving objects as a nonconvex optimization proble…

ObjectSegmentationSemantic SegmentationUnsupervised Video Object Segmentation+3

Humans as Checkerboards: Calibrating Camera Motion Scale for World-Coordinate Human Mesh Recovery

2024-06-30 · Fengyuan Yang, Kerui Gu, Ha Linh Nguyen, Tze Ho Elden Tse 외

Accurate camera motion estimation is essential for recovering global human motion in world coordinates from RGB video inputs. SLAM is widely used for estimating camera trajectory and point cloud, but monocular SLAM does …

Human Mesh RecoveryMotion EstimationSimultaneous Localization and Mapping

Spectral Inference Networks: Unifying Deep and Spectral Learning

2018-06-06 · ICLR 2019 5 · David Pfau, Stig Petersen, Ashish Agarwal, David G. T. Barrett 외

We present Spectral Inference Networks, a framework for learning eigenfunctions of linear operators by stochastic optimization. Spectral Inference Networks generalize Slow Feature Analysis to generic symmetric operators,…

Atari GamesBilevel OptimizationRepresentation LearningStochastic Optimization+1

Guess What Moves: Unsupervised Video and Image Segmentation by Anticipating Motion

2022-05-16 · Subhabrata Choudhury, Laurynas Karazija, Iro Laina, Andrea Vedaldi 외

Motion, measured via optical flow, provides a powerful cue to discover and learn objects in images and videos. However, compared to using appearance, it has some blind spots, such as the fact that objects become invisibl…

Image SegmentationOptical Flow EstimationSegmentationSemantic Segmentation+4

Unsupervised Learning of Visual Representations using Videos

2015-05-04 · ICCV 2015 12 · Xiaolong Wang, Abhinav Gupta

Is strong supervision necessary for learning a good visual representation? Do we really need millions of semantically-labeled images to train a Convolutional Neural Network (CNN)? In this paper, we present a simple yet s…

Surface Normal EstimationTripletVisual Tracking