paper-with-me

홈 › Papers

Soft Self-labeling and Potts Relaxations for Weakly-Supervised Segmentation

2025-07-02 · Zhongwen Zhang, Yuri Boykov arxiv

We consider weakly supervised segmentation where only a fraction of pixels have ground truth labels (scribbles) and focus on a self-labeling approach optimizing relaxations of the standard unsupervised CRF/Potts loss on unlabeled pixels. While WSSS methods can directly optimize such losses via gradient descent, prior work suggests that higher-order optimization can improve network training by introducing hidden pseudo-labels and powerful CRF sub-problem solvers, e.g. graph cut. However, previously used hard pseudo-labels can not represent class uncertainty or errors, which motivates soft self-labeling. We derive a principled auxiliary loss and systematically evaluate standard and new CRF relaxations (convex and non-convex), neighborhood systems, and terms connecting network predictions with soft pseudo-labels. We also propose a general continuous sub-problem solver. Using only standard architectures, soft self-labeling consistently improves scribble-based training and outperforms significantly more complex specialized WSSS systems. It can outperform full pixel-precise supervision. Our general ideas apply to other weakly-supervised problems/systems.

📄 PDF Abstract BibTeX arXiv:2507.01721

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Soft Self-labeling and Potts Relaxations for Weakly-supervised Segmentation

2025-01-01 · CVPR 2025 1 · Zhongwen Zhang, Yuri Boykov

We consider weakly supervised segmentation where only a fraction of pixels have ground truth labels (scribbles) and focus on a self-labeling approach optimizing relaxations of the standard unsupervised CRF/Potts loss…

Weakly supervised segmentation

Potts model, parametric maxflow and k-submodular functions

2013-10-07 · Igor Gridchyn, Vladimir Kolmogorov

The problem of minimizing the Potts energy function frequently occurs in computer vision applications. One way to tackle this NP-hard problem was proposed by Kovtun [19,20]. It identifies a part of an optimal solution by…

Combinatorial Optimizationmodel

Worst-case Optimal Submodular Extensions for Marginal Estimation

2018-01-10 · Pankaj Pansari, Chris Russell, M. Pawan Kumar

Submodular extensions of an energy function can be used to efficiently compute approximate marginals via variational inference. The accuracy of the marginals depends crucially on the quality of the submodular extension. …

Variational Inference

Fast Partitioning of Vector-valued Images

2014-09-23 · SIAM Journal on Imaging Sciences 2014 9 · Martin Storath, Andreas Weinmann

We propose a fast splitting approach to the classical variational formulation of the image partitioning problem, which is frequently referred to as the Potts or piecewise constant Mumford--Shah model. For vector-valued i…

Mapping of attention mechanisms to a generalized Potts model

2023-04-14 · Riccardo Rende, Federica Gerace, Alessandro Laio, Sebastian Goldt

Transformers are neural networks that revolutionized natural language processing and machine learning. They process sequences of inputs, like words, using a mechanism called self-attention, which is trained via masked la…

Language ModelingLanguage ModellingMasked Language Modeling