Dense Gaussian Processes for Few-Shot Segmentation

2021-10-07 · Joakim Johnander, Johan Edstedt, Michael Felsberg, Fahad Shahbaz Khan, Martin Danelljan

Few-shot segmentation is a challenging dense prediction task, which entails segmenting a novel query image given only a small annotated support set. The key problem is thus to design a method that aggregates detailed information from the support set, while being robust to large variations in appearance and context. To this end, we propose a few-shot segmentation method based on dense Gaussian process (GP) regression. Given the support set, our dense GP learns the mapping from local deep image features to mask values, capable of capturing complex appearance distributions. Furthermore, it provides a principled means of capturing uncertainty, which serves as another powerful cue for the final segmentation, obtained by a CNN decoder. Instead of a one-dimensional mask output, we further exploit the end-to-end learning capabilities of our approach to learn a high-dimensional output space for the GP. Our approach sets a new state-of-the-art on the PASCAL-5$^i$ and COCO-20$^i$ benchmarks, achieving an absolute gain of $+8.4$ mIoU in the COCO-20$^i$ 5-shot setting. Furthermore, the segmentation quality of our approach scales gracefully when increasing the support set size, while achieving robust cross-dataset transfer. Code and trained models are available at \url{https://github.com/joakimjohnander/dgpnet}.

📄 PDF Abstract BibTeX arXiv:2110.03674

Code (1)

joakimjohnander/dgpnet 공식 구현 pytorch

Tasks

Decoder Few-Shot Semantic Segmentation Gaussian Processes Segmentation

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Learning to Learn Dense Gaussian Processes for Few-Shot Learning

2021-12-01 · NeurIPS 2021 12 · Ze Wang, Zichen Miao, XianTong Zhen, Qiang Qiu

Gaussian processes with deep neural networks demonstrate to be a strong learner for few-shot learning since they combine the strength of deep learning and kernels while being able to well capture uncertainty. However, it…

Few-Shot Learning Gaussian Processes Inductive Bias Meta-Learning+1

Deep Gaussian Processes for Few-Shot Segmentation

2021-03-30 · Joakim Johnander, Johan Edstedt, Martin Danelljan, Michael Felsberg 외

Few-shot segmentation is a challenging task, requiring the extraction of a generalizable representation from only a few annotated samples, in order to segment novel query images. A common approach is to model each class …

Decoder Gaussian Processes Segmentation

DenseMP: Unsupervised Dense Pre-training for Few-shot Medical Image Segmentation

2023-07-13 · Zhaoxin Fan, Puquan Pan, Zeren Zhang, Ce Chen 외

Few-shot medical image semantic segmentation is of paramount importance in the domain of medical image analysis. However, existing methodologies grapple with the challenge of data scarcity during the training phase, lead…

Image Segmentation Medical Image Analysis Medical Image Segmentation Segmentation+1

Bayesian Active Learning with Gaussian Processes Guided by LLM Relevance Scoring for Dense Passage Retrieval

2026-04-20 · Junyoung Kim, Anton Korikov, Jiazhou Liang, Justin Cui 외 arxiv

While Large Language Models (LLMs) exhibit exceptional zero-shot relevance modeling, their high computational cost necessitates framing passage retrieval as a budget-constrained global optimization problem. Existing appr…

Gaussian Processes Passage Retrieval Active Learning

CDGP: Contrastive Dual Gaussian Processes for Weakly Supervised Anomaly Segmentation

2026-08-19 · Seungjun Chu, Seokhee Han, Mateusz Nowak, Peter Chin arxiv

Industrial visual inspection must both decide whether a product is defective and localize the defect, yet pixel-level masks are costly to collect at scale. Most anomaly-segmentation methods learn only from defect-free im…

Gaussian Processes