paper-with-me

홈 › Papers

Masked Cross-image Encoding for Few-shot Segmentation

2023-08-22 · Wenbo Xu, Huaxi Huang, Ming Cheng, Litao Yu, Qiang Wu, Jian Zhang

Few-shot segmentation (FSS) is a dense prediction task that aims to infer the pixel-wise labels of unseen classes using only a limited number of annotated images. The key challenge in FSS is to classify the labels of query pixels using class prototypes learned from the few labeled support exemplars. Prior approaches to FSS have typically focused on learning class-wise descriptors independently from support images, thereby ignoring the rich contextual information and mutual dependencies among support-query features. To address this limitation, we propose a joint learning method termed Masked Cross-Image Encoding (MCE), which is designed to capture common visual properties that describe object details and to learn bidirectional inter-image dependencies that enhance feature interaction. MCE is more than a visual representation enrichment module; it also considers cross-image mutual dependencies and implicit guidance. Experiments on FSS benchmarks PASCAL-$5^i$ and COCO-$20^i$ demonstrate the advanced meta-learning ability of the proposed method.

📄 PDF Abstract BibTeX arXiv:2308.11201

Code (0)

등록된 구현이 없습니다.

Tasks

Few-Shot Semantic Segmentation

Similar Papers 제목 키워드 기반

R-MAE: Regions Meet Masked Autoencoders

2023-06-08 · Duy-Kien Nguyen, Vaibhav Aggarwal, Yanghao Li, Martin R. Oswald 외

In this work, we explore regions as a potential visual analogue of words for self-supervised image representation learning. Inspired by Masked Autoencoding (MAE), a generative pre-training baseline, we propose masked reg…

Contrastive LearningInteractive Segmentationobject-detectionObject Detection+2

Self-Guided and Cross-Guided Learning for Few-Shot Segmentation

2021-03-30 · CVPR 2021 1 · Bingfeng Zhang, Jimin Xiao, Terry Qin

Few-shot segmentation has been attracting a lot of attention due to its effectiveness to segment unseen object classes with a few annotated samples. Most existing approaches use masked Global Average Pooling (GAP) to enc…

Few-Shot Semantic SegmentationImage SegmentationSegmentationSemantic Segmentation

Geometry Aware Field-to-field Transformations for 3D Semantic Segmentation

2023-10-08 · Dominik Hollidt, Clinton Wang, Polina Golland, Marc Pollefeys

We present a novel approach to perform 3D semantic segmentation solely from 2D supervision by leveraging Neural Radiance Fields (NeRFs). By extracting features along a surface point cloud, we achieve a compact representa…

3D Semantic SegmentationNeRFSegmentationSemantic Segmentation

FLAVARS: A Multimodal Foundational Language and Vision Alignment Model for Remote Sensing

2025-01-14 · Isaac Corley, Simone Fobi Nsutezo, Anthony Ortiz, Caleb Robinson 외

Remote sensing imagery is dense with objects and contextual visual information. There is a recent trend to combine paired satellite images and text captions for pretraining performant encoders for downstream tasks. Howev…

ClassificationContrastive LearningSemantic Segmentationzero-shot-classification+1

A Two-Stage Progressive Pre-training using Multi-Modal Contrastive Masked Autoencoders

2024-08-05 · Muhammad Abdullah Jamal, Omid Mohareri

In this paper, we propose a new progressive pre-training method for image understanding tasks which leverages RGB-D datasets. The method utilizes Multi-Modal Contrastive Masked Autoencoder and Denoising techniques. Our p…

Contrastive LearningDenoisingSemantic Segmentation