paper-with-me

홈 › Papers

Learning Cross-Representation Affinity Consistency for Sparsely Supervised Biomedical Instance Segmentation

2023-01-01 · ICCV 2023 1 · Xiaoyu Liu, Wei Huang, Zhiwei Xiong, Shenglong Zhou, Yueyi Zhang, Xuejin Chen, Zheng-Jun Zha, Feng Wu

Sparse instance-level supervision has recently been explored to address insufficient annotation in biomedical instance segmentation, which is easier to annotate crowded instances and better preserves instance completeness for 3D volumetric datasets compared to common semi-supervision.In this paper, we propose a sparsely supervised biomedical instance segmentation framework via cross-representation affinity consistency regularization. Specifically, we adopt two individual networks to enforce the perturbation consistency between an explicit affinity map and an implicit affinity map to capture both feature-level instance discrimination and pixel-level instance boundary structure. We then select the highly confident region of each affinity map as the pseudo label to supervise the other one for affinity consistency learning. To obtain the highly confident region, we propose a pseudo-label noise filtering scheme by integrating two entropy-based decision strategies. Extensive experiments on four biomedical datasets with sparse instance annotations show the state-of-the-art performance of our proposed framework. For the first time, we demonstrate the superiority of sparse instance-level supervision on 3D volumetric datasets, compared to common semi-supervision under the same annotation cost.

📄 PDF Abstract BibTeX

Code (1)

liuxy1103/crac 공식 구현 pytorch

Tasks

Instance SegmentationPseudo LabelSemantic Segmentation

Similar Papers 제목 키워드 기반

Contrastive Transformation for Self-supervised Correspondence Learning

2020-12-09 · Ning Wang, Wengang Zhou, Houqiang Li

In this paper, we focus on the self-supervised learning of visual correspondence using unlabeled videos in the wild. Our method simultaneously considers intra- and inter-video representation associations for reliable cor…

Object TrackingSelf-Supervised LearningSemantic SegmentationVideo Object Segmentation+2

SaCo Loss: Sample-wise Affinity Consistency for Vision-Language Pre-training

2024-01-01 · CVPR 2024 1 · Sitong Wu, Haoru Tan, Zhuotao Tian, Yukang Chen 외

Vision-language pre-training (VLP) aims to learn joint representations of vision and language modalities. The contrastive paradigm is currently dominant in this field. However we observe a notable misalignment phenom…

A Unified Framework for Contrastive Learning from a Perspective of Affinity Matrix

2022-11-26 · Wenbin Li, Meihao Kong, Xuesong Yang, Lei Wang 외

In recent years, a variety of contrastive learning based unsupervised visual representation learning methods have been designed and achieved great success in many visual tasks. Generally, these methods can be roughly cla…

Contrastive LearningRepresentation Learning

DapPep: Domain Adaptive Peptide-agnostic Learning for Universal T-cell Receptor-antigen Binding Affinity Prediction

2024-11-26 · Jiangbin Zheng, Qianhui Xu, Ruichen Xia, Stan Z. Li

Identifying T-cell receptors (TCRs) that interact with antigenic peptides provides the technical basis for developing vaccines and immunotherapies. The emergent deep learning methods excel at learning antigen binding pat…

Language ModelingLanguage ModellingProtein Language ModelSpecificity

Distill, Diffuse, Segment: Unsupervised 3D Semantic Segmentation for Autonomous Driving Based on Multi-Level Distillation and Graph Diffusion

2026-05-08 · Yijing Wang, Ruonan Li, Qilin Wang, Rongqiang Zhao 외 arxiv

LiDAR-based semantic segmentation is essential for autonomous-driving perception, yet dense point-wise annotations are costly, and long-tailed outdoor scenes make small safety-critical objects difficult to discover witho…

Scene UnderstandingAutonomous DrivingPoint Clouds