paper-with-me

홈 › Papers

Discover and Align Taxonomic Context Priors for Open-world Semi-Supervised Learning

2023-09-21 · NeurIPS 2023 11

Open-world Semi-Supervised Learning (OSSL) is a realistic and challenging task, aiming to classify unlabeled samples from both seen and novel classes using partially labeled samples from the seen classes. Previous works typically explore the relationship of samples as priors on the pre-defined single-granularity labels to help novel class recognition. In fact, classes follow a taxonomy and samples can be classified at multiple levels of granularity, which contains more underlying relationships for supervision. We thus argue that learning with single-granularity labels results in sub-optimal representation learning and inaccurate pseudo labels, especially with unknown classes. In this paper, we take the initiative to explore and propose a uniformed framework, called Taxonomic context prIors Discovering and Aligning (TIDA), which exploits the relationship of samples under various granularity. It allows us to discover multi-granularity semantic concepts as taxonomic context priors (i.e., sub-class, target-class, and super-class), and then collaboratively leverage them to enhance representation learning and improve the quality of pseudo labels. Specifically, TIDA comprises two components: i) A taxonomic context discovery module that constructs a set of hierarchical prototypes in the latent space to discover the underlying taxonomic context priors; ii) A taxonomic context-based prediction alignment module that enforces consistency across hierarchical predictions to build the reliable relationship between classes among various granularity and provide additions supervision. We demonstrate that these two components are mutually beneficial for an effective OSSL framework, which is theoretically explained from the perspective of the EM algorithm. Extensive experiments on seven commonly used datasets show that TIDA can significantly improve the performance and achieve a new state of the art. The source codes are publicly available at https://github.com/rain305f/TIDA.

📄 PDF Abstract BibTeX

Code (1)

rain305f/tida 공식 구현 pytorch

Tasks

Open-World Semi-Supervised LearningRepresentation Learning

Similar Papers 제목 키워드 기반

Discover and Align Taxonomic Context Priors for Open-world Semi-Supervised Learning

2023-09-21

Open-world Semi-Supervised Learning (OSSL) is a realistic and challenging task, aiming to classify unlabeled samples from both seen and novel classes using partially labeled samples from the seen classes. Previous works…

Open-World Semi-Supervised LearningRepresentation Learning

CoDA: Collaborative Novel Box Discovery and Cross-modal Alignment for Open-vocabulary 3D Object Detection

2023-10-04 · NeurIPS 2023 11 · Yang Cao, Yihan Zeng, Hang Xu, Dan Xu

Open-vocabulary 3D Object Detection (OV-3DDet) aims to detect objects from an arbitrary list of categories within a 3D scene, which remains seldom explored in the literature. There are primarily two fundamental problems …

3D Object Detectioncross-modal alignmentObjectobject-detection+3

Deep Taxonomic Networks for Unsupervised Hierarchical Prototype Discovery

2025-09-28 · Zekun Wang, Ethan Haarer, Tianyi Zhu, Zhiyi Dai 외 arxiv

Inspired by the human ability to learn and organize knowledge into hierarchical taxonomies with prototypes, this paper addresses key limitations in current deep hierarchical clustering methods. Existing methods often tie…

Image Classification

Correctable Landmark Discovery via Large Models for Vision-Language Navigation

2024-05-29 · Bingqian Lin, Yunshuang Nie, Ziming Wei, Yi Zhu 외

Vision-Language Navigation (VLN) requires the agent to follow language instructions to reach a target position. A key factor for successful navigation is to align the landmarks implied in the instruction with diverse vis…

Vision-Language Navigation

OptimOTU: Taxonomically aware OTU clustering with optimized thresholds and a bioinformatics workflow for metabarcoding data

2025-02-14 · Brendan Furneaux, Sten Anslan, Panu Somervuo, Jenni Hultman 외

To turn environmentally derived metabarcoding data into community matrices for ecological analysis, sequences must first be clustered into operational taxonomic units (OTUs). This task is particularly complex for data in…

ClusteringDenoising