paper-with-me

Papers

Targeted Representation Alignment for Open-World Semi-Supervised Learning

2024-01-01 · CVPR 2024 1 · Ruixuan Xiao, Lei Feng, Kai Tang, Junbo Zhao, Yixuan Li, Gang Chen, Haobo Wang

Open-world Semi-Supervised Learning aims to classify unlabeled samples utilizing information from labeled data while unlabeled samples are not only from the labeled known categories but also from novel categories previously unseen. Despite the promise current approaches solely rely on hazardous similarity-based clustering algorithms and give unlabeled samples free rein to spontaneously group into distinct novel class clusters. Nevertheless due to the absence of novel class supervision these methods typically suffer from the representation collapse dilemma---features of different novel categories can get closely intertwined and indistinguishable even collapsing into the same cluster and leading to degraded performance. To alleviate this we propose a novel framework TRAILER which targets to attain an optimal feature arrangement revealed by the recently uncovered neural collapse phenomenon. To fulfill this we adopt targeted prototypes that are pre-assigned uniformly with maximum separation and then progressively align the representations to them. To further tackle the potential downsides of such stringent alignment we encapsulate a sample-target allocation mechanism with coarse-to-fine refinery that is able to infer label assignments with high quality. Extensive experiments demonstrate that TRAILER outperforms current state-of-the-art methods on generic and fine-grained benchmarks. The code is available at https://github.com/Justherozen/TRAILER.

📄 PDF Abstract BibTeX

Code (1)

justherozen/trailer 공식 구현 pytorch

Tasks

Maximum SeparationOpen-World Semi-Supervised Learning

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

Concept Formation and Alignment in Language Models: Bridging Statistical Patterns in Latent Space to Concept Taxonomy

2024-06-08 · Mehrdad Khatir, Chandan K. Reddy

This paper explores the concept formation and alignment within the realm of language models (LMs). We propose a mechanism for identifying concepts and their hierarchical organization within the semantic representations l…

Transfer LearningWorld Knowledge

Semi-supervised Open-World Object Detection

2024-02-25 · Sahal Shaji Mullappilly, Abhishek Singh Gehlot, Rao Muhammad Anwer, Fahad Shahbaz Khan 외

Conventional open-world object detection (OWOD) problem setting first distinguishes known and unknown classes and then later incrementally learns the unknown objects when introduced with labels in the subsequent tasks. H…

Incremental LearningObjectobject-detectionObject Detection+1

Learning Textual Prompts for Open-World Semi-Supervised Learning

2025-01-01 · CVPR 2025 1 · Yuxin Fan, Junbiao Cui, Jiye Liang

Traditional semi-supervised learning achieves significant success in closed-world scenarios. To better align with the openness of the real world, researchers propose open-world semi-supervised learning (OWSSL), which…

Image-text matchingOpen-World Semi-Supervised LearningPrompt LearningText Matching

Multi-Modal Representation Learning via Semi-Supervised Rate Reduction for Generalized Category Discovery

2026-02-23 · Wei He, Xianghan Meng, Zhiyuan Huang, Xianbiao Qi 외 arxiv

Generalized Category Discovery (GCD) aims to identify both known and unknown categories, with only partial labels given for the known categories, posing a challenging open-set recognition problem. State-of-the-art approa…

Representation Learning

OpenDlign: Open-World Point Cloud Understanding with Depth-Aligned Images

2024-04-25 · Ye Mao, Junpeng Jing, Krystian Mikolajczyk

Recent open-world 3D representation learning methods using Vision-Language Models (VLMs) to align 3D point cloud with image-text information have shown superior 3D zero-shot performance. However, CAD-rendered images for …

Representation LearningTransfer LearningZero-shot 3D classificationZero-shot 3D Point Cloud Classification+3