paper-with-me

홈 › Papers

Online Collaborative Learning for Open-Vocabulary Visual Classifiers

2016-06-01 · CVPR 2016 6 · Hanwang Zhang, Xindi Shang, Wenzhuo Yang, Huan Xu, Huanbo Luan, Tat-Seng Chua

We focus on learning open-vocabulary visual classifiers, which scale up to a large portion of natural language vocabulary (e.g., over tens of thousands of classes). In particular, the training data are large-scale weakly labeled Web images since it is difficult to acquire sufficient well-labeled data at this category scale. In this paper, we propose a novel online learning paradigm towards this challenging task. Different from traditional N-way independent classifiers that generally fail to handle the extremely sparse and inter-related labels, our classifiers learn from continuous label embeddings discovered by collaboratively decomposing the sparse image-label matrix. Leveraging on the structure of the proposed collaborative learning formulation, we develop an efficient online algorithm that can jointly learn the label embeddings and visual classifiers. The algorithm can learn over 30,000 classes of 1,000 training images within 1 second on a standard GPU. Extensively experimental results on four benchmarks demonstrate the effectiveness of our method.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

GPU

Similar Papers 제목 키워드 기반

Multi-Modal Classifiers for Open-Vocabulary Object Detection

2023-06-08 · Prannay Kaul, Weidi Xie, Andrew Zisserman

The goal of this paper is open-vocabulary object detection (OVOD) $\unicode{x2013}$ building a model that can detect objects beyond the set of categories seen at training, thus enabling the user to specify categories of …

Language ModellingLarge Language ModelObjectobject-detection+3

Visual Programming for Zero-shot Open-Vocabulary 3D Visual Grounding

2023-11-26 · CVPR 2024 1 · Zhihao Yuan, Jinke Ren, Chun-Mei Feng, Hengshuang Zhao 외

3D Visual Grounding (3DVG) aims at localizing 3D object based on textual descriptions. Conventional supervised methods for 3DVG often necessitate extensive annotations and a predefined vocabulary, which can be restrictiv…

3D visual groundingObjectVisual Grounding

OvarNet: Towards Open-vocabulary Object Attribute Recognition

2023-01-23 · CVPR 2023 1 · Keyan Chen, XiaoLong Jiang, Yao Hu, Xu Tang 외

In this paper, we consider the problem of simultaneously detecting objects and inferring their visual attributes in an image, even for those with no manual annotations provided at the training stage, resembling an open-v…

AttributeKnowledge DistillationObjectobject-detection+6

OpenTrack3D: Towards Accurate and Generalizable Open-Vocabulary 3D Instance Segmentation

2025-12-03 · Zhishan Zhou, Siyuan Wei, Zengran Wang, Chunjie Wang 외 arxiv

Generalizing open-vocabulary 3D instance segmentation (OV-3DIS) to diverse, unstructured, and mesh-free environments is crucial for robotics and AR/VR, yet remains a significant challenge. We attribute this to two key li…

3D Instance SegmentationPoint Clouds

ExDet: Open-Domain Open-Vocabulary Detection with Cross-modal Extrapolation and Rectification

2026-06-08 · Yupeng Zhang, Yuzhong Feng, Ruize Han, Zhiwei Chen 외 arxiv

Open-domain open-vocabulary detection (ODOVD) requires detectors to generalize to both novel categories and unseen domains, making it more challenging than open-vocabulary detection. Existing methods typically train open…

Domain GeneralizationSemantic Similarity