Collaborative Unlabeled Data Optimization
This paper pioneers a novel data-centric paradigm to maximize the utility of unlabeled data, tackling a critical question: How can we enhance the efficiency and sustainability of deep learning training by optimizing the data itself? We begin by identifying three key limitations in existing model-centric approaches, all rooted in a shared bottleneck: knowledge extracted from data is locked to model parameters, hindering its reusability and scalability. To this end, we propose CoOpt, a highly efficient, parallelized framework for collaborative unlabeled data optimization, thereby effectively encoding knowledge into the data itself. By distributing unlabeled data and leveraging publicly available task-agnostic models, CoOpt facilitates scalable, reusable, and sustainable training pipelines. Extensive experiments across diverse datasets and architectures demonstrate its efficacy and efficiency, achieving 13.6% and 6.8% improvements on Tiny-ImageNet and ImageNet-1K, respectively, with training speedups of $1.94 \times $ and $1.2 \times$.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Multi-local Collaborative AutoEncoder
The excellent performance of representation learning of autoencoders have attracted considerable interest in various applications. However, the structure and multi-local collaborative relationships of unlabeled data are …
ClusteringRepresentation LearningWeakly Supervised Open-set Domain Adaptation by Dual-domain Collaboration
In conventional domain adaptation, a critical assumption is that there exists a fully labeled domain (source) that contains the same label space as another unlabeled or scarcely labeled domain (target). However, in the r…
Domain AdaptationTransfer LearningCollaborative Feature-Logits Contrastive Learning for Open-Set Semi-Supervised Object Detection
Current Semi-Supervised Object Detection (SSOD) methods enhance detector performance by leveraging large amounts of unlabeled data, assuming that both labeled and unlabeled data share the same label space. However, in op…
Contrastive Learningobject-detectionObject DetectionSemi-Supervised Object DetectionMulti-Source Domain Adaptation with Collaborative Learning for Semantic Segmentation
Multi-source unsupervised domain adaptation~(MSDA) aims at adapting models trained on multiple labeled source domains to an unlabeled target domain. In this paper, we propose a novel multi-source domain adaptation framew…
Domain AdaptationMulti-Source Unsupervised Domain AdaptationSemantic SegmentationUnsupervised Domain AdaptationPrivacy Protected Multi-Domain Collaborative Learning
Unsupervised domain adaptation (UDA) aims to transfer knowledge from one or more well-labeled source domains to improve model performance on the different-yet-related target domain without any annotations. However, exist…
Domain AdaptationUnsupervised Domain Adaptation