paper-with-me

홈 › Papers

Boosting Supervised Learning Performance with Co-training

2021-11-18 · Xinnan Du, William Zhang, Jose M. Alvarez

Deep learning perception models require a massive amount of labeled training data to achieve good performance. While unlabeled data is easy to acquire, the cost of labeling is prohibitive and could create a tremendous burden on companies or individuals. Recently, self-supervision has emerged as an alternative to leveraging unlabeled data. In this paper, we propose a new light-weight self-supervised learning framework that could boost supervised learning performance with minimum additional computation cost. Here, we introduce a simple and flexible multi-task co-training framework that integrates a self-supervised task into any supervised task. Our approach exploits pretext tasks to incur minimum compute and parameter overheads and minimal disruption to existing training pipelines. We demonstrate the effectiveness of our framework by using two self-supervised tasks, object detection and panoptic segmentation, on different perception models. Our results show that both self-supervised tasks can improve the accuracy of the supervised task and, at the same time, demonstrates strong domain adaption capability when used with additional unlabeled data.

📄 PDF Abstract BibTeX arXiv:2111.09797

Code (0)

등록된 구현이 없습니다.

Tasks

Domain Adaptationobject-detectionObject DetectionPanoptic SegmentationSelf-Supervised Learning

Similar Papers 제목 키워드 기반

Semi-Supervised Transfer Boosting (SS-TrBoosting)

2024-12-04 · Lingfei Deng, Changming Zhao, Zhenbang Du, Kun Xia 외

Semi-supervised domain adaptation (SSDA) aims at training a high-performance model for a target domain using few labeled target data, many unlabeled target data, and plenty of auxiliary data from a source domain. Previou…

Domain AdaptationSemi-supervised Domain AdaptationSource-Free Domain AdaptationUnsupervised Domain Adaptation

Local Boosting for Weakly-Supervised Learning

2023-06-05 · Rongzhi Zhang, Yue Yu, Jiaming Shen, Xiquan Cui 외

Boosting is a commonly used technique to enhance the performance of a set of base models by combining them into a strong ensemble model. Though widely adopted, boosting is typically used in supervised learning where the …

Weakly-supervised Learning

Building semi-supervised decision trees with semi-cart algorithm

2024-04-24 · International Journal of Machine Learning and Cybernetics 2024 4 · Aydin Abedinia, Vahid Seydi

Decision trees are a fundamental statistical learning tool for addressing classification and regression problems through a recursive partitioning approach that effectively accommodates numerical and categorical data [1, …

Classificationregression

Wasserstein Gradient Boosting: A Framework for Distribution-Valued Supervised Learning

2024-05-15 · Takuo Matsubara

Gradient boosting is a sequential ensemble method that fits a new weaker learner to pseudo residuals at each iteration. We propose Wasserstein gradient boosting, a novel extension of gradient boosting that fits a new wea…

regressionUncertainty Quantification

Regularized Boost for Semi-Supervised Learning

2007-12-01 · NeurIPS 2007 12 · Ke Chen, Shihai Wang

Semi-supervised inductive learning concerns how to learn a decision rule from a data set containing both labeled and unlabeled data. Several boosting algorithms have been extended to semi-supervised learning with various…

Ensemble LearningInductive Learning