paper-with-me

Papers

Partly Supervised Multitask Learning

2020-05-05 · Abdullah-Al-Zubaer Imran, Chao Huang, Hui Tang, Wei Fan, Yuan Xiao, Dingjun Hao, Zhen Qian, Demetri Terzopoulos

Semi-supervised learning has recently been attracting attention as an alternative to fully supervised models that require large pools of labeled data. Moreover, optimizing a model for multiple tasks can provide better generalizability than single-task learning. Leveraging self-supervision and adversarial training, we propose a novel general purpose semi-supervised, multiple-task model---namely, self-supervised, semi-supervised, multitask learning (S$^4$MTL)---for accomplishing two important tasks in medical imaging, segmentation and diagnostic classification. Experimental results on chest and spine X-ray datasets suggest that our S$^4$MTL model significantly outperforms semi-supervised single task, semi/fully-supervised multitask, and fully-supervised single task models, even with a 50\% reduction of class and segmentation labels. We hypothesize that our proposed model can be effective in tackling limited annotation problems for joint training, not only in medical imaging domains, but also for general-purpose vision tasks.

📄 PDF Abstract BibTeX arXiv:2005.02523

Code (0)

등록된 구현이 없습니다.

Tasks

DiagnosticMedical Image SegmentationSegmentation

Similar Papers 제목 키워드 기반

Kernels for Vector-Valued Functions: a Review

2011-06-30 · Mauricio A. Alvarez, Lorenzo Rosasco, Neil D. Lawrence

Kernel methods are among the most popular techniques in machine learning. From a frequentist/discriminative perspective they play a central role in regularization theory as they provide a natural choice for the hypothese…

Gaussian Processesvalid

Language-Aware Multilingual Machine Translation with Self-Supervised Learning

2023-02-10 · Haoran Xu, Jean Maillard, Vedanuj Goswami

Multilingual machine translation (MMT) benefits from cross-lingual transfer but is a challenging multitask optimization problem. This is partly because there is no clear framework to systematically learn language-specifi…

Cross-Lingual TransferDecoderDenoisingMachine Translation+2

Multitask Learning Strengthens Adversarial Robustness

2020-07-14 · ECCV 2020 8 · Chengzhi Mao, Amogh Gupta, Vikram Nitin, Baishakhi Ray 외

Although deep networks achieve strong accuracy on a range of computer vision benchmarks, they remain vulnerable to adversarial attacks, where imperceptible input perturbations fool the network. We present both theoretica…

Adversarial DefenseAdversarial Robustness

Instruction Pre-Training: Language Models are Supervised Multitask Learners

2024-06-20 · Daixuan Cheng, Yuxian Gu, Shaohan Huang, Junyu Bi 외

Unsupervised multitask pre-training has been the critical method behind the recent success of language models (LMs). However, supervised multitask learning still holds significant promise, as scaling it in the post-train…

Unsupervised Online Multitask Learning of Behavioral Sentence Embeddings

2018-07-18 · Shao-Yen Tseng, Brian Baucom, Panayiotis Georgiou

Unsupervised learning has been an attractive method for easily deriving meaningful data representations from vast amounts of unlabeled data. These representations, or embeddings, often yield superior results in many task…

Domain AdaptationSentenceSentence Embeddings