Auxiliary Tasks in Multi-task Learning
Multi-task convolutional neural networks (CNNs) have shown impressive results for certain combinations of tasks, such as single-image depth estimation (SIDE) and semantic segmentation. This is achieved by pushing the network towards learning a robust representation that generalizes well to different atomic tasks. We extend this concept by adding auxiliary tasks, which are of minor relevance for the application, to the set of learned tasks. As a kind of additional regularization, they are expected to boost the performance of the ultimately desired main tasks. To study the proposed approach, we picked vision-based road scene understanding (RSU) as an exemplary application. Since multi-task learning requires specialized datasets, particularly when using extensive sets of tasks, we provide a multi-modal dataset for multi-task RSU, called synMT. More than 2.5 $\cdot$ 10^5 synthetic images, annotated with 21 different labels, were acquired from the video game Grand Theft Auto V (GTA V). Our proposed deep multi-task CNN architecture was trained on various combination of tasks using synMT. The experiments confirmed that auxiliary tasks can indeed boost network performance, both in terms of final results and training time.
Code (3)
Tasks
Depth EstimationMulti-Task Learningroad scene understandingScene UnderstandingSemantic SegmentationSimilar Papers 제목 키워드 기반
Efficient Multi-Task Auxiliary Learning: Selecting Auxiliary Data by Feature Similarity
Multi-task auxiliary learning utilizes a set of relevant auxiliary tasks to improve the performance of a primary task. A common usage is to manually select multiple auxiliary tasks for multi-task learning on all data, wh…
Auxiliary LearningMRPCMulti-Task LearningRTE+2Reusing Preprocessing Data as Auxiliary Supervision in Conversational Analysis
Conversational analysis systems are trained using noisy human labels and often require heavy preprocessing during multi-modal feature extraction. Using noisy labels in single-task learning increases the risk of over-fitt…
Feature EngineeringMulti-Task LearningAutoSeM: Automatic Task Selection and Mixing in Multi-Task Learning
Multi-task learning (MTL) has achieved success over a wide range of problems, where the goal is to improve the performance of a primary task using a set of relevant auxiliary tasks. However, when the usefulness of the au…
Bayesian OptimizationInductive BiasMulti-Task LearningThompson SamplingAuxiliary Learning for Named Entity Recognition with Multiple Auxiliary Biomedical Training Data
Named entity recognition (NER) is one of the elemental technologies, which has been used for knowledge extraction from biomedical text. As one of the NER improvement approaches, multi-task learning that learns a model fr…
Auxiliary LearningMulti-Task Learningnamed-entity-recognitionNamed Entity Recognition+2Generating Auxiliary Tasks with Reinforcement Learning
Auxiliary Learning (AL) is a form of multi-task learning in which a model trains on auxiliary tasks to boost performance on a primary objective. While AL has improved generalization across domains such as navigation, ima…
Reinforcement LearningImage ClassificationMulti-Task Learning