Task Selection and Assignment for Multi-modal Multi-task Dialogue Act Classification with Non-stationary Multi-armed Bandits
Multi-task learning (MTL) aims to improve the performance of a primary task by jointly learning with related auxiliary tasks. Traditional MTL methods select tasks randomly during training. However, both previous studies and our results suggest that such a random selection of tasks may not be helpful, and can even be harmful to performance. Therefore, new strategies for task selection and assignment in MTL need to be explored. This paper studies the multi-modal, multi-task dialogue act classification task, and proposes a method for selecting and assigning tasks based on non-stationary multi-armed bandits (MAB) with discounted Thompson Sampling (TS) using Gaussian priors. Our experimental results show that in different training stages, different tasks have different utility. Our proposed method can effectively identify the task utility, actively avoid useless or harmful tasks, and realise the task assignment during training. Our proposed method is significantly superior in terms of UAR and F1 to the single-task and multi-task baselines with p-values < 0.05. Further analysis of experiments indicates that for the dataset with the data imbalance problem, our proposed method has significantly higher stability and can obtain consistent and decent performance for minority classes. Our proposed method is superior to the current state-of-the-art model.
Code (0)
등록된 구현이 없습니다.
Tasks
Dialogue Act ClassificationMulti-Armed BanditsMulti-Task LearningThompson SamplingSimilar Papers 제목 키워드 기반
Modeling Transit in a Fully Integrated Agent-Based Framework: Methodology and Large-Scale Application
This study presents a transit routing, assignment, and simulation framework which is fully embedded in a multimodal, multi-agent transportation demand and supply modeling platform. POLARIS, a high-performance agent-based…
Decision MakingTask Selection for Bandit-Based Task Assignment in Heterogeneous Crowdsourcing
Task selection (picking an appropriate labeling task) and worker selection (assigning the labeling task to a suitable worker) are two major challenges in task assignment for crowdsourcing. Recently, worker selection has …
Active LearningMulti-Cycle Assignment Problems with Rotational Diversity
Multi-cycle assignment problems address scenarios where a series of general assignment problems has to be solved sequentially. Subsequent cycles can differ from previous ones due to changing availability or creation of t…
DiversityOptimal Transport Guided Correlation Assignment for Multimodal Entity Linking
Multimodal Entity Linking (MEL) aims to link ambiguous mentions in multimodal contexts to entities in a multimodal knowledge graph. A pivotal challenge is to fully leverage multi-element correlations between mentions and…
Entity LinkingKnowledge DistillationFeature Selection For High-Dimensional Clustering
We present a nonparametric method for selecting informative features in high-dimensional clustering problems. We start with a screening step that uses a test for multimodality. Then we apply kernel density estimation and…
ClusteringDensity Estimationfeature selectionVocal Bursts Intensity Prediction