paper-with-me

홈 › Papers

Adversarial Training for Multi-task and Multi-lingual Joint Modeling of Utterance Intent Classification

2018-10-01 · EMNLP 2018 10 · Ryo Masumura, Yusuke Shinohara, Ryuichiro Higashinaka, Yushi Aono

This paper proposes an adversarial training method for the multi-task and multi-lingual joint modeling needed for utterance intent classification. In joint modeling, common knowledge can be efficiently utilized among multiple tasks or multiple languages. This is achieved by introducing both language-specific networks shared among different tasks and task-specific networks shared among different languages. However, the shared networks are often specialized in majority tasks or languages, so performance degradation must be expected for some minor data sets. In order to improve the invariance of shared networks, the proposed method introduces both language-specific task adversarial networks and task-specific language adversarial networks; both are leveraged for purging the task or language dependencies of the shared networks. The effectiveness of the adversarial training proposal is demonstrated using Japanese and English data sets for three different utterance intent classification tasks.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

General Classificationintent-classificationIntent ClassificationSpoken Dialogue Systems

Similar Papers 제목 키워드 기반

OCHADAI at SemEval-2022 Task 2: Adversarial Training for Multilingual Idiomaticity Detection

2022-06-07 · SemEval (NAACL) 2022 7 · Lis Kanashiro Pereira, Ichiro Kobayashi

We propose a multilingual adversarial training model for determining whether a sentence contains an idiomatic expression. Given that a key challenge with this task is the limited size of annotated data, our model relies …

SentenceTask 2

Adversarial Training for Multilingual Acoustic Modeling

2019-06-17 · Ke Hu, Hasim Sak, Hank Liao

Multilingual training has been shown to improve acoustic modeling performance by sharing and transferring knowledge in modeling different languages. Knowledge sharing is usually achieved by using common lower-level layer…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Language Identificationspeech-recognition+1

PAW at SemEval-2021 Task 2: Multilingual and Cross-lingual Word-in-Context Disambiguation : Exploring Cross Lingual Transfer, Augmentations and Adversarial Training

2021-08-01 · SEMEVAL 2021 · Harsh Goyal, Aadarsh Singh, Priyanshu Kumar

We experiment with XLM RoBERTa for Word in Context Disambiguation in the Multi Lingual and Cross Lingual setting so as to develop a single model having knowledge about both settings. We solve the problem as a binary clas…

Binary ClassificationCross-Lingual TransferData AugmentationTask 2

Adversarial Learning with Contextual Embeddings for Zero-resource Cross-lingual Classification and NER

2019-08-31 · IJCNLP 2019 11 · Phillip Keung, Yichao Lu, Vikas Bhardwaj

Contextual word embeddings (e.g. GPT, BERT, ELMo, etc.) have demonstrated state-of-the-art performance on various NLP tasks. Recent work with the multilingual version of BERT has shown that the model performs very well i…

General Classificationnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+4

Improving Zero-Shot Cross-Lingual Transfer Learning via Robust Training

2021-04-17 · EMNLP 2021 11 · Kuan-Hao Huang, Wasi Uddin Ahmad, Nanyun Peng, Kai-Wei Chang

Pre-trained multilingual language encoders, such as multilingual BERT and XLM-R, show great potential for zero-shot cross-lingual transfer. However, these multilingual encoders do not precisely align words and phrases ac…

Cross-Lingual TransferSentencetext-classificationText Classification+3