Task-oriented Word Embedding for Text Classification

2018-08-01 · COLING 2018 8 · Qian Liu, He-Yan Huang, Yang Gao, Xiaochi Wei, Yuxin Tian, Luyang Liu

Distributed word representation plays a pivotal role in various natural language processing tasks. In spite of its success, most existing methods only consider contextual information, which is suboptimal when used in various tasks due to a lack of task-specific features. The rational word embeddings should have the ability to capture both the semantic features and task-specific features of words. In this paper, we propose a task-oriented word embedding method and apply it to the text classification task. With the function-aware component, our method regularizes the distribution of words to enable the embedding space to have a clear classification boundary. We evaluate our method using five text classification datasets. The experiment results show that our method significantly outperforms the state-of-the-art methods.

📄 PDF Abstract BibTeX

Code (1)

qianliu0708/ToWE 공식 구현

Tasks

Classification General Classification Information Retrieval Sentiment Analysis text-classification Text ClassificationWord Embeddings

Task-oriented Domain-specific Meta-Embedding for Text Classification

2020-11-01 · EMNLP 2020 11 · Xin Wu, Yi Cai, Yang Kai, Tao Wang 외

Meta-embedding learning, which combines complementary information in different word embeddings, have shown superior performances across different Natural Language Processing tasks. However, domain-specific knowledge is s…

Classification General Classification text-classification Text Classification+1

Contextual and Position-Aware Factorization Machines for Sentiment Classification

2018-01-18 · Shuai Wang, Mianwei Zhou, Geli Fei, Yi Chang 외

While existing machine learning models have achieved great success for sentiment classification, they typically do not explicitly capture sentiment-oriented word interaction, which can lead to poor results for fine-grain…

Classification General Classification Position Recommendation Systems+4

Task-Oriented Learning of Word Embeddings for Semantic Relation Classification

2015-02-28 · CONLL 2015 7 · Kazuma Hashimoto, Pontus Stenetorp, Makoto Miwa, Yoshimasa Tsuruoka

We present a novel learning method for word embeddings designed for relation classification. Our word embeddings are trained by predicting words between noun pairs using lexical relation-specific features on a large unla…

Classification General Classification Relation Relation Classification+1

Atalaya at SemEval 2019 Task 5: Robust Embeddings for Tweet Classification

2019-06-01 · SEMEVAL 2019 6 · Juan Manuel P{\'e}rez, Franco M. Luque

In this article, we describe our participation in HatEval, a shared task aimed at the detection of hate speech against immigrants and women. We focused on Spanish subtasks, building from our previous experiences on senti…

General Classification Sentiment Analysis Word Embeddings

An Empirical Study on Leveraging Position Embeddings for Target-oriented Opinion Words Extraction

2021-09-02 · EMNLP 2021 11 · Samuel Mensah, Kai Sun, Nikolaos Aletras

Target-oriented opinion words extraction (TOWE) (Fan et al., 2019b) is a new subtask of target-oriented sentiment analysis that aims to extract opinion words for a given aspect in text. Current state-of-the-art methods l…

Position Sentiment Analysis target-oriented opinion words extraction Word Embeddings