paper-with-me

홈 › Papers

Metaphor Detection using Deep Contextualized Word Embeddings

2020-09-26 · Shashwat Aggarwal, Ramesh Singh

Metaphors are ubiquitous in natural language, and their detection plays an essential role in many natural language processing tasks, such as language understanding, sentiment analysis, etc. Most existing approaches for metaphor detection rely on complex, hand-crafted and fine-tuned feature pipelines, which greatly limit their applicability. In this work, we present an end-to-end method composed of deep contextualized word embeddings, bidirectional LSTMs and multi-head attention mechanism to address the task of automatic metaphor detection. Our method, unlike many other existing approaches, requires only the raw text sequences as input features to detect the metaphoricity of a phrase. We compare the performance of our method against the existing baselines on two benchmark datasets, TroFi, and MOH-X respectively. Experimental evaluations confirm the effectiveness of our approach.

📄 PDF Abstract BibTeX arXiv:2009.12565

Code (0)

등록된 구현이 없습니다.

Tasks

Sentiment AnalysisWord Embeddings

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…
BiLSTM A Bidirectional LSTM, or biLSTM, is a sequence processing model that consists of two LSTMs: one taking the input in a forward direction, and the other in a backwards…
ELMo Embeddings from Language Models, or ELMo, is a type of deep contextualized word representation that models both (1) complex characteristics of word use (e.g., syntax and…
Residual Connection 설명 없음
Weight Decay 설명 없음

Similar Papers 제목 키워드 기반

Metaphor Detection Using Contextual Word Embeddings From Transformers

2020-07-01 · WS 2020 7 · Jerry Liu, Nathan O{'}Hara, Alex Rubin, er 외

The detection of metaphors can provide valuable information about a given text and is crucial to sentiment analysis and machine translation. In this paper, we outline the techniques for word-level metaphor detection used…

Machine TranslationSentiment AnalysisTranslationWord Embeddings

MelBERT: Metaphor Detection via Contextualized Late Interaction using Metaphorical Identification Theories

2021-04-28 · NAACL 2021 4 · Minjin Choi, Sunkyung Lee, Eunseong Choi, Heesoo Park 외

Automated metaphor detection is a challenging task to identify metaphorical expressions of words in a sentence. To tackle this problem, we adopt pre-trained contextualized models, e.g., BERT and RoBERTa. To this end, we …

Sentence

Improving Neural Metaphor Detection with Visual Datasets

2020-05-01 · LREC 2020 5 · Gitit Kehat, James Pustejovsky

We present new results on Metaphor Detection by using text from visual datasets. Using a straightforward technique for sampling text from Vision-Language datasets, we create a data structure we term a visibility word emb…

IlliniMet: Illinois System for Metaphor Detection with Contextual and Linguistic Information

2020-07-01 · WS 2020 7 · Hongyu Gong, Kshitij Gupta, Akriti Jain, Suma Bhat

Metaphors are rhetorical use of words based on the conceptual mapping as opposed to their literal use. Metaphor detection, an important task in language understanding, aims to identify metaphors in word level from given …

On the Impact of Temporal Representations on Metaphor Detection

2021-11-05 · LREC 2022 6 · Giorgio Ottolina, Matteo Palmonari, Mehwish Alam, Manuel Vimercati

State-of-the-art approaches for metaphor detection compare their literal - or core - meaning and their contextual meaning using metaphor classifiers based on neural networks. However, metaphorical expressions evolve over…

Word Embeddings