paper-with-me

Papers

MelBERT: Metaphor Detection via Contextualized Late Interaction using Metaphorical Identification Theories

2021-04-28 · NAACL 2021 4 · Minjin Choi, Sunkyung Lee, Eunseong Choi, Heesoo Park, Junhyuk Lee, Dongwon Lee, Jongwuk Lee

Automated metaphor detection is a challenging task to identify metaphorical expressions of words in a sentence. To tackle this problem, we adopt pre-trained contextualized models, e.g., BERT and RoBERTa. To this end, we propose a novel metaphor detection model, namely metaphor-aware late interaction over BERT (MelBERT). Our model not only leverages contextualized word representation but also benefits from linguistic metaphor identification theories to distinguish between the contextual and literal meaning of words. Our empirical results demonstrate that MelBERT outperforms several strong baselines on four benchmark datasets, i.e., VUA-18, VUA-20, MOH-X, and TroFi.

📄 PDF Abstract BibTeX arXiv:2104.13615

Code (1)

jin530/MelBERT 공식 구현 pytorch

Tasks

Sentence

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
WordPiece 설명 없음
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

A Reproducible Multi-Architecture Baseline for Token-Level Chinese Metaphor Identification under the MIPVU Framework

2026-05-08 · Yufeng Wu arxiv

Metaphor is pervasive in everyday language, yet token-level computational identification of metaphor-related words in Chinese under the MIPVU framework remains under-explored relative to English. This paper presents a re…

Metaphor Detection using Deep Contextualized Word Embeddings

2020-09-26 · Shashwat Aggarwal, Ramesh Singh

Metaphors are ubiquitous in natural language, and their detection plays an essential role in many natural language processing tasks, such as language understanding, sentiment analysis, etc. Most existing approaches for m…

Sentiment AnalysisWord Embeddings

IlliniMet: Illinois System for Metaphor Detection with Contextual and Linguistic Information

2020-07-01 · WS 2020 7 · Hongyu Gong, Kshitij Gupta, Akriti Jain, Suma Bhat

Metaphors are rhetorical use of words based on the conceptual mapping as opposed to their literal use. Metaphor detection, an important task in language understanding, aims to identify metaphors in word level from given …

Metaphor Detection Using Contextual Word Embeddings From Transformers

2020-07-01 · WS 2020 7 · Jerry Liu, Nathan O{'}Hara, Alex Rubin, er 외

The detection of metaphors can provide valuable information about a given text and is crucial to sentiment analysis and machine translation. In this paper, we outline the techniques for word-level metaphor detection used…

Machine TranslationSentiment AnalysisTranslationWord Embeddings

Improving Neural Metaphor Detection with Visual Datasets

2020-05-01 · LREC 2020 5 · Gitit Kehat, James Pustejovsky

We present new results on Metaphor Detection by using text from visual datasets. Using a straightforward technique for sampling text from Vision-Language datasets, we create a data structure we term a visibility word emb…