홈 › Papers

Comparing Probabilistic, Distributional and Transformer-Based Models on Logical Metonymy Interpretation

2020-12-01 · Asian Chapter of the Association for Computational Linguistics 2020 · Giulia Rambelli, Emmanuele Chersoni, Alessandro Lenci, Philippe Blache, Chu-Ren Huang

In linguistics and cognitive science, Logical metonymies are defined as type clashes between an event-selecting verb and an entity-denoting noun (e.g. The editor finished the article), which are typically interpreted by inferring a hidden event (e.g. reading) on the basis of contextual cues. This paper tackles the problem of logical metonymy interpretation, that is, the retrieval of the covert event via computational methods. We compare different types of models, including the probabilistic and the distributional ones previously introduced in the literature on the topic. For the first time, we also tested on this task some of the recent Transformer-based models, such as BERT, RoBERTa, XLNet, and GPT-2. Our results show a complex scenario, in which the best Transformer-based models and some traditional distributional models perform very similarly. However, the low performance on some of the testing datasets suggests that logical metonymy is still a challenging phenomenon for computational modeling.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Retrieval

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…

Linear Warmup With Cosine Annealing Linear Warmup With Cosine Annealing is a learning rate schedule where we increase the learning rate linearly for $n$ updates and then anneal according to a cosine schedule…

BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Discriminative Fine-Tuning Discriminative Fine-Tuning is a fine-tuning strategy that is used for ULMFiT type models. Instead of using the same learning rate…

Attention 설명 없음

Adam 설명 없음

GPT-2 GPT-2 is a Transformer architecture that was notable for its size (1.5 billion parameters) on its release. The…

Modeling covert event retrieval in logical metonymy: probabilistic and distributional accounts

2012-06-01 · WS 2012 6 · Aless Zarcone, ra, Jason Utt, Sebastian Pad{\'o}

Retrieval

Logical Metonymy in a Distributional Model of Sentence Comprehension

2017-08-01 · SEMEVAL 2017 8 · Emmanuele Chersoni, Aless Lenci, ro, Philippe Blache

In theoretical linguistics, logical metonymy is defined as the combination of an event-subcategorizing verb with an entity-denoting direct object (e.g., The author began the book), so that the interpretation of the VP re…

Retrieval Sentence

Fitting, Not Clashing! A Distributional Semantic Model of Logical Metonymy

2013-03-01 · WS 2013 3 · Aless Zarcone, ra, Aless Lenci, ro 외

Don't Invite BERT to Drink a Bottle: Modeling the Interpretation of Metonymies Using BERT and Distributional Representations

2020-12-01 · COLING 2020 8 · Paolo Pedinotti, Alessandro Lenci

In this work, we carry out two experiments in order to assess the ability of BERT to capture the meaning shift associated with metonymic expressions. We test the model on a new dataset that is representative of the most …

Paraphrasing verbal metonymy through computational methods

2017-09-18 · Alberto Morón Hernández

Verbal metonymy has received relatively scarce attention in the field of computational linguistics despite the fact that a model to accurately paraphrase metonymy has applications both in academia and the technology sect…