paper-with-me

Papers

Semantic Frame Induction using Masked Word Embeddings and Two-Step Clustering

2021-05-27 · ACL 2021 5 · Kosuke Yamada, Ryohei Sasano, Koichi Takeda

Recent studies on semantic frame induction show that relatively high performance has been achieved by using clustering-based methods with contextualized word embeddings. However, there are two potential drawbacks to these methods: one is that they focus too much on the superficial information of the frame-evoking verb and the other is that they tend to divide the instances of the same verb into too many different frame clusters. To overcome these drawbacks, we propose a semantic frame induction method using masked word embeddings and two-step clustering. Through experiments on the English FrameNet data, we demonstrate that using the masked word embeddings is effective for avoiding too much reliance on the surface information of frame-evoking verbs and that two-step clustering can improve the number of resulting frame clusters for the instances of the same verb.

📄 PDF Abstract BibTeX arXiv:2105.13466

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringVocal Bursts Valence PredictionWord Embeddings

Similar Papers 제목 키워드 기반

FrameEOL: Semantic Frame Induction using Causal Language Models

2025-10-10 · Chihiro Yano, Kosuke Yamada, Hayato Tsukagoshi, Ryohei Sasano 외 arxiv

Semantic frame induction is the task of clustering frame-evoking words according to the semantic frames they evoke. In recent years, leveraging embeddings of frame-evoking words that are obtained using masked language mo…

Metric Learning

Modelling General Properties of Nouns by Selectively Averaging Contextualised Embeddings

2020-12-04 · Na Li, Zied Bouraoui, Jose Camacho Collados, Luis Espinosa-Anke 외

While the success of pre-trained language models has largely eliminated the need for high-quality static word vectors in many NLP applications, such vectors continue to play an important role in tasks where words need to…

Knowledge Base Completion

HHMM at SemEval-2019 Task 2: Unsupervised Frame Induction using Contextualized Word Embeddings

2019-05-05 · SEMEVAL 2019 6 · Saba Anwar, Dmitry Ustalov, Nikolay Arefyev, Simone Paolo Ponzetto 외

We present our system for semantic frame induction that showed the best performance in Subtask B.1 and finished as the runner-up in Subtask A of the SemEval 2019 Task 2 on unsupervised semantic frame induction (QasemiZad…

ClusteringTask 2Word Embeddings

Semantic Frame Induction with Deep Metric Learning

2023-04-27 · Kosuke Yamada, Ryohei Sasano, Koichi Takeda

Recent studies have demonstrated the usefulness of contextualized word embeddings in unsupervised semantic frame induction. However, they have also revealed that generic contextualized embeddings are not always consisten…

Metric LearningWord Embeddings

Neural GRANNy at SemEval-2019 Task 2: A combined approach for better modeling of semantic relationships in semantic frame induction

2019-06-01 · SEMEVAL 2019 6 · Nikolay Arefyev, Boris Sheludko, Adis Davletov, Dmitry Kharchev 외

We describe our solutions for semantic frame and role induction subtasks of SemEval 2019 Task 2. Our approaches got the highest scores, and the solution for the frame induction problem officially took the first place. Th…

ClusteringLanguage ModelingLanguage ModellingTask 2