Predicate-Argument Based Bi-Encoder for Paraphrase Identification
Paraphrase identification involves identifying whether a pair of sentences express the same or similar meanings. While cross-encoders have achieved high performances across several benchmarks, bi-encoders such as SBERT have been widely applied to sentence pair tasks. They exhibit substantially lower computation complexity and are better suited to symmetric tasks. In this work, we adopt a bi-encoder approach to the paraphrase identification task, and investigate the impact of explicitly incorporating predicate-argument information into SBERT through weighted aggregation. Experiments on six paraphrase identification datasets demonstrate that, with a minimal increase in parameters, the proposed model is able to outperform SBERT/SRoBERTa significantly. Further, ablation studies reveal that the predicate-argument based component plays a significant role in the performance gain.
Code (0)
등록된 구현이 없습니다.
Tasks
Paraphrase IdentificationSentenceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Predicate-Argument Based Bi-Encoder for Paraphrase Identification
Paraphrase identification involves identifying whether a pair of sentences express the same or similar meanings. While cross-encoders have achieved high performances across several benchmarks, bi-encoders such as SBERT h…
Paraphrase IdentificationSentenceTowards Structure-aware Paraphrase Identification with Phrase Alignment Using Sentence Encoders
Previous works have demonstrated the effectiveness of utilising pre-trained sentence encoders based on their sentence representations for meaning comparison tasks. Though such representations are shown to capture hidden …
Paraphrase IdentificationSensitivitySentenceLearning Typed Entailment Graphs with Global Soft Constraints
This paper presents a new method for learning typed entailment graphs from text. We extract predicate-argument structures from multiple-source news corpora, and compute local distributional similarity scores to learn ent…
Graph LearningPriMeSRL-Eval: A Practical Quality Metric for Semantic Role Labeling Systems Evaluation
Semantic role labeling (SRL) identifies the predicate-argument structure in a sentence. This task is usually accomplished in four steps: predicate identification, predicate sense disambiguation, argument identification, …
Semantic Role LabelingSentenceConstruction and Alignment of Multilingual Entailment Graphs for Semantic Inference
This paper presents ongoing work on the construction and alignment of predicate entailment graphs in English and German. We extract predicate-argument pairs from large corpora of monolingual English and German news text …