paper-with-me

홈 › Papers

KnowGraph@IITK at SemEval-2021 Task 11: Building KnowledgeGraph for NLP Research

2021-04-04 · Shashank Shailabh, Sajal Chaurasia, Ashutosh Modi

Research in Natural Language Processing is making rapid advances, resulting in the publication of a large number of research papers. Finding relevant research papers and their contribution to the domain is a challenging problem. In this paper, we address this challenge via the SemEval 2021 Task 11: NLPContributionGraph, by developing a system for a research paper contributions-focused knowledge graph over Natural Language Processing literature. The task is divided into three sub-tasks: extracting contribution sentences that show important contributions in the research article, extracting phrases from the contribution sentences, and predicting the information units in the research article together with triplet formation from the phrases. The proposed system is agnostic to the subject domain and can be applied for building a knowledge graph for any area. We found that transformer-based language models can significantly improve existing techniques and utilized the SciBERT-based model. Our first sub-task uses Bidirectional LSTM (BiLSTM) stacked on top of SciBERT model layers, while the second sub-task uses Conditional Random Field (CRF) on top of SciBERT with BiLSTM. The third sub-task uses a combined SciBERT based neural approach with heuristics for information unit prediction and triplet formation from the phrases. Our system achieved F1 score of 0.38, 0.63 and 0.76 in end-to-end pipeline testing, phrase extraction testing and triplet extraction testing respectively.

📄 PDF Abstract BibTeX arXiv:2104.01619

Code (1)

sshailabh/SemEval-2021-Task-11 공식 구현 pytorch

Tasks

Triplet

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음
BiLSTM A Bidirectional LSTM, or biLSTM, is a sequence processing model that consists of two LSTMs: one taking the input in a forward direction, and the other in a backwards…
Tanh Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…

Similar Papers 제목 키워드 기반

KnowGraph@IITK at SemEval-2021 Task 11: Building Knowledge Graph for NLP Research

2021-08-01 · SEMEVAL 2021 · Shashank Shailabh, Sajal Chaurasia, Ashutosh Modi

Research in Natural Language Processing is making rapid advances, resulting in the publication of a large number of research papers. Finding relevant research papers and their contribution to the domain is a challenging …

Triplet

IITK at SemEval-2020 Task 10: Transformers for Emphasis Selection

2020-07-21 · SEMEVAL 2020 · Vipul Singhal, Sahil Dhull, Rishabh Agarwal, Ashutosh Modi

This paper describes the system proposed for addressing the research problem posed in Task 10 of SemEval-2020: Emphasis Selection For Written Text in Visual Media. We propose an end-to-end model that takes as input the t…

IITK@LCP at SemEval 2021 Task 1: Classification for Lexical Complexity Regression Task

2021-04-02 · Neil Rajiv Shirude, Sagnik Mukherjee, Tushar Shandhilya, Ananta Mukherjee 외

This paper describes our contribution to SemEval 2021 Task 1: Lexical Complexity Prediction. In our approach, we leverage the ELECTRA model and attempt to mirror the data annotation scheme. Although the task is a regress…

General ClassificationLexical Complexity PredictionregressionTask 2

IITK@LCP at SemEval-2021 Task 1: Classification for Lexical Complexity Regression Task

2021-08-01 · SEMEVAL 2021 · Neil Shirude, Sagnik Mukherjee, Tushar Shandhilya, Ananta Mukherjee 외

This paper describes our contribution to SemEval 2021 Task 1 (Shardlow et al., 2021): Lexical Complexity Prediction. In our approach, we leverage the ELECTRA model and attempt to mirror the data annotation scheme. Althou…

Lexical Complexity PredictionregressionTask 2

ReCAM@IITK at SemEval-2021 Task 4: BERT and ALBERT based Ensemble for Abstract Word Prediction

2021-04-04 · SEMEVAL 2021 · Abhishek Mittal, Ashutosh Modi

This paper describes our system for Task 4 of SemEval-2021: Reading Comprehension of Abstract Meaning (ReCAM). We participated in all subtasks where the main goal was to predict an abstract word missing from a statement.…

Language ModelingLanguage ModellingMasked Language ModelingReading Comprehension