paper-with-me

Papers

CLaC at SemEval-2023 Task 2: Comparing Span-Prediction and Sequence-Labeling approaches for NER

2023-05-05 · Harsh Verma, Sabine Bergler

This paper summarizes the CLaC submission for the MultiCoNER 2 task which concerns the recognition of complex, fine-grained named entities. We compare two popular approaches for NER, namely Sequence Labeling and Span Prediction. We find that our best Span Prediction system performs slightly better than our best Sequence Labeling system on test data. Moreover, we find that using the larger version of XLM RoBERTa significantly improves performance. Post-competition experiments show that Span Prediction and Sequence Labeling approaches improve when they use special input tokens (<s> and </s>) of XLM-RoBERTa. The code for training all models, preprocessing, and post-processing is available at https://github.com/harshshredding/semeval2023-multiconer-paper.

📄 PDF Abstract BibTeX arXiv:2305.03845

Code (0)

등록된 구현이 없습니다.

Tasks

NERPredictionTask 2

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Test 설명 없음
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
WordPiece 설명 없음
Weight Decay 설명 없음
Residual Connection 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Similar Papers 제목 키워드 기반

CLaC-SentiPipe: SemEval2015 Subtasks 10 B,E, and Task 11

2015-06-01 · SEMEVAL 2015 6 · Canberk {\"O}zdemir, Sabine Bergler
Sentiment AnalysisTwitter Sentiment Analysis

CLaC at SemEval-2016 Task 11: Exploring linguistic and psycho-linguistic Features for Complex Word Identification

2017-09-08 · SEMEVAL 2016 6 · Elnaz Davoodi, Leila Kosseim

This paper describes the system deployed by the CLaC-EDLK team to the "SemEval 2016, Complex Word Identification task". The goal of the task is to identify if a given word in a given context is "simple" or "complex". Our…

Complex Word Identification

CLaC at SemEval-2020 Task 5: Muli-task Stacked Bi-LSTMs

2020-12-01 · SEMEVAL 2020 · MinGyou Sung, Parsa Bagherzadeh, Sabine Bergler

We consider detection of the span of antecedents and consequents in argumentative prose a structural, grammatical task. Our system comprises a set of stacked Bi-LSTMs trained on two complementary linguistic annotations. …

Multi-Task LearningPOSWord Embeddings

CLaCLab at SocialDisNER: Using Medical Gazetteers for Named-Entity Recognition of Disease Mentions in Spanish Tweets

2022-09-08 · SMM4H (COLING) 2022 10 · Harsh Verma, Parsa Bagherzadeh, Sabine Bergler

This paper summarizes the CLaC submission for SMM4H 2022 Task 10 which concerns the recognition of diseases mentioned in Spanish tweets. Before classifying each token, we encode each token with a transformer encoder usin…

named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)

CLaC-BP at SemEval-2021 Task 8: SciBERT Plus Rules for MeasEval

2021-08-01 · SEMEVAL 2021 · Benjamin Therien, Parsa Bagherzadeh, Sabine Bergler

This paper explains the design of a heterogeneous system that ranked eighth in competition in SemEval2021 Task 8. We analyze ablation experiments and demonstrate how the system components, namely tokenizer, unit identifi…

Language ModelingLanguage Modelling