Transformer-based Methods for Recognizing Ultra Fine-grained Entities (RUFES)

2021-04-13 · Emanuela Boros, Antoine Doucet

This paper summarizes the participation of the Laboratoire Informatique, Image et Interaction (L3i laboratory) of the University of La Rochelle in the Recognizing Ultra Fine-grained Entities (RUFES) track within the Text Analysis Conference (TAC) series of evaluation workshops. Our participation relies on two neural-based models, one based on a pre-trained and fine-tuned language model with a stack of Transformer layers for fine-grained entity extraction and one out-of-the-box model for within-document entity coreference. We observe that our approach has great potential in increasing the performance of fine-grained entity recognition. Thus, the future work envisioned is to enhance the ability of the models following additional experiments and a deeper analysis of the results.

📄 PDF Abstract BibTeX arXiv:2104.06048

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage Modelling

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음

Attention 설명 없음

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Position-Wise Feed-Forward Layer 설명 없음

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Adam 설명 없음

A Complementary Global and Local Knowledge Network for Ultrasound denoising with Fine-grained Refinement

2023-10-05 · Zhenyu Bu, Kai-Ni Wang, Fuxing Zhao, Shengxiao Li 외

Ultrasound imaging serves as an effective and non-invasive diagnostic tool commonly employed in clinical examinations. However, the presence of speckle noise in ultrasound images invariably degrades image quality, impedi…

Decoder Denoising Diagnostic image smoothing

UltraWiki: Ultra-fine-grained Entity Set Expansion with Negative Seed Entities

2024-03-07 · Yangning Li, Qingsong Lv, Tianyu Yu, Yinghui Li 외

Entity Set Expansion (ESE) aims to identify new entities belonging to the same semantic class as a given set of seed entities. Traditional methods primarily relied on positive seed entities to represent a target semantic…

Attribute Contrastive Learning Retrieval

Learning Cross-Image Object Semantic Relation in Transformer for Few-Shot Fine-Grained Image Classification

2022-07-02 · Bo Zhang, Jiakang Yuan, Baopu Li, Tao Chen 외

Few-shot fine-grained learning aims to classify a query image into one of a set of support categories with fine-grained differences. Although learning different objects' local differences via Deep Neural Networks has ach…

Fine-Grained Image Classification image-classification Image Classification Object+1

Multimodal Fusion for Fine-Grained Classification of Breast Fibroadenoma and Phyllodes Tumors

2026-07-02 · Chuxi Nan, Di Wu, Hongming Guo, Ning Cao 외 arxiv

Breast fibroadenoma (FA) and phyllodes tumor (PT) are fibroepithelial breast lesions with highly overlapping appearances on B-mode ultrasound, making benign and borderline PT prone to being misclassified as FA and compli…

Representation Learning

Guided Patch-Grouping Wavelet Transformer with Spatial Congruence for Ultra-High Resolution Segmentation

2023-07-03 · Deyi Ji, Feng Zhao, Hongtao Lu

Most existing ultra-high resolution (UHR) segmentation methods always struggle in the dilemma of balancing memory cost and local characterization accuracy, which are both taken into account in our proposed Guided Patch-G…