paper-with-me

Papers

MECT: Multi-Metadata Embedding based Cross-Transformer for Chinese Named Entity Recognition

2021-07-12 · ACL 2021 5 · Shuang Wu, Xiaoning Song, ZhenHua Feng

Recently, word enhancement has become very popular for Chinese Named Entity Recognition (NER), reducing segmentation errors and increasing the semantic and boundary information of Chinese words. However, these methods tend to ignore the information of the Chinese character structure after integrating the lexical information. Chinese characters have evolved from pictographs since ancient times, and their structure often reflects more information about the characters. This paper presents a novel Multi-metadata Embedding based Cross-Transformer (MECT) to improve the performance of Chinese NER by fusing the structural information of Chinese characters. Specifically, we use multi-metadata embedding in a two-stream Transformer to integrate Chinese character features with the radical-level embedding. With the structural characteristics of Chinese characters, MECT can better capture the semantic information of Chinese characters for NER. The experimental results obtained on several well-known benchmarking datasets demonstrate the merits and superiority of the proposed MECT method.\footnote{The source code of the proposed method is publicly available at https://github.com/CoderMusou/MECT4CNER.

📄 PDF Abstract BibTeX arXiv:2107.05418

Code (1)

CoderMusou/MECT4CNER 공식 구현 pytorch

Tasks

BenchmarkingChinese Named Entity Recognitionnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Adam 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

Bayesian hypothesis testing and hierarchical modelling of ivermectin effectiveness in treating Covid-19

2021-08-18 · Martin Neil, Norman Fenton

Ivermectin is an antiparasitic drug that some have claimed is an effective treatment for reducing Covid-19 deaths. To test this claim, two recent peer reviewed papers both conducted a meta-analysis on a similar set of ra…

EXIF as Language: Learning Cross-Modal Associations Between Images and Camera Metadata

2023-01-11 · CVPR 2023 1 · Chenhao Zheng, Ayush Shrivastava, Andrew Owens

We learn a visual representation that captures information about the camera that recorded a given photo. To do this, we train a multimodal embedding between image patches and the EXIF metadata that cameras automatically …

ClusteringImage Forensics

MECTA: Memory-Economic Continual Test-Time Model Adaptation

2023-02-01 · ICLR 2023 2 · Junyuan Hong, Lingjuan Lyu, Jiayu Zhou, Michael Spranger

Continual Test-time Adaptation (CTA) is a promising art to secure accuracy gains in continually-changing environments. The state-of-the-art adaptations improve out-of-distribution model accuracy via computation-efficient…

modelTest-time Adaptation

Metadata Matters for Time Series: Informative Forecasting with Transformers

2024-10-04 · Jiaxiang Dong, Haixu Wu, Yuxuan Wang, Li Zhang 외

Time series forecasting is prevalent in extensive real-world applications, such as financial analysis and energy planning. Previous studies primarily focus on time series modality, endeavoring to capture the intricate va…

Financial AnalysisTime SeriesTime Series Forecasting

M3HG: Multimodal, Multi-scale, and Multi-type Node Heterogeneous Graph for Emotion Cause Triplet Extraction in Conversations

2025-08-26 · Qiao Liang, Ying Shen, Tiantian Chen, Lin Zhang arxiv

Emotion Cause Triplet Extraction in Multimodal Conversations (MECTEC) has recently gained significant attention in social media analysis, aiming to extract emotion utterances, cause utterances, and emotion categories sim…