paper-with-me

홈 › Papers

Mutual Reinforcement Effects in Japanese Sentence Classification and Named Entity Recognition Tasks

2023-07-18 · Chengguang Gan, Qinghao Zhang, Tatsunori Mori

Information extraction(IE) is a crucial subfield within natural language processing. However, for the traditionally segmented approach to sentence classification and Named Entity Recognition, the intricate interactions between these individual subtasks remain largely uninvestigated. In this study, we propose an integrative analysis, converging sentence classification with Named Entity Recognition, with the objective to unveil and comprehend the mutual reinforcement effect within these two information extraction subtasks. To achieve this, we introduce a Sentence Classification and Named Entity Recognition Multi-task (SCNM) approach that combines Sentence Classification (SC) and Named Entity Recognition (NER). We develop a Sentence-to-Label Generation (SLG) framework for SCNM and construct a Wikipedia dataset containing both SC and NER. Using a format converter, we unify input formats and employ a generative model to generate SC-labels, NER-labels, and associated text segments. We propose a Constraint Mechanism (CM) to improve generated format accuracy. Our results show SC accuracy increased by 1.13 points and NER by 1.06 points in SCNM compared to standalone tasks, with CM raising format accuracy from 63.61 to 100. The findings indicate mutual reinforcement effects between SC and NER, and integration enhances both tasks' performance. We additionally implemented the SLG framework on single SC task. It yielded superior accuracies compared to the baseline on two distinct Japanese SC datasets. Notably, in the experiment of few-shot learning, SLG framework shows much better performance than fine-tune method. These empirical findings contribute additional evidence to affirm the efficacy of the SLG framework.

📄 PDF Abstract BibTeX arXiv:2307.10291

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationFew-Shot Learningnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERSentenceSentence Classification

Similar Papers 제목 키워드 기반

Sentence-to-Label Generation Framework for Multi-task Learning of Japanese Sentence Classification and Named Entity Recognition

2023-06-28 · Chengguang Gan, Qinghao Zhang, Tatsunori Mori

Information extraction(IE) is a crucial subfield within natural language processing. In this study, we introduce a Sentence Classification and Named Entity Recognition Multi-task (SCNM) approach that combines Sentence Cl…

Multi-Task Learningnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+3

MMM: Multilingual Mutual Reinforcement Effect Mix Datasets & Test with Open-domain Information Extraction Large Language Models

2024-07-15 · Chengguang Gan, Sunbowen Lee, Qingyu Yin, Xinyang He 외

The Mutual Reinforcement Effect (MRE) represents a promising avenue in information extraction and multitasking research. Nevertheless, its applicability has been constrained due to the exclusive availability of MRE mix d…

Language ModelingLanguage ModellingLarge Language Modelnamed-entity-recognition+5

GIELLM: Japanese General Information Extraction Large Language Model Utilizing Mutual Reinforcement Effect

2023-11-12 · Chengguang Gan, Qinghao Zhang, Tatsunori Mori

Information Extraction (IE) stands as a cornerstone in natural language processing, traditionally segmented into distinct sub-tasks. The advent of Large Language Models (LLMs) heralds a paradigm shift, suggesting the fea…

Event ExtractionLanguage ModelingLanguage ModellingLarge Language Model+8

An Experimental Evaluation of Japanese Tokenizers for Sentiment-Based Text Classification

2024-12-23 · Andre Rusli, Makoto Shishido

This study investigates the performance of three popular tokenization tools: MeCab, Sudachi, and SentencePiece, when applied as a preprocessing step for sentiment-based text classification of Japanese texts. Using Term F…

regressiontext-classificationText Classification

Predicting Japanese scrambling in the wild

2017-04-01 · WS 2017 4 · Naho Orita

Japanese speakers have a choice between canonical SOV and scrambled OSV word order to express the same meaning. Although previous experiments examine the influence of one or two factors for scrambling in a controlled set…

regressionSentence