paper-with-me

홈 › Papers

Topic-to-essay generation with knowledge-based content selection

2024-02-26 · Jieyong Wang, Chunyao Song, Yihao Wu

The topic-to-essay generation task is a challenging natural language generation task that aims to generate paragraph-level text with high semantic coherence based on a given set of topic words. Previous work has focused on the introduction of external knowledge, ignoring the insufficient generated text diversity. In order to improve the generation diversity, we propose a novel copy mechanism model with a content selection module that integrates rich semantic knowledge from the language model into the decoder. Furthermore, we introduce the improved prefix tuning method to train the model, enabling it to adapt to varying input complexities. In addition, we have contributed a new Chinese dataset for TEG tasks. Experimental results demonstrate that the proposed model can improve the generated text diversity by 35\% to 59\% compared to the state-of-the-art method, while maintaining a high level of topic consistency.

📄 PDF Abstract BibTeX arXiv:2402.16248

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderDiversityLanguage ModelingLanguage ModellingText Generation

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Topic-to-Essay Generation with Comprehensive Knowledge Enhancement

2021-06-29 · Zhiyue Liu, Jiahai Wang, Zhenghong Li

Generating high-quality and diverse essays with a set of topics is a challenging task in natural language generation. Since several given topics only provide limited source information, utilizing various topic-related kn…

Text Generation

Enhancing Topic-to-Essay Generation with External Commonsense Knowledge

2019-07-01 · ACL 2019 7 · Pengcheng Yang, Lei LI, Fuli Luo, Tianyu Liu 외

Automatic topic-to-essay generation is a challenging task since it requires generating novel, diverse, and topic-consistent paragraph-level text with a set of topics as input. Previous work tends to perform essay generat…

Concept-To-Text Generation

A Sentiment-Controllable Topic-to-Essay Generator with Topic Knowledge Graph

2020-10-12 · Findings of the Association for Computational Linguistics 2020 · Lin Qiao, Jianhao Yan, Fandong Meng, Zhendong Yang 외

Generating a vivid, novel, and diverse essay with only several given topic words is a challenging task of natural language generation. In previous work, there are two problems left unsolved: neglect of sentiment beneath …

DecoderDiversitySentenceText Generation

TegFormer: Topic-to-Essay Generation with Good Topic Coverage and High Text Coherence

2022-12-27 · Wang Qi, Rui Liu, Yuan Zuo, Yong Chen 외

Creating an essay based on a few given topics is a challenging NLP task. Although several effective methods for this problem, topic-to-essay generation, have appeared recently, there is still much room for improvement, e…

DecoderLanguage ModellingText GenerationTopic coverage+1

Can Large Language Models Differentiate Harmful from Argumentative Essays? Steps Toward Ethical Essay Scoring

2026-01-09 · Hongjin Kim, Jeonghyun Kang, Harksoo Kim arxiv

This study addresses critical gaps in Automated Essay Scoring (AES) systems and Large Language Models (LLMs) with regard to their ability to effectively identify and score harmful essays. Despite advancements in AES tech…

Automated Essay Scoring