paper-with-me

Papers

Neural Language Generation: Formulation, Methods, and Evaluation

2020-07-31 · Cristina Garbacea, Qiaozhu Mei

Recent advances in neural network-based generative modeling have reignited the hopes in having computer systems capable of seamlessly conversing with humans and able to understand natural language. Neural architectures have been employed to generate text excerpts to various degrees of success, in a multitude of contexts and tasks that fulfil various user needs. Notably, high capacity deep learning models trained on large scale datasets demonstrate unparalleled abilities to learn patterns in the data even in the lack of explicit supervision signals, opening up a plethora of new possibilities regarding producing realistic and coherent texts. While the field of natural language generation is evolving rapidly, there are still many open challenges to address. In this survey we formally define and categorize the problem of natural language generation. We review particular application tasks that are instantiations of these general formulations, in which generating natural language is of practical importance. Next we include a comprehensive outline of methods and neural architectures employed for generating diverse texts. Nevertheless, there is no standard way to assess the quality of text produced by these generative models, which constitutes a serious bottleneck towards the progress of the field. To this end, we also review current approaches to evaluating natural language generation systems. We hope this survey will provide an informative overview of formulations, methods, and assessments of neural natural language generation.

📄 PDF Abstract BibTeX arXiv:2007.15780

Code (0)

등록된 구현이 없습니다.

Tasks

SurveyText Generation

Similar Papers 제목 키워드 기반

Defining and Evaluating Fair Natural Language Generation

2020-07-28 · WS 2020 7 · Catherine Yeo, Alyssa Chen

Our work focuses on the biases that emerge in the natural language generation (NLG) task of sentence completion. In this paper, we introduce a framework of fairness for NLG followed by an evaluation of gender biases in t…

FairnessSentenceSentence CompletionText Generation

A Continuous-Time Markov Chain Framework for Insertion Language Models

2026-06-08 · Dhruvesh Patel, Benjamin Rozonoyer, Soumitra Das, Tahira Naseem 외 arxiv

Insertion Language Models (ILMs) offer several advantages over left-to-right generation and mask-based generation. However, existing formulations of insertion-based generation have largely been ad-hoc. In this paper, we …

Investigating the use of Paraphrase Generation for Question Reformulation in the FRANK QA system

2022-06-06 · Nick Ferguson, Liane Guillou, Kwabena Nuamah, Alan Bundy

We present a study into the ability of paraphrase generation methods to increase the variety of natural language questions that the FRANK Question Answering system can answer. We first evaluate paraphrase generation meth…

Paraphrase GenerationQuestion Answering

Solver-Verified Formulation Generation and Selection for Multi-Warehouse Inventory Allocation Using Large Language Models

2026-06-28 · Jintao Xu, Yingzheng Ma, Jiong Dong, Yongzhi Qi 외 arxiv

Balance-oriented multi-warehouse inventory allocation is a recurring decision problem in large-scale e-commerce supply chains, in which a fixed replenishment quantity is distributed across warehouses to balance post-allo…

ProtocoLLM: Automatic Evaluation Framework of LLMs on Domain-Specific Scientific Protocol Formulation Tasks

2024-10-06 · Seungjun Yi, Jaeyoung Lim, Juyong Yoon

Automated generation of scientific protocols executable by robots can significantly accelerate scientific research processes. Large Language Models (LLMs) excel at Scientific Protocol Formulation Tasks (SPFT), but the ev…