paper-with-me

홈 › Papers

Improving Logical-Level Natural Language Generation with Topic-Conditioned Data Augmentation and Logical Form Generation

2021-12-12 · Ao Liu, Congjian Luo, Naoaki Okazaki

Logical Natural Language Generation, i.e., generating textual descriptions that can be logically entailed by a structured table, has been a challenge due to the low fidelity of the generation. \citet{chen2020logic2text} have addressed this problem by annotating interim logical programs to control the generation contents and semantics, and presented the task of table-aware logical form to text (Logic2text) generation. However, although table instances are abundant in the real world, logical forms paired with textual descriptions require costly human annotation work, which limits the performance of neural models. To mitigate this, we propose topic-conditioned data augmentation (TopicDA), which utilizes GPT-2 to generate unpaired logical forms and textual descriptions directly from tables. We further introduce logical form generation (LG), a dual task of Logic2text that requires generating a valid logical form based on a text description of a table. We also propose a semi-supervised learning approach to jointly train a Logic2text and an LG model with both labeled and augmented data. The two models benefit from each other by providing extra supervision signals through back-translation. Experimental results on the Logic2text dataset and the LG task demonstrate that our approach can effectively utilize the augmented data and outperform supervised baselines by a substantial margin.

📄 PDF Abstract BibTeX arXiv:2112.06240

Code (0)

등록된 구현이 없습니다.

Tasks

Data AugmentationFormText Generationvalid

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Adam 설명 없음
Multi-Head Attention 설명 없음
Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…
Residual Connection 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…

Similar Papers 제목 키워드 기반

NGTM: Substructure-based Neural Graph Topic Model for Interpretable Graph Generation

2025-07-17 · Yuanxin Zhuang, Dazhong Shen, Ying Sun

Graph generation plays a pivotal role across numerous domains, including molecular design and knowledge graph construction. Although existing methods achieve considerable success in generating realistic graphs, their int…

graph constructionGraph Generation

Generating Pertinent and Diversified Comments with Topic-aware Pointer-Generator Networks

2020-05-09 · Junheng Huang, Lu Pan, Kang Xu, Weihua Peng 외

Comment generation, a new and challenging task in Natural Language Generation (NLG), attracts a lot of attention in recent years. However, comments generated by previous work tend to lack pertinence and diversity. In thi…

ArticlesComment GenerationDiversityText Generation

Topic-to-essay generation with knowledge-based content selection

2024-02-26 · Jieyong Wang, Chunyao Song, Yihao Wu

The topic-to-essay generation task is a challenging natural language generation task that aims to generate paragraph-level text with high semantic coherence based on a given set of topic words. Previous work has focused …

DecoderDiversityLanguage ModelingLanguage Modelling+1

PILOT: Steering Synthetic Data Generation with Psychological & Linguistic Output Targeting

2025-09-18 · Caitlin Cisar, Emily Sheffield, Joshua Drake, Alden Harrell 외 arxiv

Generative AI applications commonly leverage user personas as a steering mechanism for synthetic data generation, but reliance on natural language representations forces models to make unintended inferences about which a…

Synthetic Data Generation

ETC-NLG: End-to-end Topic-Conditioned Natural Language Generation

2020-08-25 · Ginevra Carbone, Gabriele Sarti

Plug-and-play language models (PPLMs) enable topic-conditioned natural language generation by pairing large pre-trained generators with attribute models used to steer the predicted token distribution towards the selected…

AttributeComputational EfficiencyConditional Text GenerationText Generation+1