paper-with-me

홈 › Papers

Improving User Controlled Table-To-Text Generation Robustness

2023-02-20 · Hanxu Hu, Yunqing Liu, Zhongyi Yu, Laura Perez-Beltrachini

In this work we study user controlled table-to-text generation where users explore the content in a table by selecting cells and reading a natural language description thereof automatically produce by a natural language generator. Such generation models usually learn from carefully selected cell combinations (clean cell selections); however, in practice users may select unexpected, redundant, or incoherent cell combinations (noisy cell selections). In experiments, we find that models perform well on test sets coming from the same distribution as the train data but their performance drops when evaluated on realistic noisy user inputs. We propose a fine-tuning regime with additional user-simulated noisy cell selections. Models fine-tuned with the proposed regime gain 4.85 BLEU points on user noisy test cases and 1.4 on clean test cases; and achieve comparable state-of-the-art performance on the ToTTo dataset.

📄 PDF Abstract BibTeX arXiv:2302.09820

Code (1)

hanxuhu/controllt2trobust 공식 구현 pytorch

Tasks

Table-to-Text GenerationText Generation

Methods 이 논문이 사용한 방법론

Test 설명 없음

Similar Papers 제목 키워드 기반

TWT: Table with Written Text for Controlled Data-to-Text Generation

2021-11-01 · Findings (EMNLP) 2021 11 · Tongliang Li, Lei Fang, Jian-Guang Lou, Zhoujun Li

Large pre-trained neural models have recently shown remarkable progress in text generation. In this paper, we propose to generate text conditioned on the structured data (table) and a prefix (the written text) by leverag…

Data-to-Text GenerationText Generation

NARRA-Gym for Evaluating Interactive Narrative Agents

2026-05-08 · Yue Huang, Yuchen Ma, Jiayi Ye, Wenjie Wang 외 arxiv

Interactive narrative tasks require LLMs to sustain a coherent, evolving story while adapting to a user over multiple turns. However, suitable benchmarks for this setting are limited: existing evaluations often focus on …

Story Generation

GenNI: Human-AI Collaboration for Data-Backed Text Generation

2021-10-19 · Hendrik Strobelt, Jambay Kinley, Robert Krueger, Johanna Beyer 외

Table2Text systems generate textual output based on structured data utilizing machine learning. These systems are essential for fluent natural language interfaces in tools such as virtual assistants; however, left to gen…

DescriptiveText Generation

Evaluating Semantic Fragility in Text-to-Audio Generation Systems Under Controlled Prompt Perturbations

2026-03-14 · Jiahui Wu arxiv

Recent advances in text-to-audio generation enable models to translate natural-language descriptions into diverse musical output. However, the robustness of these systems under semantically equivalent prompt variations r…

Semantic SimilarityAudio Generation

BREPS: Bounding-Box Robustness Evaluation of Promptable Segmentation

2026-01-21 · Andrey Moskalenko, Danil Kuznetsov, Irina Dudko, Anastasiia Iasakova 외 arxiv

Promptable segmentation models such as SAM have established a powerful paradigm, enabling strong generalization to unseen objects and domains with minimal user input, including points, bounding boxes, and text prompts. A…