paper-with-me

Papers

Interactive Text Generation

2023-03-02 · Felix Faltings, Michel Galley, Baolin Peng, Kianté Brantley, Weixin Cai, Yizhe Zhang, Jianfeng Gao, Bill Dolan

Users interact with text, image, code, or other editors on a daily basis. However, machine learning models are rarely trained in the settings that reflect the interactivity between users and their editor. This is understandable as training AI models with real users is not only slow and costly, but what these models learn may be specific to user interface design choices. Unfortunately, this means most of the research on text, code, and image generation has focused on non-interactive settings, whereby the model is expected to get everything right without accounting for any input from a user who may be willing to help. We introduce a new Interactive Text Generation task that allows training generation models interactively without the costs of involving real users, by using user simulators that provide edits that guide the model towards a given target text. We train our interactive models using Imitation Learning, and our experiments against competitive non-interactive generation models show that models trained interactively are superior to their non-interactive counterparts, even when all models are given the same budget of user inputs or edits.

📄 PDF Abstract BibTeX arXiv:2303.00908

Code (0)

등록된 구현이 없습니다.

Tasks

Image GenerationImitation LearningText Generation

Similar Papers 제목 키워드 기반

Yan: Foundational Interactive Video Generation

2025-08-12 · Deheng Ye, Fangyun Zhou, Jiacheng Lv, Jianqi Ma 외 arxiv

We present Yan, a foundational framework for interactive video generation, covering the entire pipeline from simulation and generation to editing. Specifically, Yan comprises three core modules. AAA-level Simulation: We …

Video Generation

LLM Attributor: Interactive Visual Attribution for LLM Generation

2024-04-01 · Seongmin Lee, Zijie J. Wang, Aishwarya Chakravarthy, Alec Helbling 외

While large language models (LLMs) have shown remarkable capability to generate convincing text across diverse domains, concerns around its potential risks have highlighted the importance of understanding the rationale b…

ArticlesAttributeText Generation

RoboSVG: A Unified Framework for Interactive SVG Generation with Multi-modal Guidance

2025-10-26 · Jiuniu Wang, Gongjie Zhang, Quanhao Qian, Junlong Gao 외 arxiv

Scalable Vector Graphics (SVGs) are fundamental to digital design and robot control, encoding not only visual structure but also motion paths in interactive drawings. In this work, we introduce RoboSVG, a unified multimo…

InteractiveVideo: User-Centric Controllable Video Generation with Synergistic Multimodal Instructions

2024-02-05 · Yiyuan Zhang, Yuhao Kang, Zhixin Zhang, Xiaohan Ding 외

We introduce $\textit{InteractiveVideo}$, a user-centric framework for video generation. Different from traditional generative approaches that operate based on user-provided images or text, our framework is designed for …

Video Generation

StableWorld: Towards Stable and Consistent Long Interactive Video Generation

2026-01-21 · Ying Yang, Zhengyao Lv, Tianlin Pan, Haofan Wang 외 arxiv

In this paper, we explore the overlooked challenge of stability and temporal consistency in interactive video generation, which synthesizes dynamic and controllable video worlds through interactive behaviors such as came…

Video Generation