paper-with-me

Papers

Less is More: Data-Efficient Adaptation for Controllable Text-to-Video Generation

2025-11-21 · Shihan Cheng, Nilesh Kulkarni, David Hyde, Dmitriy Smirnov arxiv

Fine-tuning large-scale text-to-video diffusion models to add new generative controls, such as those over physical camera parameters (e.g., shutter speed or aperture), typically requires vast, high-fidelity datasets that are difficult to acquire. In this work, we propose a data-efficient fine-tuning strategy that learns these controls from sparse, low-quality synthetic data. We show that not only does fine-tuning on such simple data enable the desired controls, it actually yields superior results to models fine-tuned on photorealistic "real" data. Beyond demonstrating these results, we provide a framework that justifies this phenomenon both intuitively and quantitatively.

📄 PDF Abstract BibTeX arXiv:2511.17844

Code (0)

등록된 구현이 없습니다.

Tasks

Text-to-Video Generation

Similar Papers 제목 키워드 기반

ECoSim: Data Efficient Fine-Tuning for Controllable Traffic Simulation

2026-07-01 · Yu-Hsiang Chen, Wei-Jer Chang, Yi-Ting Chen, Masayoshi Tomizuka arxiv

Controllable traffic simulation is critical for testing autonomous driving systems, yet existing approaches often require retraining large generative models with extensive annotated data. We introduce a lightweight contr…

Autonomous Driving

Controllable Continual Test-Time Adaptation

2024-05-23 · Ziqi Shi, Fan Lyu, Ye Liu, Fanhua Shang 외

Continual Test-Time Adaptation (CTTA) is an emerging and challenging task where a model trained in a source domain must adapt to continuously changing conditions during testing, without access to the original source data…

Test-time Adaptation

Towards Attribute-Entangled Controllable Text Generation: A Pilot Study of Blessing Generation

2022-10-29 · Shulin Huang, Shirong Ma, Yinghui Li, Yangning Li 외

Controllable Text Generation (CTG) has obtained great success due to its fine-grained generation ability obtained by focusing on multiple attributes. However, most existing CTG researches overlook how to utilize the attr…

AttributeDiversityText Generation

Towards Lightweight, Adaptive and Attribute-Aware Multi-Aspect Controllable Text Generation with Large Language Models

2025-02-19 · Chenyu Zhu, Yefeng Liu, Chenyang Lyu, Xue Yang 외

Multi-aspect controllable text generation aims to control text generation in attributes from multiple aspects, making it a complex but powerful task in natural language processing. Supervised fine-tuning methods are ofte…

AttributeText Generation

TASU2: Controllable CTC Simulation for Alignment and Low-Resource Adaptation of Speech LLMs

2026-04-09 · Jing Peng, Chenghao Wang, Yi Yang, Lirong Qian 외 arxiv

Speech LLM post-training increasingly relies on efficient cross-modal alignment and robust low-resource adaptation, yet collecting large-scale audio-text pairs remains costly. Text-only alignment methods such as TASU red…