paper-with-me

홈 › Papers

Syntax-Guided Diffusion Language Models with User-Integrated Personalization

2025-10-01 · Ruqian Zhang, Yijiao Zhang, Juan Shen, Zhongyi Zhu, Annie Qu arxiv

Large language models have made revolutionary progress in generating human-like text, yet their outputs often tend to be generic, exhibiting insufficient structural diversity, which limits personalized expression. Recent advances in diffusion models have opened new opportunities for improving language generation beyond the limitations of autoregressive paradigms. In this work, we propose a syntax-guided diffusion language model that integrates structural supervision and personalized conditioning to enhance text quality, diversity, and controllability. We introduce a cascaded framework that generates syntactic guidance before conditional text generation, and further generalize it to a novel noncascaded architecture for better alignment between structure and content. By incorporating syntactic information in the generating process, the proposed model better captures the lexical and structural characteristics of stylistic sentence construction. To enable fine-grained personalization, we develop a shared representation mechanism that facilitates information integration across users, supporting both faithful stylistic generation and generalizable zero-shot inference. Extensive experiments on multiple tasks demonstrate the superiority of our approach in fluency, diversity, and stylistic fidelity. Further qualitative analyses highlight its interpretability and flexibility in learning personalized patterns.

📄 PDF Abstract BibTeX arXiv:2510.01028

Code (0)

등록된 구현이 없습니다.

Tasks

Conditional Text Generation

Similar Papers 제목 키워드 기반

Structure Guided Large Language Model for SQL Generation

2024-02-19 · Qinggang Zhang, Hao Chen, Junnan Dong, Shengyuan Chen 외

Recent advancements in large language models (LLMs) have shown promise in bridging the gap between natural language queries and database management systems, enabling users to interact with databases without the backgroun…

Language ModelingLanguage ModellingLarge Language Modelmodel+3

Trace and Pace: Controllable Pedestrian Animation via Guided Trajectory Diffusion

2023-04-04 · CVPR 2023 1 · Davis Rempe, Zhengyi Luo, Xue Bin Peng, Ye Yuan 외

We introduce a method for generating realistic pedestrian trajectories and full-body animations that can be controlled to meet user-defined goals. We draw on recent advances in guided diffusion modeling to achieve test-t…

Collision Avoidance

TreeDiff: AST-Guided Code Generation with Diffusion LLMs

2025-08-02 · Yiming Zeng, Jinghan Cao, Zexin Li, Yiming Chen 외 arxiv

Code generation is increasingly critical for real-world applications. Still, diffusion-based large language models continue to struggle with this demand. Unlike free-form text, code requires syntactic precision; even min…

Code Generation

Syntax-guided Contrastive Learning for Pre-trained Language Model

2022-05-01 · Findings (ACL) 2022 5 · Shuai Zhang, Wang Lijie, Xinyan Xiao, Hua Wu

Syntactic information has been proved to be useful for transformer-based pre-trained language models. Previous studies often rely on additional syntax-guided attention components to enhance the transformer, which require…

Contrastive LearningGrammatical Error DetectionLanguage ModelingLanguage Modelling

Syntax-Aware Complex-Valued Neural Machine Translation

2023-07-17 · Yang Liu, Yuexian Hou

Syntax has been proven to be remarkably effective in neural machine translation (NMT). Previous models obtained syntax information from syntactic parsing tools and integrated it into NMT models to improve translation per…

DecoderMachine TranslationNMTTranslation