InFillmore: Frame-Guided Language Generation with Bidirectional Context
We propose a structured extension to bidirectional-context conditional language generation, or "infilling," inspired by Frame Semantic theory (Fillmore, 1976). Guidance is provided through two approaches: (1) model fine-tuning, conditioning directly on observed symbolic frames, and (2) a novel extension to disjunctive lexically constrained decoding that leverages frame semantic lexical units. Automatic and human evaluations confirm that frame-guided generation allows for explicit manipulation of intended infill semantics, with minimal loss in distinguishability from human-generated text. Our methods flexibly apply to a variety of use scenarios, and we provide a codebase and interactive demo available from https://nlp.jhu.edu/demos/infillmore.
Code (0)
등록된 구현이 없습니다.
Tasks
Text GenerationText InfillingSimilar Papers 제목 키워드 기반
Linguistic Query-Guided Mask Generation for Referring Image Segmentation
Referring image segmentation aims to segment the image region of interest according to the given language expression, which is a typical multi-modal task. Existing methods either adopt the pixel classification-based or t…
Contrastive Learningcross-modal alignmentDecoderImage Segmentation+2TraceVision: Trajectory-Aware Vision-Language Model for Human-Like Spatial Understanding
Recent Large Vision-Language Models (LVLMs) demonstrate remarkable capabilities in image understanding and natural language generation. However, current approaches focus predominantly on global image understanding, strug…
Trajectory PredictionScene UnderstandingLogical ReasoningERNIE-ViLG: Unified Generative Pre-training for Bidirectional Vision-Language Generation
Conventional methods for the image-text generation tasks mainly tackle the naturally bidirectional generation tasks separately, focusing on designing task-specific frameworks to improve the quality and fidelity of the ge…
Image CaptioningImage GenerationImage to textQuantization+3RoboForge: Physically Optimized Text-guided Whole-Body Locomotion for Humanoids
While generative models have become effective at producing human-like motions from text, transferring these motions to humanoid robots for physical execution remains challenging. Existing pipelines are often limited by r…
ARKD: Adaptive Reinforcement Learning-Guided Bidirectional KL Divergence Distillation for Text Generation
Knowledge distillation (KD) is a key technique for compressing Large Language Models (LLMs), yet methods relying on a single KL objective often fail to balance primary distribution fitting with long-tail probability mode…
Reinforcement LearningKnowledge DistillationText Generation