Generative Zero-Shot Prompt Learning for Cross-Domain Slot Filling with Inverse Prompting
Zero-shot cross-domain slot filling aims to transfer knowledge from the labeled source domain to the unlabeled target domain. Existing models either encode slot descriptions and examples or design handcrafted question templates using heuristic rules, suffering from poor generalization capability or robustness. In this paper, we propose a generative zero-shot prompt learning framework for cross-domain slot filling, both improving generalization and robustness than previous work. Besides, we introduce a novel inverse prompting strategy to distinguish different slot types to avoid the multiple prediction problem, and an efficient prompt-tuning strategy to boost higher performance by only training fewer prompt parameters. Experiments and analysis demonstrate the effectiveness of our proposed framework, especially huge improvements (+13.44% F1) on the unseen slots.
Code (1)
Tasks
Prompt Learningslot-fillingSlot FillingSimilar Papers 제목 키워드 기반
Zero-shot Generative Model Adaptation via Image-specific Prompt Learning
Recently, CLIP-guided image synthesis has shown appealing performance on adapting a pre-trained source-domain generator to an unseen target domain. It does not require any target-domain samples but only the textual domai…
DiversityImage GenerationPrompt LearningSlot Dependency Modeling for Zero-Shot Cross-Domain Dialogue State Tracking
Zero-shot learning for Dialogue State Tracking (DST) focuses on generalizing to an unseen domain without the expense of collecting in domain data. However, previous zero-shot DST methods ignore the slot dependencies in a…
Dialogue State TrackingZero-Shot LearningBIPro: Zero-shot Chinese Poem Generation via Block Inverse Prompting Constrained Generation Framework
Recently, generative pre-trained models have made significant strides, particularly highlighted by the release of ChatGPT and GPT-4, which exhibit superior cross-domain capabilities. However, these models still face chal…
Multimodal Prompt Retrieval for Generative Visual Question Answering
Recent years have witnessed impressive results of pre-trained vision-language models on knowledge-intensive tasks such as visual question answering (VQA). Despite the recent advances in VQA, existing methods mainly adopt…
Domain AdaptationGenerative Visual Question AnsweringQuestion AnsweringRetrieval+2Prompting Diffusion Models for Zero-Shot Instance Segmentation
Several disruptive research directions have recently emerged in computer vision, including foundation models achieving previously unseen zero-shot performance in scene understanding, even interactively, and generative mo…
Interactive SegmentationInstance SegmentationScene Understanding