paper-with-me

Papers

InstructionNER: A Multi-Task Instruction-Based Generative Framework for Few-shot NER

2022-03-08 · LiWen Wang, Rumei Li, Yang Yan, Yuanmeng Yan, Sirui Wang, Wei Wu, Weiran Xu

Recently, prompt-based methods have achieved significant performance in few-shot learning scenarios by bridging the gap between language model pre-training and fine-tuning for downstream tasks. However, existing prompt templates are mostly designed for sentence-level tasks and are inappropriate for sequence labeling objectives. To address the above issue, we propose a multi-task instruction-based generative framework, named InstructionNER, for low-resource named entity recognition. Specifically, we reformulate the NER task as a generation problem, which enriches source sentences with task-specific instructions and answer options, then inferences the entities and types in natural language. We further propose two auxiliary tasks, including entity extraction and entity typing, which enable the model to capture more boundary information of entities and deepen the understanding of entity type semantics, respectively. Experimental results show that our method consistently outperforms other baselines on five datasets in few-shot settings.

📄 PDF Abstract BibTeX arXiv:2203.03903

Code (1)

ovbystrova/InstructionNER pytorch

Tasks

Entity TypingFew-Shot LearningFew-shot NERLanguage ModelingLanguage ModellingLow Resource Named Entity RecognitionNamed Entity RecognitionNamed Entity Recognition (NER)Sentence

Similar Papers 제목 키워드 기반

ShapeGPT: 3D Shape Generation with A Unified Multi-modal Language Model

2023-11-29 · Fukun Yin, Xin Chen, Chi Zhang, Biao Jiang 외

The advent of large language models, enabling flexibility through instruction-driven approaches, has revolutionized many traditional generative tasks, but large models for 3D data, particularly in comprehensively handlin…

3D Shape GenerationLanguage ModelingLanguage ModellingSentence

Cookbook: A framework for improving LLM generative abilities via programmatic data generating templates

2024-10-07 · Avanika Narayan, Mayee F. Chen, Kush Bhatia, Christopher Ré

Fine-tuning large language models (LLMs) on instruction datasets is a common way to improve their generative capabilities. However, instruction datasets can be expensive and time-consuming to manually curate, and while L…

InteractiveVideo: User-Centric Controllable Video Generation with Synergistic Multimodal Instructions

2024-02-05 · Yiyuan Zhang, Yuhao Kang, Zhixin Zhang, Xiaohan Ding 외

We introduce $\textit{InteractiveVideo}$, a user-centric framework for video generation. Different from traditional generative approaches that operate based on user-provided images or text, our framework is designed for …

Video Generation

Generative Visual Instruction Tuning

2024-06-17 · Jefferson Hernandez, Ruben Villegas, Vicente Ordonez

We propose to use automatically generated instruction-following data to improve the zero-shot capabilities of a large multimodal model with additional support for generative and image editing tasks. We achieve this by cu…

Image GenerationImage-text matchingInstruction FollowingLanguage Modeling+4

A Multimodal Classifier Generative Adversarial Network for Carry and Place Tasks from Ambiguous Language Instructions

2018-06-11 · Aly Magassouba, Komei Sugiura, Hisashi Kawai

This paper focuses on a multimodal language understanding method for carry-and-place tasks with domestic service robots. We address the case of ambiguous instructions, that is, when the target area is not specified. For …

Generative Adversarial Network