paper-with-me

홈 › Papers

CoEdIT: Text Editing by Task-Specific Instruction Tuning

2023-05-17 · Vipul Raheja, Dhruv Kumar, Ryan Koo, Dongyeop Kang

We introduce CoEdIT, a state-of-the-art text editing system for writing assistance. CoEdIT takes instructions from the user specifying the attributes of the desired text, such as "Make the sentence simpler" or "Write it in a more neutral style," and outputs the edited text. We present a large language model fine-tuned on a diverse collection of task-specific instructions for text editing (a total of 82K instructions). Our model (1) achieves state-of-the-art performance on various text editing benchmarks, (2) is competitive with publicly available largest-sized LLMs trained on instructions while being nearly 60x smaller, (3) is capable of generalizing to unseen edit instructions, and (4) exhibits abilities to generalize to composite instructions containing different combinations of edit actions. Through extensive qualitative and quantitative analysis, we show that writers prefer the edits suggested by CoEdIT relative to other state-of-the-art text editing models. Our code, data, and models are publicly available at https://github.com/vipulraheja/coedit.

📄 PDF Abstract BibTeX arXiv:2305.09857

Code (1)

vipulraheja/coedit 공식 구현

Tasks

Formality Style TransferGrammatical Error CorrectionLanguage ModelingLarge Language ModelParaphrase GenerationSentenceSentence FusionText Simplification

Methods 이 논문이 사용한 방법론

Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
15 Ways to Contact How can i speak to someone at Delta Airlines 설명 없음
{Dispute@FaQ-s}How to file a dispute with Expedia? How to file a dispute with Expedia? To file a complaint against Expedia, first try contacting their customer service directly. You can reach them by phone at…
Weight Decay 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

CoEditor++: Instruction-based Visual Editing via Cognitive Reasoning

2026-01-31 · Minheng Ni, Yutao Fan, Zhengyuan Yang, Yeli Shen 외 arxiv

Recent advances in large multimodal models (LMMs) have enabled instruction-based image editing, allowing users to modify visual content via natural language descriptions. However, existing approaches often struggle with …

Instruction FollowingImage Editing

Spivavtor: An Instruction Tuned Ukrainian Text Editing Model

2024-04-29 · Aman Saini, Artem Chernodub, Vipul Raheja, Vivek Kulkarni

We introduce Spivavtor, a dataset, and instruction-tuned models for text editing focused on the Ukrainian language. Spivavtor is the Ukrainian-focused adaptation of the English-only CoEdIT model. Similar to CoEdIT, Spiva…

Grammatical Error CorrectionmodelText Simplification

CoCoEdit: Content-Consistent Image Editing via Region Regularized Reinforcement Learning

2026-02-15 · Yuhui Wu, Chenxi Xie, Ruibin Li, Liyi Chen 외 arxiv

Image editing has achieved impressive results with the development of large-scale generative models. However, existing models mainly focus on the editing effects of intended objects and regions, often leading to unwanted…

Reinforcement LearningImage Editing

mEdIT: Multilingual Text Editing via Instruction Tuning

2024-02-26 · Vipul Raheja, Dimitris Alikaniotis, Vivek Kulkarni, Bashar Alhafni 외

We introduce mEdIT, a multi-lingual extension to CoEdIT -- the recent state-of-the-art text editing models for writing assistance. mEdIT models are trained by fine-tuning multi-lingual large, pre-trained language models …

Grammatical Error CorrectionText Simplification

Coeditor: Leveraging Contextual Changes for Multi-round Code Auto-editing

2023-05-29 · Jiayi Wei, Greg Durrett, Isil Dillig

Developers often dedicate significant time to maintaining and refactoring existing code. However, most prior work on generative models for code focuses solely on creating new code, overlooking the distinctive needs of ed…

Code CompletionEDIT TaskLanguage Modelling