A System for Automated Image Editing from Natural Language Commands

2018-12-03 · Jacqueline Brixey, Ramesh Manuvinakurike, Nham Le, Tuan Lai, Walter Chang, Trung Bui

This work presents the task of modifying images in an image editing program using natural language written commands. We utilize a corpus of over 6000 image edit text requests to alter real world images collected via crowdsourcing. A novel framework composed of actions and entities to map a user's natural language request to executable commands in an image editing program is described. We resolve previously labeled annotator disagreement through a voting process and complete annotation of the corpus. We experimented with different machine learning models and found that the LSTM, the SVM, and the bidirectional LSTM-CRF joint models are the best to detect image editing actions and associated entities in a given utterance.

📄 PDF Abstract BibTeX arXiv:1812.01083

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음

Tanh Activation 설명 없음

SVM A Support Vector Machine, or SVM, is a non-parametric supervised learning model. For non-linear classification and regression, they utilise the kernel trick to map inputs…

LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…

AnyEdit: Mastering Unified High-Quality Image Editing for Any Idea

2024-11-24 · CVPR 2025 1 · Qifan Yu, Wei Chow, Zhongqi Yue, Kaihang Pan 외

Instruction-based image editing aims to modify specific image elements with natural language instructions. However, current models in this domain often struggle to accurately execute complex user instructions, as they ar…

Diversity

EditGarment: An Instruction-Based Garment Editing Dataset Constructed with Automated MLLM Synthesis and Semantic-Aware Evaluation

2025-08-05 · Deqiang Yin, Junyi Guo, Huanda Lu, Fangyu Wu 외 arxiv

Instruction-based garment editing enables precise image modifications via natural language, with broad applications in fashion design and customization. Unlike general editing tasks, it requires understanding garment-spe…

EditDuet: A Multi-Agent System for Video Non-Linear Editing

2025-09-13 · Marcelo Sandoval-Castaneda, Bryan Russell, Josef Sivic, Gregory Shakhnarovich 외 arxiv

Automated tools for video editing and assembly have applications ranging from filmmaking and advertisement to content creation for social media. Previous video editing work has mainly focused on either retrieval or user …

Decision Making

Neural Twins Talk & Alternative Calculations

2021-08-05 · Zanyar Zohourianshahzadi, Jugal K. Kalita

Inspired by how the human brain employs a higher number of neural pathways when describing a highly focused subject, we show that deep attentive models used for the main vision-language task of image captioning, could be…

Descriptive Image Captioning

VDE Bench: Evaluating The Capability of Image Editing Models to Modify Visual Documents

2026-01-27 · Hongzhu Yi, Yujia Yang, Yuanxiang Wang, Tong Li 외 arxiv

In recent years, image editing models have made significant progress, enabling users to manipulate visual content in a flexible and interactive manner through natural language instructions. However, an important yet unde…

Image Editing