paper-with-me

Papers

Adapting a Language Model for Controlled Affective Text Generation

2020-11-08 · COLING 2020 8 · Ishika Singh, Ahsan Barkati, Tushar Goswamy, Ashutosh Modi

Human use language not just to convey information but also to express their inner feelings and mental states. In this work, we adapt the state-of-the-art language generation models to generate affective (emotional) text. We posit a model capable of generating affect-driven and topic-focused sentences without losing grammatical correctness as the affect intensity increases. We propose to incorporate emotion as prior for the probabilistic state-of-the-art text generation model such as GPT-2. The model gives a user the flexibility to control the category and intensity of emotion as well as the topic of the generated text. Previous attempts at modelling fine-grained emotions fall out on grammatical correctness at extreme intensities, but our model is resilient to this and delivers robust results at all intensities. We conduct automated evaluations and human studies to test the performance of our model and provide a detailed comparison of the results with other models. In all evaluations, our model outperforms existing affective text generation models.

📄 PDF Abstract BibTeX arXiv:2011.04000

Code (1)

ishikasingh/Affective-text-gen 공식 구현 pytorch

Tasks

Language ModelingLanguage ModellingText Generation

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Adam 설명 없음
Attention 설명 없음
Weight Decay 설명 없음
Linear Warmup With Cosine Annealing Linear Warmup With Cosine Annealing is a learning rate schedule where we increase the learning rate linearly for $n$ updates and then anneal according to a cosine schedule…
Discriminative Fine-Tuning Discriminative Fine-Tuning is a fine-tuning strategy that is used for ULMFiT type models. Instead of using the same learning rate…

Similar Papers 제목 키워드 기반

Feelings from the Past---Adapting Affective Lexicons for Historical Emotion Analysis

2016-12-01 · WS 2016 12 · Sven Buechel, Johannes Hellrich, Udo Hahn

We here describe a novel methodology for measuring affective language in historical text by expanding an affective lexicon and jointly adapting it to prior language stages. We automatically construct a lexicon for word-e…

Emotion RecognitionWord Embeddings

Steering Emotional Dynamics for Art Therapy: Controllable Narrative Script Generation through Hierarchically Guided LLM Agents

2026-06-15 · Suqing Wang, Qinghai Miao, Chao Guo, Yisheng Lv arxiv

Art therapy plays a vital role in emotional healing, in which narrative creation acts as the primary vehicle for emotional expression. Given the inherently dynamic nature of emotions during healing, narratives with finel…

Trajectory PlanningScene Generation

Opening the Black Box: Preliminary Insights into Affective Modeling in Multimodal Foundation Models

2026-01-22 · Zhen Zhang, Runhao Zeng, Sicheng Zhao, Xiping Hu arxiv

Understanding where and how emotions are represented in large-scale foundation models remains an open problem, particularly in multimodal affective settings. Despite the strong empirical performance of recent affective m…

Exemplar-Controllable Paraphrasing and Translation using Bitext

2020-10-12 · Mingda Chen, Sam Wiseman, Kevin Gimpel

Most prior work on exemplar-based syntactically controlled paraphrase generation relies on automatically-constructed large-scale paraphrase datasets, which are costly to create. We sidestep this prerequisite by adapting …

Machine TranslationParaphrase GenerationTranslation

AffectON: Incorporating Affect Into Dialog Generation

2020-12-12 · Zana Bucinca, Yucel Yemez, Engin Erzin, Metin Sezgin

Due to its expressivity, natural language is paramount for explicit and implicit affective state communication among humans. The same linguistic inquiry (e.g., How are you?) might induce responses with different affects …

Language ModelingLanguage ModellingResponse GenerationText Generation