paper-with-me

Papers

Introducing Aspects of Creativity in Automatic Poetry Generation

2020-02-06 · ICON 2019 12 · Brendan Bena, Jugal Kalita

Poetry Generation involves teaching systems to automatically generate text that resembles poetic work. A deep learning system can learn to generate poetry on its own by training on a corpus of poems and modeling the particular style of language. In this paper, we propose taking an approach that fine-tunes GPT-2, a pre-trained language model, to our downstream task of poetry generation. We extend prior work on poetry generation by introducing creative elements. Specifically, we generate poems that express emotion and elicit the same in readers, and poems that use the language of dreams---called dream poetry. We are able to produce poems that correctly elicit the emotions of sadness and joy 87.5 and 85 percent, respectively, of the time. We produce dreamlike poetry by training on a corpus of texts that describe dreams. Poems from this model are shown to capture elements of dream poetry with scores of no less than 3.2 on the Likert scale. We perform crowdsourced human-evaluation for all our poems. We also make use of the Coh-Metrix tool, outlining metrics we use to gauge the quality of text generated.

📄 PDF Abstract BibTeX arXiv:2002.02511

Code (1)

BrendanBena/poetry-gen 공식 구현

Tasks

Language ModelingLanguage Modelling

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…
Weight Decay 설명 없음
Residual Connection 설명 없음
Adam 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

Generating Modern Poetry Automatically in Finnish

2019-11-01 · IJCNLP 2019 11 · Mika H{\"a}m{\"a}l{\"a}inen, Khalid Alnajjar

We present a novel approach for generating poetry automatically for the morphologically rich Finnish language by using a genetic algorithm. The approach improves the state of the art of the previous Finnish poem generato…

Harnessing NLG to create Finnish poetry automatically

2018-06-01 · Mika Hämäläinen

This paper presents a new, NLG based approach to poetry generation in Finnish for use as a part of a bigger Poem Machine system the objective of which is to provide a platform for human computer co-creativity. The approa…

Let's FACE it. Finnish Poetry Generation with Aesthetics and Framing

2019-10-30 · WS 2019 10 · Mika Hämäläinen, Khalid Alnajjar

We present a creative poem generator for the morphologically rich Finnish language. Our method falls into the master-apprentice paradigm, where a computationally creative genetic algorithm teaches a BRNN model to generat…

DeepCreativity: Measuring Creativity with Deep Learning Techniques

2022-01-16 · Giorgio Franceschelli, Mirco Musolesi

Measuring machine creativity is one of the most fascinating challenges in Artificial Intelligence. This paper explores the possibility of using generative learning techniques for automatic assessment of creativity. The p…

Deep Learning

Chinese Poetry Generation with a Working Memory Model

2018-09-12 · Xiaoyuan Yi, Maosong Sun, Ruoyu Li, Zonghan Yang

As an exquisite and concise literary form, poetry is a gem of human culture. Automatic poetry generation is an essential step towards computer creativity. In recent years, several neural models have been designed for thi…

Cultural Vocal Bursts Intensity Predictionmodel