Generating News Headlines with Recurrent Neural Networks
We describe an application of an encoder-decoder recurrent neural network with LSTM units and attention to generating headlines from the text of news articles. We find that the model is quite effective at concisely paraphrasing news articles. Furthermore, we study how the neural network decides which input words to pay attention to, and specifically we identify the function of the different neurons in a simplified attention mechanism. Interestingly, our simplified attention mechanism performs better that the more complex attention mechanism on a held out set of articles.
Code (4)
Tasks
ArticlesDecoderMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Do small language models generate realistic variable-quality fake news headlines?
Small language models (SLMs) have the capability for text generation and may potentially be used to generate falsified texts online. This study evaluates 14 SLMs (1.7B-14B parameters) including LLaMA, Gemma, Phi, SmolLM,…
Prompt EngineeringText GenerationBaitWatcher: A lightweight web interface for the detection of incongruent news headlines
In digital environments where substantial amounts of information are shared online, news headlines play essential roles in the selection and diffusion of news articles. Some news articles attract audience attention by sh…
AI AgentArticlesMisinformationStock Movement Prediction with Financial News using Contextualized Embedding from BERT
News events can greatly influence equity markets. In this paper, we are interested in predicting the short-term movement of stock prices after financial news events using only the headlines of the news. To achieve this g…
Enhancing Emotion Prediction in News Headlines: Insights from ChatGPT and Seq2Seq Models for Free-Text Generation
Predicting emotions elicited by news headlines can be challenging as the task is largely influenced by the varying nature of people's interpretations and backgrounds. Previous works have explored classifying discrete emo…
ClassificationEmotion ClassificationExplanation GenerationLanguage Modelling+2Diverse, Controllable, and Keyphrase-Aware: A Corpus and Method for News Multi-Headline Generation
News headline generation aims to produce a short sentence to attract readers to read the news. One news article often contains multiple keyphrases that are of interest to different users, which can naturally have multipl…
DecoderDiversityHeadline GenerationSentence