Zero-shot topic generation
We present an approach to generating topics using a model trained only for document title generation, with zero examples of topics given during training. We leverage features that capture the relevance of a candidate span in a document for the generation of a title for that document. The output is a weighted collection of the phrases that are most relevant for describing the document and distinguishing it within a corpus, without requiring access to the rest of the corpus. We conducted a double-blind trial in which human annotators scored the quality of our machine-generated topics along with original human-written topics associated with news articles from The Guardian and The Huffington Post. The results show that our zero-shot model generates topic labels for news documents that are on average equal to or higher quality than those written by humans, as judged by humans.
Code (0)
등록된 구현이 없습니다.
Tasks
ArticlesSimilar Papers 제목 키워드 기반
Assaying on the Robustness of Zero-Shot Machine-Generated Text Detectors
To combat the potential misuse of Natural Language Generation (NLG) technology, a variety of algorithms have been developed for the detection of AI-generated texts. Traditionally, this task is treated as a binary classif…
Binary ClassificationText DetectionText GenerationAdversarial Learning for Zero-Shot Stance Detection on Social Media
Stance detection on social media can help to identify and understand slanted news or commentary in everyday life. In this work, we propose a new model for zero-shot stance detection on Twitter that uses adversarial learn…
Stance DetectionZero-Shot Stance DetectionZero-Shot Stance Detection using Contextual Data Generation with LLMs
Stance detection, the classification of attitudes expressed in a text towards a specific topic, is vital for applications like fake news detection and opinion mining. However, the scarcity of labeled data remains a chall…
Fake News DetectionFew-Shot LearningOpinion MiningStance Detection+1Zero-Shot Stance Detection: A Dataset and Model using Generalized Topic Representations
Stance detection is an important component of understanding hidden influences in everyday life. Since there are thousands of potential topics to take a stance on, most with little to no training data, we focus on zero-sh…
Stance DetectionZero-Shot Stance DetectionZYN: Zero-Shot Reward Models with Yes-No Questions for RLAIF
In this work, we address the problem of directing the text generation of a language model (LM) towards a desired behavior, aligning the generated text with the preferences of the human operator. We propose using another,…
AttributeDiversityLanguage ModelingLanguage Modelling+1