paper-with-me

Papers

Generative AI for automatic topic labelling

2024-08-13 · Diego Kozlowski, Carolina Pradier, Pierre Benz

Topic Modeling has become a prominent tool for the study of scientific fields, as they allow for a large scale interpretation of research trends. Nevertheless, the output of these models is structured as a list of keywords which requires a manual interpretation for the labelling. This paper proposes to assess the reliability of three LLMs, namely flan, GPT-4o, and GPT-4 mini for topic labelling. Drawing on previous research leveraging BERTopic, we generate topics from a dataset of all the scientific articles (n=34,797) authored by all biology professors in Switzerland (n=465) between 2008 and 2020, as recorded in the Web of Science database. We assess the output of the three models both quantitatively and qualitatively and find that, first, both GPT models are capable of accurately and precisely label topics from the models' output keywords. Second, 3-word labels are preferable to grasp the complexity of research topics.

📄 PDF Abstract BibTeX arXiv:2408.07003

Code (0)

등록된 구현이 없습니다.

Tasks

Articles

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…
Position-Wise Feed-Forward Layer 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

Multimodal Topic Labelling

2017-04-01 · EACL 2017 4 · Ionut Sorodoc, Jey Han Lau, Nikolaos Aletras, Timothy Baldwin

Topics generated by topic models are typically presented as a list of topic terms. Automatic topic labelling is the task of generating a succinct label that summarises the theme or subject of a topic, with the intention …

Topic Models

Automatic Labelling of Topics with Neural Embeddings

2016-12-16 · COLING 2016 12 · Shraey Bhatia, Jey Han Lau, Timothy Baldwin

Topics generated by topic models are typically represented as list of terms. To reduce the cognitive overhead of interpreting these topics for end-users, we propose labelling a topic with a succinct phrase that summarise…

Topic Models

Automatic Labelling of Topic Models Learned from Twitter by Summarisation

2014-06-01 · ACL 2014 6 · Amparo Elizabeth Cano Basave, Yulan He, Ruifeng Xu
Sentiment AnalysisTopic Models

Principled Analysis of Energy Discourse across Domains with Thesaurus-based Automatic Topic Labeling

2021-12-01 · ALTA 2021 12 · Thomas Scelsi, Alfonso Martinez Arranz, Lea Frermann

With the increasing impact of Natural Language Processing tools like topic models in social science research, the experimental rigor and comparability of models and datasets has come under scrutiny. Especially when contr…

Topic Models

Extractive and Abstractive Sentence Labelling of Sentiment-bearing Topics

2021-08-29 · Mohamad Hardyman Barawi, Chenghua Lin, Advaith Siddharthan, Yinbin Liu

This paper tackles the problem of automatically labelling sentiment-bearing topics with descriptive sentence labels. We propose two approaches to the problem, one extractive and the other abstractive. Both approaches rel…

DescriptiveSentenceSentence Fusion