Leveraging Large Language Models for Topic Classification in the Domain of Public Affairs
The analysis of public affairs documents is crucial for citizens as it promotes transparency, accountability, and informed decision-making. It allows citizens to understand government policies, participate in public discourse, and hold representatives accountable. This is crucial, and sometimes a matter of life or death, for companies whose operation depend on certain regulations. Large Language Models (LLMs) have the potential to greatly enhance the analysis of public affairs documents by effectively processing and understanding the complex language used in such documents. In this work, we analyze the performance of LLMs in classifying public affairs documents. As a natural multi-label task, the classification of these documents presents important challenges. In this work, we use a regex-powered tool to collect a database of public affairs documents with more than 33K samples and 22.5M tokens. Our experiments assess the performance of 4 different Spanish LLMs to classify up to 30 different topics in the data in different configurations. The results shows that LLMs can be of great use to process domain-specific documents, such as those in the domain of public affairs.
Code (0)
등록된 구현이 없습니다.
Tasks
Decision MakingTopic ClassificationSimilar Papers 제목 키워드 기반
A Benchmark for Cross-Domain Argumentative Stance Classification on Social Media
Argumentative stance classification plays a key role in identifying authors' viewpoints on specific topics. However, generating diverse pairs of argumentative sentences across various domains is challenging. Existing ben…
Stance ClassificationSeeded Poisson Factorization: Leveraging domain knowledge to fit topic models
Topic models are widely used for discovering latent thematic structures in large text corpora, yet traditional unsupervised methods often struggle to align with predefined conceptual domains. This paper introduces Seeded…
Computational EfficiencyTopic ModelsVariational InferenceZero-Shot Topic Classification of Column Headers: Leveraging LLMs for Metadata Enrichment
Traditional dataset retrieval systems rely on metadata for indexing, rather than on the underlying data values. However, high-quality metadata creation and enrichment often require manual annotations, which is a labour-i…
Retrievaltext-classificationText ClassificationTopic ClassificationAgriLens: Semantic Retrieval in Agricultural Texts Using Topic Modeling and Language Models
As the volume of unstructured text continues to grow across domains, there is an urgent need for scalable methods that enable interpretable organization, summarization, and retrieval of information. This work presents a …
Semantic RetrievalBridging the gap between supervised classification and unsupervised topic modelling for social-media assisted crisis management
Social media such as Twitter provide valuable information to crisis managers and affected people during natural disasters. Machine learning can help structure and extract information from the large volume of messages sha…
Domain AdaptationManagementTopic Models