A document processing pipeline for the construction of a dataset for topic modeling based on the judgments of the Italian Supreme Court
Topic modeling in Italian legal research is hindered by the lack of public datasets, limiting the analysis of legal themes in Supreme Court judgments. To address this, we developed a document processing pipeline that produces an anonymized dataset optimized for topic modeling. The pipeline integrates document layout analysis (YOLOv8x), optical character recognition, and text anonymization. The DLA module achieved a mAP@50 of 0.964 and a mAP@50-95 of 0.800. The OCR detector reached a mAP@50-95 of 0.9022, and the text recognizer (TrOCR) obtained a character error rate of 0.0047 and a word error rate of 0.0248. Compared to OCR-only methods, our dataset improved topic modeling with a diversity score of 0.6198 and a coherence score of 0.6638. We applied BERTopic to extract topics and used large language models to generate labels and summaries. Outputs were evaluated against domain expert interpretations. Claude Sonnet 3.7 achieved a BERTScore F1 of 0.8119 for labeling and 0.9130 for summarization.
Code (0)
등록된 구현이 없습니다.
Tasks
DiversityDocument Layout AnalysisOptical Character RecognitionOptical Character Recognition (OCR)Text AnonymizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
RaV-IDP: A Reconstruction-as-Validation Framework for Faithful Intelligent Document Processing
Intelligent document processing pipelines extract structured entities (tables, images, and text) from documents for use in downstream systems such as knowledge bases, retrieval-augmented generation, and analytics. A pers…
Capturing research literature attitude towards Sustainable Development Goals: an LLM-based topic modeling approach
The world is facing a multitude of challenges that hinder the development of human civilization and the well-being of humanity on the planet. The Sustainable Development Goals (SDGs) were formulated by the United Nations…
HADES: Homologous Automated Document Exploration and Summarization
This paper introduces HADES, a novel tool for automatic comparative documents with similar structures. HADES is designed to streamline the work of professionals dealing with large volumes of documents, such as policy doc…
Neural Topic Model with Reinforcement Learning
In recent years, advances in neural variational inference have achieved many successes in text processing. Examples include neural topic models which are typically built upon variational autoencoder (VAE) with an objecti…
modelreinforcement-learningReinforcement LearningReinforcement Learning (RL)+2MAPEX: A Multi-Agent Pipeline for Keyphrase Extraction
Keyphrase extraction is a fundamental task in natural language processing. However, existing unsupervised prompt-based methods for Large Language Models (LLMs) often rely on single-stage inference pipelines with uniform …
Keyphrase Extraction