홈 › Papers

No Argument Left Behind: Overlapping Chunks for Faster Processing of Arbitrarily Long Legal Texts

2024-10-24 · Israel Fama, Bárbara Bueno, Alexandre Alcoforado, Thomas Palmeira Ferraz, Arnold Moya, Anna Helena Reali Costa

In a context where the Brazilian judiciary system, the largest in the world, faces a crisis due to the slow processing of millions of cases, it becomes imperative to develop efficient methods for analyzing legal texts. We introduce uBERT, a hybrid model that combines Transformer and Recurrent Neural Network architectures to effectively handle long legal texts. Our approach processes the full text regardless of its length while maintaining reasonable computational overhead. Our experiments demonstrate that uBERT achieves superior performance compared to BERT+LSTM when overlapping input is used and is significantly faster than ULMFiT for processing long legal documents.

📄 PDF Abstract BibTeX arXiv:2410.19184

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Attention 설명 없음

Sigmoid Activation 설명 없음

Tanh Activation 설명 없음

LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…

Temporal Activation Regularization 설명 없음

Weight Tying Weight Tying improves the performance of language models by tying (sharing) the weights of the embedding and softmax layers. This…

Slanted Triangular Learning Rates Slanted Triangular Learning Rates (STLR) is a learning rate schedule which first linearly increases the learning rate and then linearly decays it, which can be seen in Figure…

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Open Information Extraction via Chunks

2023-05-05 · Kuicai Dong, Aixin Sun, Jung-jae Kim, XiaoLi Li

Open Information Extraction (OIE) aims to extract relational tuples from open-domain sentences. Existing OIE systems split a sentence into tokens and recognize token spans as tuple relations and arguments. We instead pro…

Chunking Open Information Extraction Sentence

Morpho-Syntactic Study of Errors from Speech Recognition System

2014-05-01 · LREC 2014 5 · Maria Goryainova, Cyril Grouin, Sophie Rosset, Ioana Vasilescu

The study provides an original standpoint of the speech transcription errors by focusing on the morpho-syntactic features of the erroneous chunks and of the surrounding left and right context. The typology concerns the f…

Named Entity Recognition (NER)POS Question Answering speech-recognition+1

The Touché23-ValueEval Dataset for Identifying Human Values behind Arguments

2023-01-31 · Nailia Mirzakhmedova, Johannes Kiesel, Milad Alshomary, Maximilian Heinrich 외

We present the Touch\'e23-ValueEval Dataset for Identifying Human Values behind Arguments. To investigate approaches for the automated detection of human values behind arguments, we collected 9324 arguments from 6 divers…

ChronoStitch: Training-Free Composition of Visual KV Memories for Long-Horizon Temporal Reasoning

2026-07-21 · Santiram Tiwari, Nishant Sinha, Kunal Kislay arxiv

Long-video question answering requires a model to preserve visual evidence over time without repeatedly reprocessing the same video. A practical approach is to store the vision-language model's internal key-value (KV) ca…

Video Question Answering

Alternative Technique to Asymmetry Analysis-Based Overlapping for Foot Ulcer Examination: Scalable Scanning

2016-06-11 · Naima Kaabouch, Wen-Chen Hu, Yi Chen

Asymmetry analysis based on the overlapping of thermal images proved able to detect inflammation and, predict foot ulceration. This technique involves three main steps: segmentation, geometric transformation, and overlap…