Spatial Information Integration in Small Language Models for Document Layout Generation and Classification
Document layout understanding is a field of study that analyzes the spatial arrangement of information in a document hoping to understand its structure and layout. Models such as LayoutLM (and its subsequent iterations) can understand semi-structured documents with SotA results; however, the lack of open semi-structured data is a limitation in itself. While semi-structured data is common in everyday life (balance sheets, purchase orders, receipts), there is a lack of public datasets for training machine learning models for this type of document. In this investigation we propose a method to generate new, synthetic, layout information that can help overcoming this data shortage. According to our results, the proposed method performs better than LayoutTransformer, another popular layout generation method. We also show that, in some scenarios, text classification can improve when supported by bounding box information.
Code (0)
등록된 구현이 없습니다.
Tasks
Layout Generationtext-classificationText ClassificationSimilar Papers 제목 키워드 기반
Learning optimal integration of spatial and temporal information in noisy chemotaxis
We investigate the boundary between chemotaxis driven by spatial estimation of gradients and chemotaxis driven by temporal estimation. While it is well known that spatial chemotaxis becomes disadvantageous for small orga…
Deep Reinforcement LearningAdaptive Markup Language Generation for Contextually-Grounded Visual Document Understanding
Visual Document Understanding has become essential with the increase of text-rich visual content. This field poses significant challenges due to the need for effective integration of visual perception and textual compreh…
document understandingInstruction FollowingText GenerationQuantifying Geospatial in the Common Crawl Corpus
Large language models (LLMs) exhibit emerging geospatial capabilities, stemming from their pre-training on vast unlabelled text datasets that are often derived from the Common Crawl (CC) corpus. However, the geospatial c…
Language ModelingLanguage ModellingSpatial ReasoningCombining Local and Document-Level Context: The LMU Munich Neural Machine Translation System at WMT19
We describe LMU Munich{'}s machine translation system for English→German translation which was used to participate in the WMT19 shared task on supervised news translation. We specifically participated in the document-l…
Machine TranslationSentenceTranslationSpatial Latent Dirichlet Allocation
In recent years, the language model Latent Dirichlet Allocation (LDA), which clusters co-occurring words into topics, has been widely appled in the computer vision field. However, many of these applications have difficul…
Language ModelingLanguage Modelling