Few-Shot Tabular Data Enrichment Using Fine-Tuned Transformer Architectures
The enrichment of tabular datasets using external sources has gained significant attention in recent years. Existing solutions, however, either ignore external unstructured data completely or devise dataset-specific solutions. In this study we proposed Few-Shot Transformer based Enrichment (FeSTE), a generic and robust framework for the enrichment of tabular datasets using unstructured data. By training over multiple datasets, our approach is able to develop generic models that can be applied to additional datasets with minimal training (i.e., few-shot). Our approach is based on an adaptation of BERT, for which we present a novel fine-tuning approach that reformulates the tuples of the datasets as sentences. Our evaluation, conducted on 17 datasets, shows that FeSTE is able to generate high quality features and significantly outperform existing fine-tuning solutions.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Beyond Extraction: Contextualising Tabular Data for Efficient Summarisation by Language Models
The conventional use of the Retrieval-Augmented Generation (RAG) architecture has proven effective for retrieving information from diverse documents. However, challenges arise in handling complex table queries, especiall…
Information RetrievalLanguage ModelingLanguage ModellingRAG+2MediTab: Scaling Medical Tabular Data Predictors via Data Consolidation, Enrichment, and Refinement
Tabular data prediction has been employed in medical applications such as patient health risk prediction. However, existing methods usually revolve around the algorithm design while overlooking the significance of data e…
PredictionTransfer-based Enrichment of a Hungarian Named Entity Dataset
In this paper, we present a major update to the first Hungarian named entity dataset, the Szeged NER corpus. We used zero-shot cross-lingual transfer to initialize the enrichment of entity types annotated in the corpus u…
Cross-Lingual TransferNERZero-Shot Cross-Lingual TransferLearning from Convenience Samples: A Case Study on Fine-Tuning LLMs for Survey Non-response in the German Longitudinal Election Study
Survey researchers face two key challenges: the rising costs of probability samples and missing data (e.g., non-response or attrition), which can undermine inference and increase the use of convenience samples. Recent wo…
Column Property Annotation using Large Language Models
Column property annotation (CPA), also known as column relationship prediction, is the task of predicting the semantic relationship between two columns in a table given a set of candidate relationships. CPA annotations a…
Columns Property AnnotationColumn Type AnnotationData IntegrationIn-Context Learning+1