paper-with-me

Papers

Table Transformers for Imputing Textual Attributes

2024-08-04 · Ting-Ruen Wei, YuAn Wang, Yoshitaka Inoue, Hsin-Tai Wu, Yi Fang

Missing data in tabular dataset is a common issue as the performance of downstream tasks usually depends on the completeness of the training dataset. Previous missing data imputation methods focus on numeric and categorical columns, but we propose a novel end-to-end approach called Table Transformers for Imputing Textual Attributes (TTITA) based on the transformer to impute unstructured textual columns using other columns in the table. We conduct extensive experiments on three datasets, and our approach shows competitive performance outperforming baseline models such as recurrent neural networks and Llama2. The performance improvement is more significant when the target sequence has a longer length. Additionally, we incorporate multi-task learning to simultaneously impute for heterogeneous columns, boosting the performance for text imputation. We also qualitatively compare with ChatGPT for realistic applications.

📄 PDF Abstract BibTeX arXiv:2408.02128

Code (2)

tingruew/TTITA-Text-Imputation 공식 구현 pytorch
pwc-1/Paper-10/tree/main/table_transformer mindspore

Tasks

ImputationMulti-Task Learning

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Edgeformers: Graph-Empowered Transformers for Representation Learning on Textual-Edge Networks

2023-02-21 · Bowen Jin, Yu Zhang, Yu Meng, Jiawei Han

Edges in many real-world social/information networks are associated with rich text information (e.g., user-user communications or user-product reviews). However, mainstream network representation learning models focus on…

Edge ClassificationLink PredictionRepresentation Learning

LidaRefer: Outdoor 3D Visual Grounding for Autonomous Driving with Transformers

2024-11-07 · Yeong-Seung Baek, Heung-Seon Oh

3D visual grounding (VG) aims to locate relevant objects or regions within 3D scenes based on natural language descriptions. Although recent methods for indoor 3D VG have successfully transformer-based architectures to c…

3D visual groundingAutonomous DrivingVisual Grounding

Can Attention-based Transformers Explain or Interpret Cyberbullying Detection?

2022-10-01 · TRAC (COLING) 2022 10 · Kanishk Verma, Tijana Milosevic, Brian Davis

Automated textual cyberbullying detection is known to be a challenging task. It is sometimes expected that messages associated with bullying will either be a) abusive, b) targeted at a specific individual or group, or c)…

Decision MakingTransfer Learning

TexTailor: Inference-Time Textual Guidance Tailoring for Multimodal Diffusion Transformers

2026-01-05 · Binglei Li, Mengping Yang, Zhiyu Tan, Junping Zhang 외 arxiv

Recent breakthroughs of transformer-based diffusion models, particularly with Multimodal Diffusion Transformers (MMDiT) driven models like FLUX and Qwen Image, have facilitated thrilling experiences in visual generation.…

Text-to-Image GenerationImage Editing

Contextual Semantic Interpretability

2020-09-18 · Diego Marcos, Ruth Fong, Sylvain Lobry, Remi Flamary 외

Convolutional neural networks (CNN) are known to learn an image representation that captures concepts relevant to the task, but do so in an implicit way that hampers model interpretability. However, one could argue that …