paper-with-me

Papers

Korean-Specific Dataset for Table Question Answering

2022-01-17 · LREC 2022 6 · Changwook Jun, Jooyoung Choi, Myoseop Sim, Hyun Kim, Hansol Jang, Kyungkoo Min

Existing question answering systems mainly focus on dealing with text data. However, much of the data produced daily is stored in the form of tables that can be found in documents and relational databases, or on the web. To solve the task of question answering over tables, there exist many datasets for table question answering written in English, but few Korean datasets. In this paper, we demonstrate how we construct Korean-specific datasets for table question answering: Korean tabular dataset is a collection of 1.4M tables with corresponding descriptions for unsupervised pre-training language models. Korean table question answering corpus consists of 70k pairs of questions and answers created by crowd-sourced workers. Subsequently, we then build a pre-trained language model based on Transformer and fine-tune the model for table question answering with these datasets. We then report the evaluation results of our model. We make our datasets publicly available via our GitHub repository and hope that those datasets will help further studies for question answering over tables, and for the transformation of table formats.

📄 PDF Abstract BibTeX arXiv:2201.06223

Code (1)

lg-nlp/korwikitablequestions 공식 구현

Tasks

Language ModelingLanguage ModellingQuestion AnsweringUnsupervised Pre-training

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Position-Wise Feed-Forward Layer 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

KorMedMCQA: Multi-Choice Question Answering Benchmark for Korean Healthcare Professional Licensing Examinations

2024-03-03 · Sunjun Kweon, Byungjin Choi, Gyouk Chu, Junyeong Song 외

We present KorMedMCQA, the first Korean Medical Multiple-Choice Question Answering benchmark, derived from professional healthcare licensing examinations conducted in Korea between 2012 and 2024. The dataset contains 7,4…

MedQAMMLUMultiple-choiceMultiple Choice Question Answering (MCQA)+1

A Method of Passage-Based Document Retrieval in Question Answering System

2015-12-17 · Jong Man-Hung, Ri Chong-Han, Choe Hyok-Chol, Hwang Chol-Jun

We propose a method for using the scoring values of passages to effectively retrieve documents in a Question Answering system. For this, we suggest evaluation function that considers proximity between each question ter…

Question AnsweringRetrieval

KoBBQ: Korean Bias Benchmark for Question Answering

2023-07-31 · Jiho Jin, Jiseon Kim, Nayeon Lee, Haneul Yoo 외

The Bias Benchmark for Question Answering (BBQ) is designed to evaluate social biases of language models (LMs), but it is not simple to adapt this benchmark to cultural contexts other than the US because social biases de…

Question Answering

KorQuAD1.0: Korean QA Dataset for Machine Reading Comprehension

2019-09-16 · Seungyoung Lim, Myungji Kim, Jooyoul Lee

Machine Reading Comprehension (MRC) is a task that requires machine to understand natural language and answer questions by reading a document. It is the core of automatic response technology such as chatbots and automati…

ArticlesMachine Reading ComprehensionQuestion AnsweringReading Comprehension

KRETA: A Benchmark for Korean Reading and Reasoning in Text-Rich VQA Attuned to Diverse Visual Contexts

2025-08-27 · Taebaek Hwang, Minseo Kim, Gisang Lee, Seonuk Kim 외 arxiv

Understanding and reasoning over text within visual contexts poses a significant challenge for Vision-Language Models (VLMs), given the complexity and diversity of real-world scenarios. To address this challenge, text-ri…

Visual Question Answering