paper-with-me

Papers

Sequence-to-Sequence Learning for Indonesian Automatic Question Generator

2020-09-29 · Ferdiant Joshua Muis, Ayu Purwarianti

Automatic question generation is defined as the task of automating the creation of question given a various of textual data. Research in automatic question generator (AQG) has been conducted for more than 10 years, mainly focused on factoid question. In all these studies, the state-of-the-art is attained using sequence-to-sequence approach. However, AQG system for Indonesian has not ever been researched intensely. In this work we construct an Indonesian automatic question generator, adapting the architecture from some previous works. In summary, we used sequence-to-sequence approach using BiGRU, BiLSTM, and Transformer with additional linguistic features, copy mechanism, and coverage mechanism. Since there is no public large dan popular Indonesian dataset for question generation, we translated SQuAD v2.0 factoid question answering dataset, with additional Indonesian TyDiQA dev set for testing. The system achieved BLEU1, BLEU2, BLEU3, BLEU4, and ROUGE-L score at 38,35, 20,96, 10,68, 5,78, and 43,4 for SQuAD, and 39.9, 20.78, 10.26, 6.31, 44.13 for TyDiQA, respectively. The system performed well when the expected answers are named entities and are syntactically close with the context explaining them. Additionally, from native Indonesian perspective, the best questions generated by our best models on their best cases are acceptable and reasonably useful.

📄 PDF Abstract BibTeX arXiv:2009.13889

Code (1)

FerdiantJoshua/question-generator 공식 구현

Tasks

Question AnsweringQuestion GenerationQuestion-Generation

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…
BiGRU A Bidirectional GRU, or BiGRU, is a sequence processing model that consists of two GRUs. one taking the input in a forward…
BiLSTM A Bidirectional LSTM, or biLSTM, is a sequence processing model that consists of two LSTMs: one taking the input in a forward direction, and the other in a backwards…

Similar Papers 제목 키워드 기반

Putting the Horse Before the Cart:A Generator-Evaluator Framework for Question Generation from Text

2018-08-15 · Vishwajeet Kumar, Ganesh Ramakrishnan, Yuan-Fang Li

Automatic question generation (QG) is a useful yet challenging task in NLP. Recent neural network-based approaches represent the state-of-the-art in this task. In this work, we attempt to strengthen them significantly by…

Question GenerationQuestion-Generation

Putting the Horse before the Cart: A Generator-Evaluator Framework for Question Generation from Text

2019-11-01 · CONLL 2019 11 · Vishwajeet Kumar, Ganesh Ramakrishnan, Yuan-Fang Li

Automatic question generation (QG) is a useful yet challenging task in NLP. Recent neural network-based approaches represent the state-of-the-art in this task. In this work, we attempt to strengthen them significantly by…

Question GenerationQuestion-Generation

A Neural Network Approach to Create Minangkabau-Indonesia Bilingual Dictionary

2022-06-01 · SIGUL (LREC) 2022 6 · Kartika Resiandi, Yohei Murakami, Arbi Haza Nasution

Indonesia has many varieties of ethnic languages, and most come from the same language family, namely Austronesian languages. Coming from that same language family, the words in Indonesian ethnic languages are very simil…

Decoder

IDK-MRC: Unanswerable Questions for Indonesian Machine Reading Comprehension

2022-10-25 · Rifki Afina Putri, Alice Oh

Machine Reading Comprehension (MRC) has become one of the essential tasks in Natural Language Understanding (NLU) as it is often included in several NLU benchmarks (Liang et al., 2020; Wilie et al., 2020). However, most …

Machine Reading ComprehensionNatural Language UnderstandingQuestion GenerationReading Comprehension

Improving Bi-LSTM Performance for Indonesian Sentiment Analysis Using Paragraph Vector

2020-09-12 · Ayu Purwarianti, Ida Ayu Putu Ari Crisdayanti

Bidirectional Long Short-Term Memory Network (Bi-LSTM) has shown promising performance in sentiment classification task. It processes inputs as sequence of information. Due to this behavior, sentiment predictions by Bi-L…

Sentiment AnalysisSentiment Classification