paper-with-me

홈 › Papers

Auto-tagging of Short Conversational Sentences using Transformer Methods

2021-06-03 · D. Emre Taşar, Şükrü Ozan, Umut Özdil, M. Fatih Akca, Oğuzhan Ölmez, Semih Gülüm, Seçilay Kutal, Ceren Belhan

The problem of categorizing short speech sentences according to their semantic features with high accuracy is a subject studied in natural language processing. In this study, a data set created with samples classified in 46 different categories was used. Examples consist of sentences taken from chat conversations between a company's customer representatives and the company's website visitors. The primary purpose is to automatically tag questions and requests from visitors in the most accurate way for 46 predetermined categories for use in a chat application to generate meaningful answers to the questions asked by the website visitors. For this, different BERT models and one GPT-2 model, pre-trained in Turkish, were preferred. The classification performances of the relevant models were analyzed in detail and reported accordingly.

📄 PDF Abstract BibTeX arXiv:2106.01735

Code (0)

등록된 구현이 없습니다.

Tasks

TAG

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…
Linear Warmup With Cosine Annealing Linear Warmup With Cosine Annealing is a learning rate schedule where we increase the learning rate linearly for $n$ updates and then anneal according to a cosine schedule…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Discriminative Fine-Tuning Discriminative Fine-Tuning is a fine-tuning strategy that is used for ULMFiT type models. Instead of using the same learning rate…
Adam 설명 없음
GPT-2 GPT-2 is a Transformer architecture that was notable for its size (1.5 billion parameters) on its release. The…

Similar Papers 제목 키워드 기반

Auto-tagging of Short Conversational Sentences using Natural Language Processing Methods

2021-06-09 · Şükrü Ozan, D. Emre Taşar

In this study, we aim to find a method to auto-tag sentences specific to a domain. Our training data comprises short conversational sentences extracted from chat conversations between company's customer representatives a…

ChatbotLanguage ModelingLanguage ModellingTAG

Introducing a Large-Scale Dataset for Vietnamese POS Tagging on Conversational Texts

2020-05-01 · LREC 2020 5 · Oanh Tran, Tu Pham, Vu Dang, Bang Nguyen

This paper introduces a large-scale human-labeled dataset for the Vietnamese POS tagging task on conversational texts. To this end, wepropose a new tagging scheme (with 36 POS tags) consisting of exclusive tags for speci…

POSPOS TaggingTAG

POS-Tagging based Neural Machine Translation System for European Languages using Transformers

2021-05-31 · WSEAS Transactions on Information Science and Applications 2021 5 · Preetham Ganesh, Bharat S. Rawal, Alexander Peter, Andi Giri

The interaction between human beings has always faced different kinds of difficulties. One of those difficulties is the language barrier. It would be a tedious task for someone to learn all the syllables in a new languag…

Machine TranslationNMTPart-Of-Speech TaggingPOS+2

Generating Gender Augmented Data for NLP

2021-07-13 · ACL (GeBNLP) 2021 8 · Nishtha Jain, Maja Popovic, Declan Groves, Eva Vanmassenhove

Gender bias is a frequent occurrence in NLP-based applications, especially pronounced in gender-inflected languages. Bias can appear through associations of certain adjectives and animate nouns with the natural gender of…

Machine TranslationNMTSentenceTranslation

Towards Automatic Generation of Questions from Long Answers

2020-04-10 · Shlok Kumar Mishra, Pranav Goel, Abhishek Sharma, Abhyuday Jagannatha 외

Automatic question generation (AQG) has broad applicability in domains such as tutoring systems, conversational agents, healthcare literacy, and information retrieval. Existing efforts at AQG have been limited to short a…

Information RetrievalNatural QuestionsQuestion GenerationQuestion-Generation+2