paper-with-me

홈 › Papers

Turkish Tweet Classification with Transformer Encoder

2019-09-01 · RANLP 2019 9 · At{\i}f Emre Y{\"u}ksel, Ya{\c{s}}ar Alim T{\"u}rkmen, Arzucan {\"O}zg{\"u}r, Berna Alt{\i}nel

Short-text classification is a challenging task, due to the sparsity and high dimensionality of the feature space. In this study, we aim to analyze and classify Turkish tweets based on their topics. Social media jargon and the agglutinative structure of the Turkish language makes this classification task even harder. As far as we know, this is the first study that uses a Transformer Encoder for short text classification in Turkish. The model is trained in a weakly supervised manner, where the training data set has been labeled automatically. Our results on the test set, which has been manually labeled, show that performing morphological analysis improves the classification performance of the traditional machine learning algorithms Random Forest, Naive Bayes, and Support Vector Machines. Still, the proposed approach achieves an F-score of 89.3 {\%} outperforming those algorithms by at least 5 points.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationGeneral ClassificationMorphological Analysistext-classificationText Classification

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Residual Connection 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…

Similar Papers 제목 키워드 기반

TurkishBERTweet: Fast and Reliable Large Language Model for Social Media Analysis

2023-11-29 · Ali Najafi, Onur Varol

Turkish is one of the most popular languages in the world. Wide us of this language on social media platforms such as Twitter, Instagram, or Tiktok and strategic position of the country in the world politics makes it app…

Hate Speech DetectionLanguage ModelingLanguage ModellingLarge Language Model+4

A Turkish Hate Speech Dataset and Detection System

2022-06-01 · LREC 2022 6 · Fatih Beyhan, Buse Çarık, İnanç Arın, Ayşecan Terzioğlu 외

Social media posts containing hate speech are reproduced and redistributed at an accelerated pace, reaching greater audiences at a higher speed. We present a machine learning system for automatic detection of hate speech…

Binary ClassificationHate Speech Detection

TabiBERT: A Large-Scale ModernBERT Foundation Model and A Unified Benchmark for Turkish

2025-12-28 · Melikşah Türker, A. Ebrar Kızıloğlu, Onur Güngör, Susan Üsküdarlı arxiv

Since the inception of BERT, encoder-only Transformers have evolved significantly in computational efficiency, training stability, and long-context modeling. ModernBERT consolidates these advances by integrating Rotary P…

Computational EfficiencyDomain GeneralizationQuestion Answering

Fine-tuning Transformer-based Encoder for Turkish Language Understanding Tasks

2024-01-30 · Savas Yildirim

Deep learning-based and lately Transformer-based language models have been dominating the studies of natural language processing in the last years. Thanks to their accurate and fast fine-tuning characteristics, they have…

named-entity-recognitionNamed Entity RecognitionNatural Language UnderstandingQuestion Answering+4

CoLi at UdS at SemEval-2020 Task 12: Offensive Tweet Detection with Ensembling

2020-12-01 · SEMEVAL 2020 · Kathryn Chapman, Johannes Bernhard, Dietrich Klakow

We present our submission and results for SemEval-2020 Task 12: Multilingual Offensive Language Identification in Social Media (OffensEval 2020) where we participated in offensive tweet classification tasks in English, A…

BIG-bench Machine LearningLanguage IdentificationregressionXLM-R