paper-with-me

홈 › Papers

Comparative Analysis of Multilingual Text Classification & Identification through Deep Learning and Embedding Visualization

2023-12-06 · Arinjay Wyawhare

This research conducts a comparative study on multilingual text classification methods, utilizing deep learning and embedding visualization. The study employs LangDetect, LangId, FastText, and Sentence Transformer on a dataset encompassing 17 languages. It explores dimensionality's impact on clustering, revealing FastText's clearer clustering in 2D visualization due to its extensive multilingual corpus training. Notably, the FastText multi-layer perceptron model achieved remarkable accuracy, precision, recall, and F1 score, outperforming the Sentence Transformer model. The study underscores the effectiveness of these techniques in multilingual text classification, emphasizing the importance of large multilingual corpora for training embeddings. It lays the groundwork for future research and assists practitioners in developing language detection and classification systems. Additionally, it includes the comparison of multi-layer perceptron, LSTM, and Convolution models for classification.

📄 PDF Abstract BibTeX arXiv:2312.03789

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationClusteringMultilingual text classificationSentencetext-classificationText Classification

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Tanh Activation 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

cs@DravidianLangTech-EACL2021: Offensive Language Identification Based On Multilingual BERT Model

2021-04-01 · EACL (DravidianLangTech) 2021 4 · Shi Chen, Bing Kong

This paper introduces the related content of the task “Offensive Language Identification in Dravidian LANGUAGES-EACL 2021”. The task requires us to classify Dravidian languages collected from social media into Not-Offens…

Language Identificationtext-classificationText Classification

Comparative Performance of Advanced NLP Models and LLMs in Multilingual Geo-Entity Detection

2024-12-29 · Kalin Kopanov

The integration of advanced Natural Language Processing (NLP) methodologies and Large Language Models (LLMs) has significantly enhanced the extraction and analysis of geospatial data from multilingual texts, impacting se…

ALBERTI, a Multilingual Domain Specific Language Model for Poetry Analysis

2023-07-03 · Javier de la Rosa, Álvaro Pérez Pozo, Salvador Ros, Elena González-Blanco

The computational analysis of poetry is limited by the scarcity of tools to automatically analyze and scan poems. In a multilingual settings, the problem is exacerbated as scansion and rhyme systems only exist for indivi…

Language ModelingLanguage ModellingLarge Language Model

Multilingual Pre-Trained Transformers and Convolutional NN Classification Models for Technical Domain Identification

2021-01-22 · ICON 2020 12 · Suman Dowlagar, Radhika Mamidi

In this paper, we present a transfer learning system to perform technical domain identification on multilingual text data. We have submitted two runs, one uses the transformer model BERT, and the other uses XLM-ROBERTa w…

General Classificationtext-classificationText ClassificationTransfer Learning

Mono vs Multilingual BERT for Hate Speech Detection and Text Classification: A Case Study in Marathi

2022-04-19 · Abhishek Velankar, Hrushikesh Patil, Raviraj Joshi

Transformers are the most eminent architectures used for a vast range of Natural Language Processing tasks. These models are pre-trained over a large text corpus and are meant to serve state-of-the-art results over tasks…

ArticlesClassificationHate Speech DetectionSentence+5