Evaluation Of Word Embeddings From Large-Scale French Web Content
Distributed word representations are popularly used in many tasks in natural language processing. Adding that pretrained word vectors on huge text corpus achieved high performance in many different NLP tasks. This paper introduces multiple high-quality word vectors for the French language where two of them are trained on massive crawled French data during this study and the others are trained on an already existing French corpus. We also evaluate the quality of our proposed word vectors and the existing French word vectors on the French word analogy task. In addition, we do the evaluation on multiple real NLP tasks that shows the important performance enhancement of the pre-trained word vectors compared to the existing and random ones. Finally, we created a demo web application to test and visualize the obtained word embeddings. The produced French word embeddings are available to the public, along with the finetuning code on the NLU tasks and the demo code.
Code (1)
Tasks
Word EmbeddingsSimilar Papers 제목 키워드 기반
BERTrade: Using Contextual Embeddings to Parse Old French
The successes of contextual word embeddings learned by training large-scale language models, while remarkable, have mostly occurred for languages where significant amounts of raw texts are available and where annotated d…
Dependency ParsingPOSPositionPOS Tagging+1Neural Networks approaches focused on French Spoken Language Understanding: application to the MEDIA Evaluation Task
In this paper, we present a study on a French Spoken Language Understanding (SLU) task: the MEDIA task. Many works and studies have been proposed for many tasks, but most of them are focused on English language and tasks…
Spoken Language UnderstandingWord EmbeddingsRight Tool, Right Job: Native-Language Evaluation, Tokenizer Sensitivity, and Methodological Findings from a French-Only BabyLM
We submit MéTRON-FR, a 125M GPT-2 pretrained on 92.47M words of French, to the BabyLM 2026 Strict track. It scores 85.97 +/- 0.17% on QFrBLiMP (a native Quebec-French benchmark of grammatical minimal pairs) and 62.80% on…
Adapted Sentiment Similarity Seed Words For French Tweets' Polarity Classification
We present, in this paper, our contribution in DEFT 2018 task 2 : {``}Global polarity{''}, determining the overall polarity (Positive, Negative, Neutral or MixPosNeg) of tweets regarding public transport, in French langu…
General ClassificationTask 2Word EmbeddingsJeuxDeLiens: Word Embeddings and Path-Based Similarity for Entity Linking using the French JeuxDeMots Lexical Semantic Network
Entity linking systems typically rely on encyclopedic knowledge bases such as DBpedia or Freebase. In this paper, we use, instead, a French lexical-semantic network named JeuxDeMots to jointly type and link entities. Our…
Entity LinkingWord Embeddings