Hashtag Occurrences, Layout and Translation: A Corpus-driven Analysis of Tweets Published by the Canadian Government
We present an aligned bilingual corpus of 8758 tweet pairs in French and English, derived from Canadian government agencies. Hashtags appear in a tweet{'}s prologue, announcing its topic, or in the tweet{'}s text in lieu of traditional words, or in an epilogue. Hashtags are words prefixed with a pound sign in 80{\%} of the cases. The rest is mostly multiword hashtags, for which we describe a segmentation algorithm. A manual analysis of the bilingual alignment of 5000 hashtags shows that 5{\%} (French) to 18{\%} (English) of them don{'}t have a counterpart in their containing tweet{'}s translation. This analysis shows that 80{\%} of multiword hashtags are correctly translated by humans, and that the mistranslation of the rest may be due to incomplete translation directives regarding social media. We show how these resources and their analysis can guide the design of a machine translation pipeline, and its evaluation. A baseline system implementing a tweet-specific tokenizer yields promising results. The system is improved by translating epilogues, prologues, and text separately. We attempt to feed the SMT engine with the original hashtag and some alternatives ({``}dehashed{''} version or a segmented version of multiword hashtags), but translation quality improves at the cost of hashtag recall.
Code (0)
등록된 구현이 없습니다.
Tasks
Information RetrievalMachine TranslationOpinion MiningTranslationSimilar Papers 제목 키워드 기반
Emotion Corpus Construction Based on Selection from Hashtags
The availability of labelled corpus is of great importance for supervised learning in emotion classification tasks. Because it is time-consuming to manually label text, hashtags have been used as naturally annotated labe…
Emotion ClassificationSegmenting Hashtags using Automatically Created Training Data
Hashtags, which are commonly composed of multiple words, are increasingly used to convey the actual messages in tweets. Understanding what tweets are saying is getting more dependent on understanding hashtags. Therefore,…
BIG-bench Machine LearningText-to-hashtag Generation using Seq2seq Learning
In this paper, we studied whether models based on BiLSTM and BERT can predict hashtags in Brazilian Portuguese for Ecommerce websites. Hashtags have a sizable financial impact on Ecommerce. We processed a corpus of Ecomm…
A Computational Analysis of Polarization on Indian and Pakistani Social Media
Between February 14, 2019 and March 4, 2019, a terrorist attack in Pulwama, Kashmir followed by retaliatory airstrikes led to rising tensions between India and Pakistan, two nuclear-armed countries. In this work, we exam…
Identifying Idioms in Chinese Translations
Optimally, a translated text should preserve information while maintaining the writing style of the original. When this is not possible, as is often the case with figurative speech, a common practice is to simplify and m…
Machine TranslationTranslation