Alignment Analysis of Sequential Segmentation of Lexicons to Improve Automatic Cognate Detection
Ranking functions in information retrieval are often used in search engines to recommend the relevant answers to the query. This paper makes use of this notion of information retrieval and applies onto the problem domain of cognate detection. The main contributions of this paper are: (1) positional segmentation, which incorporates the sequential notion; (2) graphical error modelling, which deduces the transformations. The current research work focuses on classification problem; which is distinguishing whether a pair of words are cognates. This paper focuses on a harder problem, whether we could predict a possible cognate from the given input. Our study shows that when language modelling smoothing methods are applied as the retrieval functions and used in conjunction with positional segmentation and error modelling gives better results than competing baselines, in both classification and prediction of cognates. Source code is at: https://github.com/pranav-ust/cognates
Code (1)
Tasks
General ClassificationInformation RetrievalLanguage ModellingRetrievalSegmentationSimilar Papers 제목 키워드 기반
Bilingual Lexicon Induction via Unsupervised Bitext Construction and Word Alignment
Bilingual lexicons map words in one language to their translations in another, and are typically induced by learning linear projections to align monolingual word embedding spaces. In this paper, we show it is possible to…
Bilingual Lexicon InductionWord AlignmentDeveloping Resources for Automated Speech Processing of Quebec French
The analysis of the structure of speech nearly always rests on the alignment of the speech recording with a phonetic transcription. Nowadays several tools can perform this speech segmentation automatically. However, none…
SegmentationText NormalizationAgreement-based Learning of Parallel Lexicons and Phrases from Non-Parallel Corpora
We introduce an agreement-based approach to learning parallel lexicons and phrases from non-parallel corpora. The basic idea is to encourage two asymmetric latent-variable translation models (i.e., source-to-target and t…
TranslationSimultaneous Sentence Boundary Detection and Alignment with Pivot-based Machine Translation Generated Lexicons
Sentence alignment is a task that consists in aligning the parallel sentences in a translated article pair. This paper describes a method to perform sentence boundary detection and alignment simultaneously, which signifi…
Boundary DetectionMachine TranslationSentenceTranslationCross-Lingual Emotion Lexicon Induction using Representation Alignment in Low-Resource Settings
Emotion lexicons provide information about associations between words and emotions. They have proven useful in analyses of reviews, literary texts, and posts on social media, among other things. We evaluate the feasibili…
SentenceTranslation