Exploiting a comparability mapping to improve bi-lingual data categorization: a three-mode data analysis perspective
We address in this paper the co-clustering and co-classification of bilingual data laying in two linguistic similarity spaces when a comparability measure defining a mapping between these two spaces is available. A new approach that we can characterized as a three-mode analysis scheme, is proposed to mix the comparability measure with the two similarity measures. Our aim is to improve jointly the accuracy of classification and clustering tasks performed in each of the two linguistic spaces, as well as the quality of the final alignment of comparable clusters that can be obtained. We used first some purely synthetic random data sets to assess our formal similarity-comparability mixing model. We then propose two variants of the comparability measure that has been defined by (Li and Gaussier 2010) in the context of bilingual lexicon extraction to adapt it to clustering or categorizing tasks. These two variant measures are subsequently used to evaluate our similarity-comparability mixing model in the context of the co-classification and co-clustering of comparable textual data sets collected from Wikipedia categories for the English and French languages. Our experiments show clear improvements in clustering and classification accuracies when mixing comparability with similarity measures, with, as expected, a higher robustness obtained when the two comparability variant measures that we propose are used. We believe that this approach is particularly well suited for the construction of thematic comparable corpora of controllable quality.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationClusteringGeneral ClassificationSimilar Papers 제목 키워드 기반
Co-clustering of bilingual datasets as a mean for assisting the construction of thematic bilingual comparable corpora
We address in this paper the assisted construction of bilingual thematic comparable corpora by means of co-clustering bilingual documents collected from raw sources such as the Web. The proposed approach is based on a qu…
ClusteringInformation RetrievalLearning Cross-lingual Mappings for Data Augmentation to Improve Low-Resource Speech Recognition
Exploiting cross-lingual resources is an effective way to compensate for data scarcity of low resource languages. Recently, a novel multilingual model fusion technique has been proposed where a model is trained to learn …
Data Augmentationspeech-recognitionSpeech RecognitionTransliterationA Multilingual Topic Model for Learning Weighted Topic Links Across Corpora with Low Comparability
Multilingual topic models (MTMs) learn topics on documents in multiple languages. Past models align topics across languages by implicitly assuming the documents in different languages are highly comparable, often a false…
Topic ModelsMeta-evaluation of comparability metrics using parallel corpora
Metrics for measuring the comparability of corpora or texts need to be developed and evaluated systematically. Applications based on a corpus, such as training Statistical MT systems in specialised narrow domains, requir…
Representation Mapping: A Novel Approach to Generate High-Quality Multi-Lingual Emotion Lexicons
In the past years, sentiment analysis has increasingly shifted attention to representational frameworks more expressive than semantic polarity (being positive, negative or neutral). However, these richer formats (like Ba…
Sentiment Analysis