paper-with-me

홈 › Papers

Word Similarity Datasets for Indian Languages: Annotation and Baseline Systems

2017-04-01 · WS 2017 4 · Syed Sarfaraz Akhtar, Arihant Gupta, Avijit Vajpayee, Arjit Srivastava, Manish Shrivastava

With the advent of word representations, word similarity tasks are becoming increasing popular as an evaluation metric for the quality of the representations. In this paper, we present manually annotated monolingual word similarity datasets of six Indian languages - Urdu, Telugu, Marathi, Punjabi, Tamil and Gujarati. These languages are most spoken Indian languages worldwide after Hindi and Bengali. For the construction of these datasets, our approach relies on translation and re-annotation of word similarity datasets of English. We also present baseline scores for word representation models using state-of-the-art techniques for Urdu, Telugu and Marathi by evaluating them on newly created word similarity datasets.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Dependency ParsingMachine TranslationNamed Entity Recognition (NER)Question AnsweringSemantic Textual SimilarityTranslationWord Sense DisambiguationWord Similarity

Similar Papers 제목 키워드 기반

Transfer Learning for Scene Text Recognition in Indian Languages

2022-01-10 · Sanjana Gunna, Rohit Saluja, C. V. Jawahar

Scene text recognition in low-resource Indian languages is challenging because of complexities like multiple scripts, fonts, text size, and orientations. In this work, we investigate the power of transfer learning for al…

Scene Text RecognitionTransfer Learning

Multiword Expressions Dataset for Indian Languages

2016-05-01 · LREC 2016 5 · Dhirendra Singh, Sudha Bhingardive, Pushpak Bhattacharyya

Multiword Expressions (MWEs) are used frequently in natural languages, but understanding the diversity in MWEs is one of the open problem in the area of Natural Language Processing. In the context of Indian languages, MW…

DiversityPOSTAGvalid

How do different factors Impact the Inter-language Similarity? A Case Study on Indian languages

2021-08-01 · ACL 2021 5 · Sourav Kumar, Salil Aggarwal, Dipti Misra Sharma, Radhika Mamidi

India is one of the most linguistically diverse nations of the world and is culturally very rich. Most of these languages are somewhat similar to each other on account of sharing a common ancestry or being in contact for…

Machine TranslationSentiment AnalysisTranslation

CL-NERIL: A Cross-Lingual Model for NER in Indian Languages

2021-11-23 · Akshara Prabhakar, Gouri Sankar Majumder, Ashish Anand

Developing Named Entity Recognition (NER) systems for Indian languages has been a long-standing challenge, mainly owing to the requirement of a large amount of annotated clean training instances. This paper proposes an e…

named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER+3

Utilizing Wordnets for Cognate Detection among Indian Languages

2021-12-30 · GWC 2019 7 · Diptesh Kanojia, Kevin Patel, Pushpak Bhattacharyya, Malhar Kulkarni 외

Automatic Cognate Detection (ACD) is a challenging task which has been utilized to help NLP applications like Machine Translation, Information Retrieval and Computational Phylogenetics. Unidentified cognate pairs can pos…

Information RetrievalMachine TranslationRetrieval