Cross-Language Question Re-Ranking
We study how to find relevant questions in community forums when the language of the new questions is different from that of the existing questions in the forum. In particular, we explore the Arabic-English language pair. We compare a kernel-based system with a feed-forward neural network in a scenario where a large parallel corpus is available for training a machine translation system, bilingual dictionaries, and cross-language word embeddings. We observe that both approaches degrade the performance of the system when working on the translated text, especially the kernel-based system, which depends heavily on a syntactic kernel. We address this issue using a cross-language tree kernel, which compares the original Arabic tree to the English trees of the related questions. We show that this kernel almost closes the performance gap with respect to the monolingual system. On the neural network side, we use the parallel corpus to train cross-language embeddings, which we then use to represent the Arabic input and the English related questions in the same space. The results also improve to close to those of the monolingual neural network. Overall, the kernel system shows a better performance compared to the neural network in all cases.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationRe-RankingWord EmbeddingsSimilar Papers 제목 키워드 기반
Query Expansion for Cross-Language Question Re-Ranking
Community question-answering (CQA) platforms have become very popular forums for asking and answering questions daily. While these forums are rich repositories of community knowledge, they present challenges for finding …
Community Question AnsweringQuestion AnsweringRe-RankingWord EmbeddingsxPQA: Cross-Lingual Product Question Answering across 12 Languages
Product Question Answering (PQA) systems are key in e-commerce applications to provide responses to customers' questions as they shop for products. While existing work on PQA focuses mainly on English, in practice there …
Answer GenerationMachine TranslationQuestion AnsweringTask 2+1Passage-specific Prompt Tuning for Passage Reranking in Question Answering with Large Language Models
Effective passage retrieval and reranking methods have been widely utilized to identify suitable candidates in open-domain question answering tasks, recent studies have resorted to LLMs for reranking the retrieved passag…
Open-Domain Question AnsweringPassage RerankingPassage RetrievalQuestion Answering+1Cross-language Learning with Adversarial Neural Networks: Application to Community Question Answering
We address the problem of cross-language adaptation for question-question similarity reranking in community question answering, with the objective to port a system trained on one input language to another input language …
Community Question AnsweringQuestion AnsweringQuestion SimilarityRerankingCross-language Learning with Adversarial Neural Networks
We address the problem of cross-language adaptation for question-question similarity reranking in community question answering, with the objective to port a system trained on one input language to another input language …
Community Question AnsweringDomain AdaptationMachine TranslationQuestion Answering+3