paper-with-me

Papers

Multilingual Tourist Assistance using ChatGPT: Comparing Capabilities in Hindi, Telugu, and Kannada

2023-07-28 · Sanjana Kolar, Rohit Kumar

This research investigates the effectiveness of ChatGPT, an AI language model by OpenAI, in translating English into Hindi, Telugu, and Kannada languages, aimed at assisting tourists in India's linguistically diverse environment. To measure the translation quality, a test set of 50 questions from diverse fields such as general knowledge, food, and travel was used. These were assessed by five volunteers for accuracy and fluency, and the scores were subsequently converted into a BLEU score. The BLEU score evaluates the closeness of a machine-generated translation to a human translation, with a higher score indicating better translation quality. The Hindi translations outperformed others, showcasing superior accuracy and fluency, whereas Telugu translations lagged behind. Human evaluators rated both the accuracy and fluency of translations, offering a comprehensive perspective on the language model's performance.

📄 PDF Abstract BibTeX arXiv:2307.15376

Code (0)

등록된 구현이 없습니다.

Tasks

General KnowledgeLanguage ModelingLanguage ModellingTranslation

Methods 이 논문이 사용한 방법론

Travel 설명 없음

Similar Papers 제목 키워드 기반

zIA: a GenAI-powered local auntie assists tourists in Italy

2024-07-16 · Alexio Cassani, Michele Ruberl, Antonio Salis, Giacomo Giannese 외

The Tourism and Destination Management Organization (DMO) industry is rapidly evolving to adapt to new technologies and traveler expectations. Generative Artificial Intelligence (AI) offers an astonishing and innovative …

ChatbotManagement

Evaluating Telugu Proficiency in Large Language Models_ A Comparative Analysis of ChatGPT and Gemini

2024-04-30 · Katikela Sreeharsha Kishore, Rahimanuddin Shaik

The growing prominence of large language models (LLMs) necessitates the exploration of their capabilities beyond English. This research investigates the Telugu language proficiency of ChatGPT and Gemini, two leading LLMs…

Counting the Bugs in ChatGPT's Wugs: A Multilingual Investigation into the Morphological Capabilities of a Large Language Model

2023-10-23 · Leonie Weissweiler, Valentin Hofmann, Anjali Kantharuban, Anna Cai 외

Large language models (LLMs) have recently reached an impressive level of linguistic capability, prompting comparisons with human language skills. However, there have been relatively few systematic inquiries into the lin…

Language ModelingLanguage ModellingLarge Language Model

Is ChatGPT the Ultimate Programming Assistant -- How far is it?

2023-04-24 · Haoye Tian, Weiqi Lu, Tsz On Li, Xunzhu Tang 외

Recently, the ChatGPT LLM has received great attention: it can be used as a bot for discussing source code, prompting it to suggest changes, provide descriptions or even generate code. Typical demonstrations generally fo…

Code GenerationCode SummarizationProgram RepairPrompt Engineering

Repair Is Nearly Generation: Multilingual Program Repair with LLMs

2022-08-24 · Harshit Joshi, José Cambronero, Sumit Gulwani, Vu Le 외

Most programmers make mistakes when writing code. Some of these mistakes are small and require few edits to the original program -- a class of errors recently termed last mile mistakes. These errors break the flow for ex…

Language ModellingLarge Language ModelProgram Repair