paper-with-me

Papers

CCAE: A Corpus of Chinese-based Asian Englishes

2023-10-09 · Yang Liu, Melissa Xiaohui Qin, Long Wang, Chao Huang

Language models have been foundations in various scenarios of NLP applications, but it has not been well applied in language variety studies, even for the most popular language like English. This paper represents one of the few initial efforts to utilize the NLP technology in the paradigm of World Englishes, specifically in creating a multi-variety corpus for studying Asian Englishes. We present an overview of the CCAE -- Corpus of Chinese-based Asian English, a suite of corpora comprising six Chinese-based Asian English varieties. It is based on 340 million tokens in 448 thousand web documents from six regions. The ontology of data would make the corpus a helpful resource with enormous research potential for Asian Englishes (especially for Chinese Englishes for which there has not been a publicly accessible corpus yet so far) and an ideal source for variety-specific language modeling and downstream tasks, thus setting the stage for NLP-based World Englishes studies. And preliminary experiments on this corpus reveal the practical value of CCAE. Finally, we make CCAE available at \href{https://huggingface.co/datasets/CCAE/CCAE-Corpus}{this https URL}.

📄 PDF Abstract BibTeX arXiv:2310.05381

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage Modelling

Methods 이 논문이 사용한 방법론

Ontology 설명 없음

Similar Papers 제목 키워드 기반

ASPEC: Asian Scientific Paper Excerpt Corpus

2016-05-01 · LREC 2016 5 · Toshiaki Nakazawa, Manabu Yaguchi, Kiyotaka Uchimoto, Masao Utiyama 외

In this paper, we describe the details of the ASPEC (Asian Scientific Paper Excerpt Corpus), which is the first large-size parallel corpus of scientific paper domain. ASPEC was constructed in the Japanese-Chinese machine…

Machine TranslationTranslation

PANDA -- Paired Anti-hate Narratives Dataset from Asia: Using an LLM-as-a-Judge to Create the First Chinese Counterspeech Dataset

2025-01-01 · Michael Bennie, Demi Zhang, Bushi Xiao, Jing Cao 외

Despite the global prevalence of Modern Standard Chinese language, counterspeech (CS) resources for Chinese remain virtually nonexistent. To address this gap in East Asian counterspeech research we introduce the a corpus…

Improving Patent Translation using Bilingual Term Extraction and Re-tokenization for Chinese--Japanese

2016-12-01 · WS 2016 12 · Wei Yang, Yves Lepage

Unlike European languages, many Asian languages like Chinese and Japanese do not have typographic boundaries in written system. Word segmentation (tokenization) that break sentences down into individual words (tokens) is…

Chinese Word SegmentationMachine TranslationSegmentationTerm Extraction+1

Assessing Authenticity in Media Englishes and the Englishes of Popular Culture

2017-11-01 · PACLIC 2017 11 · Andrew Moody
Cultural Vocal Bursts Intensity Prediction

An Overview of BPPT's Indonesian Language Resources

2016-12-01 · WS 2016 12 · Gunarso Gunarso, Hammam Riza

This paper describes various Indonesian language resources that Agency for the Assessment and Application of Technology (BPPT) has developed and collected since mid 80{'}s when we joined MMTS (Multilingual Machine Transl…

Machine Translationspeech-recognitionSpeech RecognitionSpeech Synthesis+1