paper-with-me

홈 › Papers

JIANG: Chinese Open Foundation Language Model

2023-08-01 · Qinhua Duan, Wenchao Gu, Yujia Chen, Wenxin Mao, Zewen Tian, Hui Cao

With the advancements in large language model technology, it has showcased capabilities that come close to those of human beings across various tasks. This achievement has garnered significant interest from companies and scientific research institutions, leading to substantial investments in the research and development of these models. While numerous large models have emerged during this period, the majority of them have been trained primarily on English data. Although they exhibit decent performance in other languages, such as Chinese, their potential remains limited due to factors like vocabulary design and training corpus. Consequently, their ability to fully express their capabilities in Chinese falls short. To address this issue, we introduce the model named JIANG (Chinese pinyin of ginger) specifically designed for the Chinese language. We have gathered a substantial amount of Chinese corpus to train the model and have also optimized its structure. The extensive experimental results demonstrate the excellent performance of our model.

📄 PDF Abstract BibTeX arXiv:2308.00624

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage ModellingLarge Language Modelmodel

Similar Papers 제목 키워드 기반

Fengshenbang 1.0: Being the Foundation of Chinese Cognitive Intelligence

2022-09-07 · Jiaxing Zhang, Ruyi Gan, Junjie Wang, Yuxiang Zhang 외

Nowadays, foundation models become one of fundamental infrastructures in artificial intelligence, paving ways to the general intelligence. However, the reality presents two urgent challenges: existing foundation models a…

GardenDesigner: Encoding Aesthetic Principles into Jiangnan Garden Construction via a Chain of Agents

2026-04-02 · Mengtian Li, Fan Yang, Ruixue Xiong, Yiyan Fan 외 arxiv

Jiangnan gardens, a prominent style of Chinese classical gardens, hold great potential as digital assets for film and game production and digital tourism. However, manual modeling of Jiangnan gardens heavily relies on ex…

A Case Study of Chinese Sentiment Analysis on Social Media Reviews Based on LSTM

2022-10-31 · Lukai Wang, Lei Wang

Network public opinion analysis is obtained by a combination of natural language processing (NLP) and public opinion supervision, and is crucial for monitoring public mood and trends. Therefore, network public opinion an…

Chinese Sentiment AnalysisSentiment Analysis

Skywork: A More Open Bilingual Foundation Model

2023-10-30 · Tianwen Wei, Liang Zhao, Lichang Zhang, Bo Zhu 외

In this technical report, we present Skywork-13B, a family of large language models (LLMs) trained on a corpus of over 3.2 trillion tokens drawn from both English and Chinese texts. This bilingual foundation model is the…

Language ModelingLanguage Modellingmodel

EEG2TEXT-CN: An Exploratory Study of Open-Vocabulary Chinese Text-EEG Alignment via Large Language Model and Contrastive Learning on ChineseEEG

2025-06-01 · Jacky Tai-Yu Lu, Jung Chiang, Chi-Sheng Chen, Anna Nai-Yun Tung 외

We propose EEG2TEXT-CN, which, to the best of our knowledge, represents one of the earliest open-vocabulary EEG-to-text generation frameworks tailored for Chinese. Built on a biologically grounded EEG encoder (NICE-EEG) …

Contrastive LearningDecoderEEGLanguage Modeling+4