paper-with-me

홈 › Papers

SikuGPT: A Generative Pre-trained Model for Intelligent Information Processing of Ancient Texts from the Perspective of Digital Humanities

2023-04-16 · Liu Chang, Wang Dongbo, Zhao Zhixiao, Hu Die, Wu Mengcheng, Lin Litao, Shen Si, Li Bin, Liu Jiangfeng, Zhang Hai, Zhao Lianzheng

The rapid advance in artificial intelligence technology has facilitated the prosperity of digital humanities research. Against such backdrop, research methods need to be transformed in the intelligent processing of ancient texts, which is a crucial component of digital humanities research, so as to adapt to new development trends in the wave of AIGC. In this study, we propose a GPT model called SikuGPT based on the corpus of Siku Quanshu. The model's performance in tasks such as intralingual translation and text classification exceeds that of other GPT-type models aimed at processing ancient texts. SikuGPT's ability to process traditional Chinese ancient texts can help promote the organization of ancient information and knowledge services, as well as the international dissemination of Chinese ancient culture.

📄 PDF Abstract BibTeX arXiv:2304.07778

Code (1)

siku-bert/sikugpt 공식 구현

Tasks

Cultural Vocal Bursts Intensity Predictiontext-classificationText ClassificationTranslation

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
Residual Connection 설명 없음
Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

Mathematical Characterization of Signal Semantics and Rethinking of the Mathematical Theory of Information

2023-03-26 · Guangming Shi, Dahua Gao, Shuai Ma, Minxi Yang 외

Shannon information theory is established based on probability and bits, and the communication technology based on this theory realizes the information age. The original goal of Shannon's information theory is to describ…

Semantic Communication

Toward Agentic AI: Generative Information Retrieval Inspired Intelligent Communications and Networking

2025-02-24 · Ruichen Zhang, Shunpu Tang, Yinqiu Liu, Dusit Niyato 외

The increasing complexity and scale of modern telecommunications networks demand intelligent automation to enhance efficiency, adaptability, and resilience. Agentic AI has emerged as a key paradigm for intelligent commun…

Information RetrievalRetrievalSemantic Retrieval

A Survey of Generative AI for Intelligent Transportation Systems: Road Transportation Perspective

2023-12-13 · Huan Yan, Yong Li

Intelligent transportation systems are vital for modern traffic management and optimization, greatly improving traffic efficiency and safety. With the rapid development of generative artificial intelligence (Generative A…

Decision MakingImage GenerationManagementSurvey+1

Investigating Self-regulated Learning Sequences within a Generative AI-based Intelligent Tutoring System

2026-01-13 · Jie Gao, Shasha Li, Jianhua Zhang, Shan Li 외 arxiv

There has been a growing trend in employing generative artificial intelligence (GenAI) techniques to support learning. Moreover, scholars have reached a consensus on the critical role of self-regulated learning (SRL) in …

A New Theoretical and Technological System of Imprecise-Information Processing

2016-10-10 · Shiyou Lian

Imprecise-information processing will play an indispensable role in intelligent systems, especially in the anthropomorphic intelligent systems (as intelligent robots). A new theoretical and technological system of imprec…