Shai: A large language model for asset management

2023-12-21 · Zhongyang Guo, Guanran Jiang, Zhongdan Zhang, Peng Li, Zhefeng Wang, Yinchun Wang

This paper introduces "Shai" a 10B level large language model specifically designed for the asset management industry, built upon an open-source foundational model. With continuous pre-training and fine-tuning using a targeted corpus, Shai demonstrates enhanced performance in tasks relevant to its domain, outperforming baseline models. Our research includes the development of an innovative evaluation framework, which integrates professional qualification exams, tailored tasks, open-ended question answering, and safety assessments, to comprehensively assess Shai's capabilities. Furthermore, we discuss the challenges and implications of utilizing large language models like GPT-4 for performance assessment in asset management, suggesting a combination of automated evaluation and human judgment. Shai's development, showcasing the potential and versatility of 10B-level large language models in the financial sector with significant performance and modest computational requirements, hopes to provide practical insights and methodologies to assist industry peers in their similar endeavors.

📄 PDF Abstract BibTeX arXiv:2312.14203

Code (0)

등록된 구현이 없습니다.

Tasks

Asset ManagementLanguage ModelingLanguage ModellingLarge Language ModelManagementmodelOpen-Ended Question AnsweringQuestion Answering

Methods 이 논문이 사용한 방법론

Attention 설명 없음

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Position-Wise Feed-Forward Layer 설명 없음

Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Shai-am: A Machine Learning Platform for Investment Strategies

2022-07-01 · Jonghun Kwak, Jungyu Ahn, Jinho Lee, Sungwoo Park

The finance industry has adopted machine learning (ML) as a form of quantitative research to support better investment decisions, yet there are several challenges often overlooked in practice. (1) ML code tends to be uns…

BIG-bench Machine Learning

FishAI 2.0: Marine Fish Image Classification with Multi-modal Few-shot Learning

2025-09-26 · Chenghan Yang, Peng Zhou, Dong-Sheng Zhang, Yueyun Wang 외 arxiv

Traditional marine biological image recognition faces challenges of incomplete datasets and unsatisfactory model accuracy, particularly for few-shot conditions of rare species where data scarcity significantly hampers th…

Image Classification Image Augmentation Few-Shot Learning Data Augmentation

SpecPylot: Python Specification Generation using Large Language Models

2026-04-17 · Ragib Shahariar Ayon, Shibbir Ahmed arxiv

Automatically generating formal specifications could reduce the effort needed to improve program correctness, but in practice, this is still challenging. Many developers avoid writing contracts by hand, which limits the …

Towards Automated Solution Recipe Generation for Industrial Asset Management with LLM

2024-07-26 · Nianjun Zhou, Dhaval Patel, Shuxin Lin, Fearghal O'Donncha

This study introduces a novel approach to Industrial Asset Management (IAM) by incorporating Conditional-Based Management (CBM) principles with the latest advancements in Large Language Models (LLMs). Our research introd…

Asset Management Management Recipe Generation

Ownership at Large -- Open Problems and Challenges in Ownership Management

2020-04-15 · John Ahlgren, Maria Eugenia Berezin, Kinga Bojarczuk, Elena Dulskyte 외

Software-intensive organizations rely on large numbers of software assets of different types, e.g., source-code files, tables in the data warehouse, and software configurations. Who is the most suitable owner of a given …

BIG-bench Machine Learning Management