paper-with-me

Papers

JaFIn: Japanese Financial Instruction Dataset

2024-04-14 · Kota Tanabe, Masahiro Suzuki, Hiroki Sakaji, Itsuki Noda

We construct an instruction dataset for the large language model (LLM) in the Japanese finance domain. Domain adaptation of language models, including LLMs, is receiving more attention as language models become more popular. This study demonstrates the effectiveness of domain adaptation through instruction tuning. To achieve this, we propose an instruction tuning data in Japanese called JaFIn, the Japanese Financial Instruction Dataset. JaFIn is manually constructed based on multiple data sources, including Japanese government websites, which provide extensive financial knowledge. We then utilize JaFIn to apply instruction tuning for several LLMs, demonstrating that our models specialized in finance have better domain adaptability than the original models. The financial-specialized LLMs created were evaluated using a quantitative Japanese financial benchmark and qualitative response comparisons, showing improved performance over the originals.

📄 PDF Abstract BibTeX arXiv:2404.09260

Code (0)

등록된 구현이 없습니다.

Tasks

Domain AdaptationLanguage ModelingLanguage ModellingLarge Language Model

Similar Papers 제목 키워드 기반

JFinTEB: Japanese Financial Text Embedding Benchmark

2026-04-17 · Masahiro Suzuki, Hiroki Sakaji arxiv

We introduce JFinTEB, the first comprehensive benchmark specifically designed for evaluating Japanese financial text embeddings. Existing embedding benchmarks provide limited coverage of language-specific and domain-spec…

Sentiment AnalysisText Generation

Constructing Synthetic Instruction Datasets for Improving Reasoning in Domain-Specific LLMs: A Case Study in the Japanese Financial Domain

2026-03-02 · Yuma Okochi, Fabio Milentiansen Sim, Tomoyasu Okada arxiv

In adapting LLMs to specific domains, achieving both domain expertise and reasoning ability remains an urgent challenge. This study proposes a general method for constructing high-quality synthetic instruction data for a…

Construction of Domain-specified Japanese Large Language Model for Finance through Continual Pre-training

2024-04-16 · Masanori Hirano, Kentaro Imajo

Large language models (LLMs) are now widely used in various fields, including finance. However, Japanese financial-specific LLMs have not been proposed yet. Hence, this study aims to construct a Japanese financial-specif…

Language ModelingLanguage ModellingLarge Language Model

Economy Watchers Survey Provides Datasets and Tasks for Japanese Financial Domain

2024-07-20 · Masahiro Suzuki, Hiroki Sakaji

Natural language processing (NLP) tasks in English and general domains are widely available and are often used to evaluate pre-trained language models. In contrast, fewer tasks are available for languages other than Engl…

Sentiment Analysis

From Base to Conversational: Japanese Instruction Dataset and Tuning Large Language Models

2023-09-07 · Masahiro Suzuki, Masanori Hirano, Hiroki Sakaji

Instruction tuning is essential for large language models (LLMs) to become interactive. While many instruction tuning datasets exist in English, there is a noticeable lack in other languages. Also, their effectiveness ha…