paper-with-me

홈 › Papers

An Effective Data Creation Pipeline to Generate High-quality Financial Instruction Data for Large Language Model

2023-07-31 · Ziao Wang, Jianning Wang, Junda Wu, Xiaofeng Zhang

At the beginning era of large language model, it is quite critical to generate a high-quality financial dataset to fine-tune a large language model for financial related tasks. Thus, this paper presents a carefully designed data creation pipeline for this purpose. Particularly, we initiate a dialogue between an AI investor and financial expert using ChatGPT and incorporate the feedback of human financial experts, leading to the refinement of the dataset. This pipeline yielded a robust instruction tuning dataset comprised of 103k multi-turn chats. Extensive experiments have been conducted on this dataset to evaluate the model's performance by adopting an external GPT-4 as the judge. The promising experimental results verify that our approach led to significant advancements in generating accurate, relevant, and financial-style responses from AI models, and thus providing a powerful tool for applications within the financial sector.

📄 PDF Abstract BibTeX arXiv:2308.01415

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage ModellingLarge Language Model

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Adam 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Residual Connection 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

EfficientDreamer: High-Fidelity and Robust 3D Creation via Orthogonal-view Diffusion Prior

2023-08-25 · Zhipeng Hu, Minda Zhao, Chaoyi Zhao, Xinyue Liang 외

While image diffusion models have made significant progress in text-driven 3D content creation, they often fail to accurately capture the intended meaning of text prompts, especially for view information. This limitation…

Text to 3D

EfficientDreamer: High-Fidelity and Robust 3D Creation via Orthogonal-view Diffusion Priors

2024-01-01 · CVPR 2024 1 · Zhipeng Hu, Minda Zhao, Chaoyi Zhao, Xinyue Liang 외

While image diffusion models have made significant progress in text-driven 3D content creation they often fail to accurately capture the intended meaning of text prompts especially for view information. This limitati…

Text to 3D

From World-Gen to Quest-Line: A Dependency-Driven Prompt Pipeline for Coherent RPG Generation

2026-04-28 · Dominik Borawski, Marta Szulc, Robert Chudy, Małgorzata Giedrowicz 외 arxiv

Large Language Models (LLMs) have shown strong potential for narrative generation, but their use in complex, multi-layered role-playing game (RPG) worlds is still limited by issues of coherence, controllability, and stru…

MegaFake: A Theory-Driven Dataset of Fake News Generated by Large Language Models

2024-08-19 · Lionel Z. Wang, Yiming Ma, Renfei Gao, Beichen Guo 외

The advent of large language models (LLMs) has revolutionized online content creation, making it much easier to generate high-quality fake news. This misuse threatens the integrity of our digital environment and ethical …

From Unstable to Playable: Stabilizing Angry Birds Levels via Object Segmentation

2025-09-28 · Mahdi Farrokhimaleki, Parsa Rahmati, Richard Zhao arxiv

Procedural Content Generation (PCG) techniques enable automatic creation of diverse and complex environments. While PCG facilitates more efficient content creation, ensuring consistently high-quality, industry-standard c…

Object Segmentation