'Finance Wizard' at the FinLLM Challenge Task: Financial Text Summarization
This paper presents our participation under the team name Finance Wizard' in the FinNLP-AgentScen 2024 shared task #2: Financial Text Summarization. It documents our pipeline approach of fine-tuning a foundation model into a task-specific model for Financial Text Summarization. It involves (1) adapting Llama3 8B, a foundation model, to the Finance domain via continued pre-training, (2) multi-task instruction-tuning to further equip the model with more finance-related capabilities, (3) finally fine-tuning the model into a task-specific expert'. Our model, FinLlama3\_sum, yielded commendable results, securing the third position in its category with a ROUGE-1 score of 0.521.
Code (0)
등록된 구현이 없습니다.
Tasks
PositionTask 2Text SummarizationSimilar Papers 제목 키워드 기반
A Survey of Large Language Models in Finance (FinLLMs)
Large Language Models (LLMs) have shown remarkable capabilities across a wide variety of Natural Language Processing (NLP) tasks and have attracted attention from multiple domains, including financial services. Despite t…
Named Entity Recognition (NER)Question AnsweringSentiment ClassificationSurvey+3FinGPT: Open-Source Financial Large Language Models
Large language models (LLMs) have shown the potential of revolutionizing natural language processing tasks in diverse domains, sparking great interest in finance. Accessing high-quality financial data is the first challe…
Algorithmic TradingLanguage ModelingLanguage ModellingLarge Language ModelSNFinLLM: Systematic and Nuanced Financial Domain Adaptation of Chinese Large Language Models
Large language models (LLMs) have become powerful tools for advancing natural language processing applications in the financial industry. However, existing financial LLMs often face challenges such as hallucinations or s…
ArticlesDomain AdaptationLanguage ModellingLarge Language Model+2FinGPT: Democratizing Internet-scale Data for Financial Large Language Models
Large language models (LLMs) have demonstrated remarkable proficiency in understanding and generating human-like texts, which may potentially revolutionize the finance industry. However, existing LLMs often fall short in…
Algorithmic TradingSentiment AnalysisLLMs Meet Finance: Fine-Tuning Foundation Models for the Open FinLLM Leaderboard
This paper investigates the application of large language models (LLMs) to financial tasks. We fine-tuned foundation models using the Open FinLLM Leaderboard as a benchmark. Building on Qwen2.5 and Deepseek-R1, we employ…
Reinforcement Learning (RL)