paper-with-me

홈 › Papers

The Open Source Advantage in Large Language Models (LLMs)

2024-12-16 · Jiya Manchanda, Laura Boettcher, Matheus Westphalen, Jasser Jasser

Large language models (LLMs) have rapidly advanced natural language processing, driving significant breakthroughs in tasks such as text generation, machine translation, and domain-specific reasoning. The field now faces a critical dilemma in its approach: closed-source models like GPT-4 deliver state-of-the-art performance but restrict reproducibility, accessibility, and external oversight, while open-source frameworks like LLaMA and Mixtral democratize access, foster collaboration, and support diverse applications, achieving competitive results through techniques like instruction tuning and LoRA. Hybrid approaches address challenges like bias mitigation and resource accessibility by combining the scalability of closed-source systems with the transparency and inclusivity of open-source framework. However, in this position paper, we argue that open-source remains the most robust path for advancing LLM research and ethical deployment.

📄 PDF Abstract BibTeX arXiv:2412.12004

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencyMachine TranslationPositionText Generation

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Adam 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Position-Wise Feed-Forward Layer 설명 없음
GPT-4 GPT-4 is a transformer based model pre-trained to predict the next token in a document.
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

Leveraging Open-Source Large Language Models for Native Language Identification

2024-09-15 · Yee Man Ng, Ilia Markov

Native Language Identification (NLI) - the task of identifying the native language (L1) of a person based on their writing in the second language (L2) - has applications in forensics, marketing, and second language acqui…

Feature EngineeringLanguage AcquisitionLanguage IdentificationMarketing+2

FinGPT: Open-Source Financial Large Language Models

2023-06-09 · Hongyang Yang, Xiao-Yang Liu, Christina Dan Wang

Large language models (LLMs) have shown the potential of revolutionizing natural language processing tasks in diverse domains, sparking great interest in finance. Accessing high-quality financial data is the first challe…

Algorithmic TradingLanguage ModelingLanguage ModellingLarge Language Model

Legal Evalutions and Challenges of Large Language Models

2024-11-15 · Jiaqi Wang, Huan Zhao, Zhenyuan Yang, Peng Shu 외

In this paper, we review legal testing methods based on Large Language Models (LLMs), using the OPENAI o1 model as a case study to evaluate the performance of large models in applying legal provisions. We compare current…

Legal Reasoning

Performance Evaluation of Open-Source Large Language Models for Assisting Pathology Report Writing in Japanese

2026-03-12 · Masataka Kawai, Singo Sakashita, Shumpei Ishikawa, Shogo Watanabe 외 arxiv

The performance of large language models (LLMs) for supporting pathology report writing in Japanese remains unexplored. We evaluated seven open-source LLMs from three perspectives: (A) generation and information extracti…

Information Extraction

Building Real-World Meeting Summarization Systems using Large Language Models: A Practical Perspective

2023-10-30 · Md Tahmid Rahman Laskar, Xue-Yong Fu, Cheng Chen, Shashi Bhushan TN

This paper studies how to effectively build meeting summarization systems for real-world usage using large language models (LLMs). For this purpose, we conduct an extensive evaluation and comparison of various closed-sou…

Meeting Summarization