paper-with-me

홈 › Papers

MPL: Multiple Programming Languages with Large Language Models for Information Extraction

2025-05-22 · Bo Li, Gexiang Fang, Wei Ye, Zhenghua Xu, Jinglei Zhang, Hao Cheng, Shikun Zhang

Recent research in information extraction (IE) focuses on utilizing code-style inputs to enhance structured output generation. The intuition behind this is that the programming languages (PLs) inherently exhibit greater structural organization than natural languages (NLs). This structural advantage makes PLs particularly suited for IE tasks. Nevertheless, existing research primarily focuses on Python for code-style simulation, overlooking the potential of other widely-used PLs (e.g., C++ and Java) during the supervised fine-tuning (SFT) phase. In this research, we propose \textbf{M}ultiple \textbf{P}rogramming \textbf{L}anguages with large language models for information extraction (abbreviated as \textbf{MPL}), a novel framework that explores the potential of incorporating different PLs in the SFT phase. Additionally, we introduce \texttt{function-prompt} with virtual running to simulate code-style inputs more effectively and efficiently. Experimental results on a wide range of datasets demonstrate the effectiveness of MPL. Furthermore, we conduct extensive experiments to provide a comprehensive analysis. We have released our code for future research.

📄 PDF Abstract BibTeX arXiv:2505.16107

Code (1)

pku-fgx/mpl 공식 구현 pytorch

Tasks

Structured Output Generation

Methods 이 논문이 사용한 방법론

SFT Shrink and Fine-Tune, or SFT, is a type of distillation that avoids explicit distillation by copying parameters to a student student model and then fine-tuning.…

Similar Papers 제목 키워드 기반

Benchmarking LLM Code Generation for Audio Programming with Visual Dataflow Languages

2024-09-01 · William Zhang, Maria Leon, Ryan Xu, Adrian Cardenas 외

Node-based programming languages are increasingly popular in media arts coding domains. These languages are designed to be accessible to users with limited coding experience, allowing them to achieve creative output with…

BenchmarkingCode Generation

Mix-of-Language-Experts Architecture for Multilingual Programming

2025-06-18 · Yifan Zong, Yuntian Deng, Pengyu Nie

Large language models (LLMs) have demonstrated impressive capabilities in aiding developers with tasks like code comprehension, generation, and translation. Supporting multilingual programming -- i.e., coding tasks acros…

Multilingual Code Co-Evolution Using Large Language Models

2023-07-27 · Jiyang Zhang, Pengyu Nie, Junyi Jessy Li, Milos Gligoric

Many software projects implement APIs and algorithms in multiple programming languages. Maintaining such projects is tiresome, as developers have to ensure that any change (e.g., a bug fix or a new feature) is being prop…

On the Impact of Language Selection for Training and Evaluating Programming Language Models

2023-08-25 · Jonathan Katzy, Maliheh Izadi, Arie van Deursen

The recent advancements in Transformer-based Language Models have demonstrated significant potential in enhancing the multilingual capabilities of these models. The remarkable progress made in this domain not only applie…

Fast Flexible Function Dispatch in Julia

2018-08-09 · Jeff Bezanson, Jake Bolewski, Jiahao Chen

Technical computing is a challenging application area for programming languages to address. This is evinced by the unusually large number of specialized languages in the area (e.g. MATLAB, R), and the complexity of commo…