paper-with-me

Papers

Pair Programming with Large Language Models for Sampling and Estimation of Copulas

2023-03-31 · Jan Górecki

Without writing a single line of code by a human, an example Monte Carlo simulation based application for stochastic dependence modeling with copulas is developed using a state-of-the-art large language model (LLM) fine-tuned for conversations. This includes interaction with ChatGPT in natural language and using mathematical formalism, which, under careful supervision by a human-expert, led to producing a working code in MATLAB, Python and R for sampling from a given copula model, evaluation of the model's density, performing maximum likelihood estimation, optimizing the code for parallel computing for CPUs as well as for GPUs, and visualization of the computed results. In contrast to other emerging studies that assess the accuracy of LLMs like ChatGPT on tasks from a selected area, this work rather investigates ways how to achieve a successful solution of a standard statistical task in a collaboration of a human-expert and artificial intelligence (AI). Particularly, through careful prompt engineering, we separate successful solutions generated by ChatGPT from unsuccessful ones, resulting in a comprehensive list of related pros and cons. It is demonstrated that if the typical pitfalls are avoided, we can substantially benefit from collaborating with an AI partner. For example, we show that if ChatGPT is not able to provide a correct solution due to a lack of or incorrect knowledge, the human-expert can feed it with the correct knowledge, e.g., in the form of mathematical theorems and formulas, and make it to apply the gained knowledge in order to provide a solution that is correct. Such ability presents an attractive opportunity to achieve a programmed solution even for users with rather limited knowledge of programming techniques.

📄 PDF Abstract BibTeX arXiv:2303.18116

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModellingLarge Language ModelPrompt Engineering

Similar Papers 제목 키워드 기반

Is AI the better programming partner? Human-Human Pair Programming vs. Human-AI pAIr Programming

2023-06-08 · Qianou Ma, Tongshuang Wu, Kenneth Koedinger

The emergence of large-language models (LLMs) that excel at code generation and commercial products such as GitHub's Copilot has sparked interest in human-AI pair programming (referred to as "pAIr programming") where an …

Code Generation

Incorporating External Knowledge through Pre-training for Natural Language to Code Generation

2020-04-20 · ACL 2020 6 · Frank F. Xu, Zhengbao Jiang, Pengcheng Yin, Bogdan Vasilescu 외

Open-domain code generation aims to generate code in a general-purpose programming language (such as Python) from natural language (NL) intents. Motivated by the intuition that developers usually retrieve resources on th…

Code GenerationData AugmentationRetrieval

Building A Proof-Oriented Programmer That Is 64% Better Than GPT-4o Under Data Scarcity

2025-02-17 · Dylan Zhang, Justin Wang, Tianran Sun

Existing LMs struggle with proof-oriented programming due to data scarcity, which manifest in two key ways: (1) a lack of sufficient corpora for proof-oriented programming languages such as F*, and (2) the absence of lar…

Data Augmentation

Dr. Boot: Bootstrapping Program Synthesis Language Models to Perform Repairing

2025-07-20 · Noah van der Vleuten arxiv

Language models for program synthesis are usually trained and evaluated on programming competition datasets (MBPP, APPS). However, these datasets are limited in size and quality, while these language models are extremely…

Reinforcement LearningProgram Synthesis

Configuration Design of Mechanical Assemblies using an Estimation of Distribution Algorithm and Constraint Programming

2025-03-14 · Hyunmin Cheong, Mehran Ebrahimi, Adrian Butscher, Francesco Iorio

A configuration design problem in mechanical engineering involves finding an optimal assembly of components and joints that realizes some desired performance criteria. Such a problem is a discrete, constrained, and black…