paper-with-me

홈 › Papers

Leveraging Metamemory Mechanisms for Enhanced Data-Free Code Generation in LLMs

2025-01-14 · Shuai Wang, Liang Ding, Yibing Zhan, Yong Luo, Zheng He, Dapeng Tao

Automated code generation using large language models (LLMs) has gained attention due to its efficiency and adaptability. However, real-world coding tasks or benchmarks like HumanEval and StudentEval often lack dedicated training datasets, challenging existing few-shot prompting approaches that rely on reference examples. Inspired by human metamemory-a cognitive process involving recall and evaluation-we present a novel framework (namely M^2WF) for improving LLMs' one-time code generation. This approach enables LLMs to autonomously generate, evaluate, and utilize synthetic examples to enhance reliability and performance. Unlike prior methods, it minimizes dependency on curated data and adapts flexibly to various coding scenarios. Our experiments demonstrate significant improvements in coding benchmarks, offering a scalable and robust solution for data-free environments. The code and framework will be publicly available on GitHub and HuggingFace.

📄 PDF Abstract BibTeX arXiv:2501.07892

Code (0)

등록된 구현이 없습니다.

Tasks

Code GenerationHumanEval

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

BERT-JAM: Boosting BERT-Enhanced Neural Machine Translation with Joint Attention

2020-11-09 · Zhebin Zhang, Sai Wu, Dawei Jiang, Gang Chen

BERT-enhanced neural machine translation (NMT) aims at leveraging BERT-encoded representations for translation tasks. A recently proposed approach uses attention mechanisms to fuse Transformer's encoder and decoder layer…

DecoderMachine TranslationNMTTranslation

Angle Domain Guidance: Latent Diffusion Requires Rotation Rather Than Extrapolation

2025-05-21 · Cheng Jin, Zhenyu Xiao, Chutao Liu, Yuantao Gu

Classifier-free guidance (CFG) has emerged as a pivotal advancement in text-to-image latent diffusion models, establishing itself as a cornerstone technique for achieving high-quality image synthesis. However, under high…

Image Generation

Parameter-Free Bio-Inspired Channel Attention for Enhanced Cardiac MRI Reconstruction

2025-05-29 · Anam Hashmi, Julia Dietlmeier, Kathleen M. Curran, Noel E. O'Connor

Attention is a fundamental component of the human visual recognition system. The inclusion of attention in a convolutional neural network amplifies relevant visual features and suppresses the less important ones. Integra…

MRI Reconstruction

SpecAttn: Speculating Sparse Attention

2025-10-31 · Harsh Shah arxiv

Large Language Models (LLMs) face significant computational bottlenecks during inference due to the quadratic complexity of self-attention mechanisms, particularly as context lengths increase. We introduce SpecAttn, a no…

Object Isolated Attention for Consistent Story Visualization

2025-03-30 · Xiangyang Luo, Junhao Cheng, Yifan Xie, Xin Zhang 외

Open-ended story visualization is a challenging task that involves generating coherent image sequences from a given storyline. One of the main difficulties is maintaining character consistency while creating natural and …

ObjectStory Visualization