paper-with-me

Papers

PsFuture: A Pseudo-Future-based Zero-Shot Adaptive Policy for Simultaneous Machine Translation

2024-10-05 · Libo Zhao, Jing Li, Ziqian Zeng

Simultaneous Machine Translation (SiMT) requires target tokens to be generated in real-time as streaming source tokens are consumed. Traditional approaches to SiMT typically require sophisticated architectures and extensive parameter configurations for training adaptive read/write policies, which in turn demand considerable computational power and memory. We propose PsFuture, the first zero-shot adaptive read/write policy for SiMT, enabling the translation model to independently determine read/write actions without the necessity for additional training. Furthermore, we introduce a novel training strategy, Prefix-to-Full (P2F), specifically tailored to adjust offline translation models for SiMT applications, exploiting the advantages of the bidirectional attention mechanism inherent in offline models. Experiments across multiple benchmarks demonstrate that our zero-shot policy attains performance on par with strong baselines and the P2F method can further enhance performance, achieving an outstanding trade-off between translation quality and latency.

📄 PDF Abstract BibTeX arXiv:2410.04075

Code (0)

등록된 구현이 없습니다.

Tasks

Machine TranslationTranslation

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

Z-ICL: Zero-Shot In-Context Learning with Pseudo-Demonstrations

2022-12-19 · Xinxi Lyu, Sewon Min, Iz Beltagy, Luke Zettlemoyer 외

Although large language models can be prompted for both zero- and few-shot learning, performance drops significantly when no demonstrations are available. In this paper, we introduce Z-ICL, a new zero-shot method that cl…

Few-Shot LearningIn-Context Learning

Context-Aware Pseudo-Label Scoring for Zero-Shot Video Summarization

2025-10-20 · Yuanli Wu, Long Zhang, Yue Du, Bin Li arxiv

We propose a rubric-guided, pseudo-labeled, and prompt-driven zero-shot video summarization framework that bridges large language models with structured semantic reasoning. A small subset of human annotations is converte…

Video Summarization

Universal Self-Adaptive Prompting

2023-05-24 · Xingchen Wan, Ruoxi Sun, Hootan Nakhost, Hanjun Dai 외

A hallmark of modern large language models (LLMs) is their impressive general zero-shot and few-shot abilities, often elicited through in-context learning (ICL) via prompting. However, while highly coveted and being the …

In-Context LearningNatural Language UnderstandingText GenerationZero-Shot Learning

Zero-Resource Neural Machine Translation with Monolingual Pivot Data

2019-11-01 · WS 2019 11 · Anna Currey, Kenneth Heafield

Zero-shot neural machine translation (NMT) is a framework that uses source-pivot and target-pivot parallel data to train a source-target NMT system. An extension to zero-shot NMT is zero-resource NMT, which generates pse…

Machine TranslationNMTTranslation

Commonsense for Zero-Shot Natural Language Video Localization

2023-12-29 · Meghana Holla, Ismini Lourentzou

Zero-shot Natural Language-Video Localization (NLVL) methods have exhibited promising results in training NLVL models exclusively with raw video data by dynamically generating video segments and pseudo-query annotations.…