paper-with-me

Papers

Agent-SiMT: Agent-assisted Simultaneous Machine Translation with Large Language Models

2024-06-11 · Shoutao Guo, Shaolei Zhang, Zhengrui Ma, Min Zhang, Yang Feng

Simultaneous Machine Translation (SiMT) generates target translations while reading the source sentence. It relies on a policy to determine the optimal timing for reading sentences and generating translations. Existing SiMT methods generally adopt the traditional Transformer architecture, which concurrently determines the policy and generates translations. While they excel at determining policies, their translation performance is suboptimal. Conversely, Large Language Models (LLMs), trained on extensive corpora, possess superior generation capabilities, but it is difficult for them to acquire translation policy through the training methods of SiMT. Therefore, we introduce Agent-SiMT, a framework combining the strengths of LLMs and traditional SiMT methods. Agent-SiMT contains the policy-decision agent and the translation agent. The policy-decision agent is managed by a SiMT model, which determines the translation policy using partial source sentence and translation. The translation agent, leveraging an LLM, generates translation based on the partial source sentence. The two agents collaborate to accomplish SiMT. Experiments demonstrate that Agent-SiMT attains state-of-the-art performance.

📄 PDF Abstract BibTeX arXiv:2406.06910

Code (1)

ictnlp/LSG pytorch

Tasks

Machine TranslationSentenceTranslation

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Adam 설명 없음
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

SiLLM: Large Language Models for Simultaneous Machine Translation

2024-02-20 · Shoutao Guo, Shaolei Zhang, Zhengrui Ma, Min Zhang 외

Simultaneous Machine Translation (SiMT) generates translations while reading the source sentence, necessitating a policy to determine the optimal timing for reading and generating words. Despite the remarkable performanc…

Machine TranslationSentenceTranslation

On the Hallucination in Simultaneous Machine Translation

2024-06-11 · Meizhi Zhong, Kehai Chen, Zhengshan Xue, Lemao Liu 외

It is widely known that hallucination is a critical issue in Simultaneous Machine Translation (SiMT) due to the absence of source-side information. While many efforts have been made to enhance performance for SiMT, few o…

HallucinationMachine TranslationTranslation

Improving Simultaneous Machine Translation with Monolingual Data

2022-12-02 · Hexuan Deng, Liang Ding, Xuebo Liu, Meishan Zhang 외

Simultaneous machine translation (SiMT) is usually done via sequence-level knowledge distillation (Seq-KD) from a full-sentence neural machine translation (NMT) model. However, there is still a significant performance ga…

HallucinationKnowledge DistillationMachine TranslationNMT+2

Exploiting Multimodal Reinforcement Learning for Simultaneous Machine Translation

2021-02-22 · EACL 2021 2 · Julia Ive, Andy Mingren Li, Yishu Miao, Ozan Caglayan 외

This paper addresses the problem of simultaneous machine translation (SiMT) by exploring two main concepts: (a) adaptive policies to learn a good trade-off between high translation quality and low latency; and (b) visual…

Machine Translationreinforcement-learningReinforcement LearningReinforcement Learning (RL)+1

Modeling Dual Read/Write Paths for Simultaneous Machine Translation

2022-03-17 · ACL 2022 5 · Shaolei Zhang, Yang Feng

Simultaneous machine translation (SiMT) outputs translation while reading source sentence and hence requires a policy to decide whether to wait for the next source word (READ) or generate a target word (WRITE), the actio…

de-enMachine TranslationSentenceTranslation