Bi-Directional Differentiable Input Reconstruction for Low-Resource Neural Machine Translation
We aim to better exploit the limited amounts of parallel text available in low-resource settings by introducing a differentiable reconstruction loss for neural machine translation (NMT). This loss compares original inputs to reconstructed inputs, obtained by back-translating translation hypotheses into the input language. We leverage differentiable sampling and bi-directional NMT to train models end-to-end, without introducing additional parameters. This approach achieves small but consistent BLEU improvements on four language pairs in both translation directions, and outperforms an alternative differentiable reconstruction strategy based on hidden states.
Code (1)
Tasks
Low Resource Neural Machine TranslationLow-Resource Neural Machine TranslationMachine TranslationNMTTranslationSimilar Papers 제목 키워드 기반
OmniGS: Fast Radiance Field Reconstruction using Omnidirectional Gaussian Splatting
Photorealistic reconstruction relying on 3D Gaussian Splatting has shown promising potential in various domains. However, the current 3D Gaussian Splatting system only supports radiance field reconstruction using undisto…
GPULearning Scene-Level Signed Directional Distance Function with Ellipsoidal Priors and Neural Residuals
Dense geometric environment representations are critical for autonomous mobile robot navigation and exploration. Recent work shows that implicit continuous representations of occupancy, signed distance, or radiance learn…
NeRFRobot NavigationSingle-view 3D reconstruction via inverse procedural modeling
We propose an approach to 3D reconstruction via inverse procedural modeling and investigate two variants of this approach. The first option consists in the fitting set of input parameters using a genetic algorithm. We de…
3D ReconstructionSingle-View 3D ReconstructionData Aware Differentiable Neural Architecture Search for Tiny Keyword Spotting Applications
The success of Machine Learning is increasingly tempered by its significant resource footprint, driving interest in efficient paradigms like TinyML. However, the inherent complexity of designing TinyML systems hampers th…
Neural Architecture SearchKeyword SpottingSC-OmniGS: Self-Calibrating Omnidirectional Gaussian Splatting
360-degree cameras streamline data collection for radiance field 3D reconstruction by capturing comprehensive scene data. However, traditional radiance field methods do not address the specific challenges inherent to 360…
3D Reconstruction