A baseline revisited: Pushing the limits of multi-segment models for context-aware translation
This paper addresses the task of contextual translation using multi-segment models. Specifically we show that increasing model capacity further pushes the limits of this approach and that deeper models are more suited to capture context dependencies. Furthermore, improvements observed with larger models can be transferred to smaller models using knowledge distillation. Our experiments show that this approach achieves competitive performance across several languages and benchmarks, without additional language-specific tuning and task specific architectures.
Code (0)
등록된 구현이 없습니다.
Tasks
Knowledge DistillationTranslationSimilar Papers 제목 키워드 기반
Every Sample a Task: Pushing the Limits of Heterogeneous Models with Personalized Regression
When data arise from multiple latent subpopulations, machine learning frameworks typically estimate parameter values independently for each sub-population. In this paper, we propose to overcome these limits by considerin…
BIG-bench Machine LearningregressionCascadeCNN: Pushing the performance limits of quantisation
This work presents CascadeCNN, an automated toolflow that pushes the quantisation limits of any given CNN model, to perform high-throughput inference by exploiting the computation time-accuracy trade-off. Without the nee…
Understanding Stain Separation Improves Cross-Scanner Adenocarcinoma Segmentation with Joint Multi-Task Learning
Digital pathology has made significant advances in tumor diagnosis and segmentation, but image variability due to differences in organs, tissue preparation, and acquisition - known as domain shift - limits the effectiven…
DecoderDiagnosticMulti-Task LearningSegmentation+1CascadeCNN: Pushing the Performance Limits of Quantisation in Convolutional Neural Networks
This work presents CascadeCNN, an automated toolflow that pushes the quantisation limits of any given CNN model, aiming to perform high-throughput inference. A two-stage architecture tailored for any given CNN-FPGA pair …
Visual Prompt Guided Unified Pushing Policy
As one of the simplest non-prehensile manipulation skills, pushing has been widely studied as an effective means to rearrange objects. Existing approaches, however, typically rely on multi-step push plans composed of pre…