Sparse Regression for Machine Translation
We use transductive regression techniques to learn mappings between source and target features of given parallel corpora and use these mappings to generate machine translation outputs. We show the effectiveness of $L_1$ regularized regression (\textit{lasso}) to learn the mappings between sparsely observed feature sets versus $L_2$ regularized regression. Proper selection of training instances plays an important role to learn correct feature mappings within limited computational resources and at expected accuracy levels. We introduce \textit{dice} instance selection method for proper selection of training instances, which plays an important role to learn correct feature mappings for improving the source and target coverage of the training set. We show that $L_1$ regularized regression performs better than $L_2$ regularized regression both in regression measurements and in the translation experiments using graph decoding. We present encouraging results when translating from German to English and Spanish to English. We also demonstrate results when the phrase table of a phrase-based decoder is replaced with the mappings we find with the regression model.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderMachine TranslationregressionTranslationSimilar Papers 제목 키워드 기반
Steerable Wavelet Scattering for 3D Atomic Systems with Application to Li-Si Energy Prediction
A general machine learning architecture is introduced that uses wavelet scattering coefficients of an inputted three dimensional signal as features. Solid harmonic wavelet scattering transforms of three dimensional signa…
BIG-bench Machine LearningFormation EnergyregressionOnline optimisation of log-linear weights in interactive machine translation
Whenever the quality provided by a machine translation system is not enough, a human expert is required to correct the sentences provided by the machine translation system. In such a setup, it is crucial that the system …
Language ModellingMachine TranslationregressionTranslationQuality Estimation and Translation Metrics via Pre-trained Word and Sentence Embeddings
We propose the use of pre-trained embeddings as features of a regression model for sentence-level quality estimation of machine translation. In our work we combine freely available BERT and LASER multilingual embeddings …
Machine TranslationregressionSentenceSentence Embeddings+1PETCI: A Parallel English Translation Dataset of Chinese Idioms
Idioms are an important language phenomenon in Chinese, but idiom translation is notoriously hard. Current machine translation models perform poorly on idiom translation, while idioms are sparse in many translation datas…
Machine TranslationTranslationSparseChem: Fast and accurate machine learning model for small molecules
SparseChem provides fast and accurate machine learning models for biochemical applications. Especially, the package supports very high-dimensional sparse inputs, e.g., millions of features and millions of compounds. It i…
BIG-bench Machine Learningregression