paper-with-me

홈 › Papers

Joint Space Neural Probabilistic Language Model for Statistical Machine Translation

2013-01-16 · Tsuyoshi Okita

A neural probabilistic language model (NPLM) provides an idea to achieve the better perplexity than n-gram language model and their smoothed language models. This paper investigates application area in bilingual NLP, specifically Statistical Machine Translation (SMT). We focus on the perspectives that NPLM has potential to open the possibility to complement potentially huge' monolingual resources into the resource-constraint' bilingual resources. We introduce an ngram-HMM language model as NPLM using the non-parametric Bayesian construction. In order to facilitate the application to various tasks, we propose the joint space model of ngram-HMM language model. We show an experiment of system combination in the area of SMT. One discovery was that our treatment of noise improved the results 0.20 BLEU points if NPLM is trained in relatively small corpus, in our case 500,000 sentence pairs, which is often the case due to the long training time of NPLM.

📄 PDF Abstract BibTeX arXiv:1301.3614

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage ModellingMachine TranslationSentenceTranslation

Methods 이 논문이 사용한 방법론

Neural Probabilistic Language Model 설명 없음

Similar Papers 제목 키워드 기반

Hamiltonian Monte Carlo for Probabilistic Programs with Discontinuities

2018-04-07 · Bradley Gram-Hansen, Yuan Zhou, Tobias Kohn, Tom Rainforth 외

Hamiltonian Monte Carlo (HMC) is arguably the dominant statistical inference algorithm used in most popular "first-order differentiable" Probabilistic Programming Languages (PPLs). However, the fact that HMC uses derivat…

Probabilistic Programming

Probabilistic Vision-Language Representation for Weakly Supervised Temporal Action Localization

2024-08-12 · Geuntaek Lim, Hyunwoo Kim, Joonsoo Kim, Yukyung Choi

Weakly supervised temporal action localization (WTAL) aims to detect action instances in untrimmed videos using only video-level annotations. Since many existing works optimize WTAL models based on action classification …

Action ClassificationAction LocalizationContrastive LearningTemporal Action Localization+1

Automated Statistical Model Discovery with Language Models

2024-02-27 · Michael Y. Li, Emily B. Fox, Noah D. Goodman

Statistical model discovery is a challenging search over a vast space of models subject to domain-specific constraints. Efficiently searching over this space requires expertise in modeling and the problem domain. Motivat…

Language ModellingmodelModel Discovery

Static Analysis for Probabilistic Programs

2019-09-10 · Ryan Bernstein

Probabilistic programming is a powerful abstraction for statistical machine learning. Applying static analysis methods to probabilistic programs could serve to optimize the learning process, automatically verify properti…

BIG-bench Machine LearningProbabilistic Programming

A Case for Quantifying Statistical Robustness of Specialized Probabilistic AI Accelerators

2019-10-27 · Xiangyu Zhang, Sayan Mukherjee, Alvin R. Lebeck

Statistical machine learning often uses probabilistic algorithms, such as Markov Chain Monte Carlo (MCMC), to solve a wide range of problems. Many accelerators are proposed using specialized hardware to address sampling …

Diagnostic