paper-with-me

홈 › Papers

Neural Lattice-to-Sequence Models for Uncertain Inputs

2017-04-03 · EMNLP 2017 9 · Matthias Sperber, Graham Neubig, Jan Niehues, Alex Waibel

The input to a neural sequence-to-sequence model is often determined by an up-stream system, e.g. a word segmenter, part of speech tagger, or speech recognizer. These up-stream models are potentially error-prone. Representing inputs through word lattices allows making this uncertainty explicit by capturing alternative sequences and their posterior probabilities in a compact form. In this work, we extend the TreeLSTM (Tai et al., 2015) into a LatticeLSTM that is able to consume word lattices, and can be used as encoder in an attentional encoder-decoder model. We integrate lattice posterior scores into this architecture by extending the TreeLSTM's child-sum and forget gates and introducing a bias term into the attention mechanism. We experiment with speech translation lattices and report consistent improvements over baselines that translate either the 1-best hypothesis or the lattice without posterior scores.

📄 PDF Abstract BibTeX arXiv:1704.00559

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderTranslation

Similar Papers 제목 키워드 기반

Self-Attentional Models for Lattice Inputs

2019-06-04 · ACL 2019 7 · Matthias Sperber, Graham Neubig, Ngoc-Quan Pham, Alex Waibel

Lattices are an efficient and effective method to encode ambiguity of upstream systems in natural language processing tasks, for example to compactly capture multiple speech recognition hypotheses, or to represent multip…

Computational Efficiencyspeech-recognitionSpeech RecognitionTranslation

Subword Encoding in Lattice LSTM for Chinese Word Segmentation

2018-10-30 · NAACL 2019 6 · Jie Yang, Yue Zhang, Shuailong Liang

We investigate a lattice LSTM network for Chinese word segmentation (CWS) to utilize words or subwords. It integrates the character sequence features with all subsequences information matched from a lexicon. The matched …

Chinese Word SegmentationWord Embeddings

Reducing fuzzy relation equations via concept lattices

2024-10-08 · David Lobo, Víctor López-Marchante, Jesús Medina

This paper has taken into advantage the relationship between Fuzzy Relation Equations (FRE) and Concept Lattices in order to introduce a procedure to reduce a FRE, without losing information. Specifically, attribute redu…

AttributeRelation

Lattice Transformer for Speech Translation

2019-06-13 · ACL 2019 7 · Pei Zhang, Boxing Chen, Niyu Ge, Kai Fan

Recent advances in sequence modeling have highlighted the strengths of the transformer architecture, especially in achieving state-of-the-art machine translation results. However, depending on the up-stream systems, e.g.…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Machine Translationspeech-recognition+2

Chain-based Adaptive Reconfiguration Over Lattices for Hallucination Reduction

2026-05-26 · Joan Vendrell Gallart, Solmaz Kia, Russell Bent, Michael Grosskopf arxiv

We introduce CAROL (Chain-based Adaptive Reconfiguration Over Lattices), a probabilistic framework for test-time hallucination reduction in large language models. Rather than relying on token-level uncertainty, CAROL def…

Computational EfficiencyQuestion Answering