paper-with-me

홈 › Papers

Sequence-to-sequence Models for Cache Transition Systems

2018-07-01 · ACL 2018 7 · Xiaochang Peng, Linfeng Song, Daniel Gildea, Giorgio Satta

In this paper, we present a sequence-to-sequence based approach for mapping natural language sentences to AMR semantic graphs. We transform the sequence to graph mapping problem to a word sequence to transition action sequence problem using a special transition system called a cache transition system. To address the sparsity issue of neural AMR parsing, we feed feature embeddings from the transition state to provide relevant local information for each decoder state. We present a monotonic hard attention model for the transition framework to handle the strictly left-to-right alignment between each transition state and the current buffer input focus. We evaluate our neural transition model on the AMR parsing task, and our parser outperforms other sequence-to-sequence approaches and achieves competitive results in comparison with the best-performing models.

📄 PDF Abstract BibTeX

Code (1)

xiaochang13/CacheTransition-Seq2seq 공식 구현 tf

Tasks

AMR ParsingDecoderHard AttentionSentence CompressionText Summarization

Similar Papers 제목 키워드 기반

AMR-to-Text Generation with Cache Transition Systems

2019-12-03 · Lisa Jin, Daniel Gildea

Text generation from AMR involves emitting sentences that reflect the meaning of their AMR annotations. Neural sequence-to-sequence models have successfully been used to decode strings from flattened graphs (e.g., using …

AMR-to-Text GenerationDecoderSentenceText Generation

A Transition-based Parser for Unscoped Episodic Logical Forms

2021-03-15 · IWCS (ACL) 2021 6 · Gene Louis Kim, Viet Duong, Xin Lu, Lenhart Schubert

"Episodic Logic:Unscoped Logical Form" (EL-ULF) is a semantic representation capturing predicate-argument structure as well as more challenging aspects of language within the Episodic Logic formalism. We present the firs…

Attamba: Attending To Multi-Token States

2024-11-26 · Yash Akhauri, Safeen Huda, Mohamed S. Abdelfattah

When predicting the next token in a sequence, vanilla transformers compute attention over all previous tokens, resulting in quadratic scaling of compute with sequence length. State-space models compress the entire sequen…

ChunkingState Space Models

TreeKV: Smooth Key-Value Cache Compression with Tree Structures

2025-01-09 · Ziwei He, Jian Yuan, Haoli Bai, Jingwen Leng 외

Efficient key-value (KV) cache compression is critical for scaling transformer-based Large Language Models (LLMs) in long sequences and resource-limited settings. Existing methods evict tokens based on their positions or…

Language ModelingLanguage Modelling

Cacheback: Speculative Decoding With Nothing But Cache

2025-11-15 · Zhiyao Ma, In Gim, Lin Zhong arxiv

We present Cacheback Decoding, a training-free and model-agnostic speculative decoding method that exploits the locality in language to accelerate Large Language Model (LLM) inference. Cacheback leverages only Least Rece…