paper-with-me

Papers

Efficient Constituency Tree based Encoding for Natural Language to Bash Translation

2022-07-01 · NAACL 2022 7 · Shikhar Bharadwaj, Shirish Shevade

Bash is a Unix command language used for interacting with the Operating System. Recent works on natural language to Bash translation have made significant advances, but none of the previous methods utilize the problem’s inherent structure. We identify this structure andpropose a Segmented Invocation Transformer (SIT) that utilizes the information from the constituency parse tree of the natural language text. Our method is motivated by the alignment between segments in the natural language text and Bash command components. Incorporating the structure in the modelling improves the performance of the model. Since such systems must be universally accessible, we benchmark the inference times on a CPU rather than a GPU. We observe a 1.8x improvement in the inference time and a 5x reduction in model parameters. Attribution analysis using Integrated Gradients reveals that the proposed method can capture the problem structure.

📄 PDF Abstract BibTeX

Code (1)

shikhar-s/segmented-invocation-transformer 공식 구현

Tasks

CPUGPUTranslation

Similar Papers 제목 키워드 기반

Improving Tree-LSTM with Tree Attention

2019-01-01 · Mahtab Ahmed, Muhammad Rifayat Samee, Robert E. Mercer

In Natural Language Processing (NLP), we often need to extract information from tree topology. Sentence structure can be represented via a dependency tree or a constituency tree structure. For this reason, a variant of L…

Sentence

Explainable Natural Language to Bash Translation using Abstract Syntax Tree

2021-11-01 · CoNLL (EMNLP) 2021 11 · Shikhar Bharadwaj, Shirish Shevade

Natural language processing for program synthesis has been widely researched. In this work, we focus on generating Bash commands from natural language invocations with explanations. We propose a novel transformer based s…

Program SynthesisTranslation

CPTAM: Constituency Parse Tree Aggregation Method

2022-01-19 · Adithya Kulkarni, Nasim Sabetpour, Alexey Markin, Oliver Eulenstein 외

Diverse Natural Language Processing tasks employ constituency parsing to understand the syntactic structure of a sentence according to a phrase structure grammar. Many state-of-the-art constituency parsers are proposed, …

Constituency ParsingSentence

Constituency Parsing using LLMs

2023-10-30 · Xuefeng Bai, Jialong Wu, Yulong Chen, Zhongqing Wang 외

Constituency parsing is a fundamental yet unsolved natural language processing task. In this paper, we explore the potential of recent large language models (LLMs) that have exhibited remarkable performance across variou…

Constituency Parsing

Constituency Lattice Encoding for Aspect Term Extraction

2020-12-01 · COLING 2020 8 · Yunyi Yang, Kun Li, Xiaojun Quan, Weizhou Shen 외

One of the remaining challenges for aspect term extraction in sentiment analysis resides in the extraction of phrase-level aspect terms, which is non-trivial to determine the boundaries of such terms. In this paper, we a…

Aspect Term Extraction and Sentiment ClassificationSentenceSentiment AnalysisTerm Extraction