paper-with-me

홈 › Papers

Generating Natural Language from Logic Expressions with Structural Representation

2023-04-04 · journal 2023 4 · Xin Wu; Yi Cai; Zetao Lian; Ho-fung Leung; Tao Wang

Incorporating logic reasoning with deep neural networks (DNNs) is an important challenge in machine learning. In this article, we study the problem of converting logical expressions into natural language. In particular, given a sequential logic expression, the goal is to generate its corresponding natural sentence. Since the information in a logic expression often has a hierarchical structure, a sequence-to-sequence baseline struggles to capture the full dependencies between words, and hence it often generates incorrect sentences. To alleviate this problem, we propose a model to convert Structural Logic Expressions into Natural Language (SLEtoNL). SLEtoNL converts sequential logic expressions into structural representation and leverages structural encoders to capture the dependencies between nodes. The quantitative and qualitative analyses demonstrate that our proposed method outperforms the seq2seq model, which is based on the sequential representation, and outperforms strong pretrained language models (e.g., T5, BART, GPT3) with a large margin (28.6 in BLEU3) in out-of-distribution evaluation.

📄 PDF Abstract BibTeX

Code (1)

2024-MindSpore-1/Code9/tree/main/amr2text mindspore

Tasks

Sentence

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Tanh Activation 설명 없음
Sigmoid Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Similar Papers 제목 키워드 기반

Tree-Based Representation and Generation of Natural and Mathematical Language

2023-02-15 · Alexander Scarlatos, Andrew Lan

Mathematical language in scientific communications and educational scenarios is important yet relatively understudied compared to natural languages. Recent works on mathematical language focus either on representing stan…

MathMathematical Reasoningvalid

FOL2NS: Generating Natural Sentences from First-Order Logic

2026-05-18 · Mei Jia arxiv

Translating formal language into natural language is a foundational challenge in NLP, driving various downstream applications in semantic parsing, theorem validation, and question answering. In this study, we introduce F…

Question AnsweringSemantic Parsing

TabVer: Tabular Fact Verification with Natural Logic

2024-11-02 · Rami Aly, Andreas Vlachos

Fact verification on tabular evidence incentivises the use of symbolic reasoning models where a logical form is constructed (e.g. a LISP-style program), providing greater verifiability than fully neural approaches. Howev…

Fact Verification

Structural Language Models for Any-Code Generation

2019-09-25 · Uri Alon, Roy Sadaka, Omer Levy, Eran Yahav

We address the problem of Any-Code Generation (AnyGen) - generating code without any restriction on the vocabulary or structure. The state-of-the-art in this problem is the sequence-to-sequence (seq2seq) approach, which …

C++ codeCode GenerationLanguage ModelingLanguage Modelling

SoftRegex: Generating Regex from Natural Language Descriptions using Softened Regex Equivalence

2019-11-01 · IJCNLP 2019 11 · Jun-U Park, Sang-Ki Ko, Marco Cognetta, Yo-Sub Han

We continue the study of generating se-mantically correct regular expressions from natural language descriptions (NL). The current state-of-the-art model SemRegex produces regular expressions from NLs by rewarding the re…