paper-with-me

Papers

A Bionic Natural Language Parser Equivalent to a Pushdown Automaton

2024-04-26 · Zhenghao Wei, Kehua Lin, Jianlin Feng

Assembly Calculus (AC), proposed by Papadimitriou et al., aims to reproduce advanced cognitive functions through simulating neural activities, with several applications based on AC having been developed, including a natural language parser proposed by Mitropolsky et al. However, this parser lacks the ability to handle Kleene closures, preventing it from parsing all regular languages and rendering it weaker than Finite Automata (FA). In this paper, we propose a new bionic natural language parser (BNLP) based on AC and integrates two new biologically rational structures, Recurrent Circuit and Stack Circuit which are inspired by RNN and short-term memory mechanism. In contrast to the original parser, the BNLP can fully handle all regular languages and Dyck languages. Therefore, leveraging the Chomsky-Sch \H{u}tzenberger theorem, the BNLP which can parse all Context-Free Languages can be constructed. We also formally prove that for any PDA, a Parser Automaton corresponding to BNLP can always be formed, ensuring that BNLP has a description ability equal to that of PDA and addressing the deficiencies of the original parser.

📄 PDF Abstract BibTeX arXiv:2404.17343

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Convergence and Diversity in the Control Hierarchy

2023-06-06 · Alexandra Butoi, Ryan Cotterell, David Chiang

Weir has defined a hierarchy of language classes whose second member ($\mathcal{L}_2$) is generated by tree-adjoining grammars (TAG), linear indexed grammars (LIG), combinatory categorial grammars, and head grammars. The…

DiversityTAG

Efficient Algorithms for Recognizing Weighted Tree-Adjoining Languages

2023-10-23 · Alexandra Butoi, Tim Vieira, Ryan Cotterell, David Chiang

The class of tree-adjoining languages can be characterized by various two-level formalisms, consisting of a context-free grammar (CFG) or pushdown automaton (PDA) controlling another CFG or PDA. These four formalisms are…

TAG

Algorithms for Weighted Pushdown Automata

2022-10-13 · Alexandra Butoi, Brian DuSell, Tim Vieira, Ryan Cotterell 외

Weighted pushdown automata (WPDAs) are at the core of many natural language processing tasks, like syntax-based statistical machine translation and transition-based dependency parsing. As most existing dynamic programmin…

Dependency ParsingMachine TranslationTransition-Based Dependency Parsing

Pushdown Layers: Encoding Recursive Structure in Transformer Language Models

2023-10-29 · Shikhar Murty, Pratyusha Sharma, Jacob Andreas, Christopher D. Manning

Recursion is a prominent feature of human language, and fundamentally challenging for self-attention due to the lack of an explicit recursive-state tracking mechanism. Consequently, Transformer language models poorly cap…

text-classificationText Classification

The Neural Network Pushdown Automaton: Model, Stack and Learning Simulations

2017-11-15 · G. Z. Sun, C. L. Giles, H. H. Chen, Y. C. Lee

In order for neural networks to learn complex languages or grammars, they must have sufficient computational power or resources to recognize or generate such languages. Though many approaches have been discussed, one ob-…

Quantization