Syntactic Structure from Deep Learning
Modern deep neural networks achieve impressive performance in engineering applications that require extensive linguistic skills, such as machine translation. This success has sparked interest in probing whether these models are inducing human-like grammatical knowledge from the raw data they are exposed to, and, consequently, whether they can shed new light on long-standing debates concerning the innate structure necessary for language acquisition. In this article, we survey representative studies of the syntactic abilities of deep networks, and discuss the broader implications that this work has for theoretical linguistics.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep LearningLanguage AcquisitionMachine TranslationTranslationSimilar Papers 제목 키워드 기반
Tree-Planted Transformers: Unidirectional Transformer Language Models with Implicit Syntactic Supervision
Syntactic Language Models (SLMs) can be trained efficiently to reach relatively high performance; however, they have trouble with inference efficiency due to the explicit generation of syntactic structures. In this paper…
Continual LearningSyntactic Structure Processing in the Brain while Listening
Syntactic parsing is the task of assigning a syntactic structure to a sentence. There are two popular syntactic parsing methods: constituency and dependency parsing. Recent works have used syntactic embeddings based on c…
Activity PredictionDependency ParsingSentenceAutomatic Refinement of Syntactic Categories in Chinese Word Structures
Annotated word structures are useful for various Chinese NLP tasks, such as word segmentation, POS tagging and syntactic parsing. Chinese word structures are often represented by binary trees, the nodes of which are labe…
Chinese Word SegmentationPOSPOS TaggingSegmentationLeveraging Partial Dependency Trees to Control Image Captions
Controlling the generation of image captions attracts lots of attention recently. In this paper, we propose a framework leveraging partial syntactic dependency trees as control signals to make image captions include spec…
Image CaptioningSyntactic representation learning for neural network based TTS with syntactic parse tree traversal
Syntactic structure of a sentence text is correlated with the prosodic structure of the speech that is crucial for improving the prosody and naturalness of a text-to-speech (TTS) system. Nowadays TTS systems usually try …
DiversityRepresentation LearningSentencetext-to-speech+1