Neural Network based Deep Transfer Learning for Cross-domain Dependency Parsing
In this paper, we describe the details of the neural dependency parser sub-mitted by our team to the NLPCC 2019 Shared Task of Semi-supervised do-main adaptation subtask on Cross-domain Dependency Parsing. Our system is based on the stack-pointer networks(STACKPTR). Considering the im-portance of context, we utilize self-attention mechanism for the representa-tion vectors to capture the meaning of words. In addition, to adapt three dif-ferent domains, we utilize neural network based deep transfer learning which transfers the pre-trained partial network in the source domain to be a part of deep neural network in the three target domains (product comments, product blogs and web fiction) respectively. Results on the three target domains demonstrate that our model performs competitively.
Code (0)
등록된 구현이 없습니다.
Tasks
Dependency ParsingTransfer LearningSimilar Papers 제목 키워드 기반
Unsupervised Domain Adaptation Method with Semantic-Structural Alignment for Dependency Parsing
Unsupervised cross-domain dependency parsing is to accomplish domain adaptation for dependency parsing without using labeled data in target domain. Existing methods are often of the pseudo-annotation type, which generate…
Dependency ParsingDomain AdaptationUnsupervised Domain AdaptationCross-Lingual Dependency Parsing via Self-Training
Recent advances of multilingual word representations weaken the input divergences across languages, making cross-lingual transfer similar to the monolingual cross-domain and semi-supervised settings. Thus self-training, …
Cross-Lingual POS TaggingCross-Lingual TransferDependency ParsingPOS+1Project-then-Transfer: Effective Two-stage Cross-lingual Transfer for Semantic Dependency Parsing
This paper describes the first report on cross-lingual transfer for semantic dependency parsing. We present the insight that there are twodifferent kinds of cross-linguality, namely sur-face level and mantic level, and t…
Cross-Lingual TransferDependency ParsingSemantic Dependency ParsingAPGN: Adversarial and Parameter Generation Networks for Multi-Source Cross-Domain Dependency Parsing
Thanks to the strong representation learning capability of deep learning, especially pre-training techniques with language model loss, dependency parsing has achieved great performance boost in the in-domain scenario wit…
Dependency ParsingLanguage ModelingLanguage ModellingRepresentation LearningCross-Lingual Dependency Parsing Using Code-Mixed TreeBank
Treebank translation is a promising method for cross-lingual transfer of syntactic dependency knowledge. The basic idea is to map dependency arcs from a source treebank to its target translation according to word alignme…
Cross-Lingual TransferCross-Lingual Word EmbeddingsDependency ParsingTranslation+1