Better heads do not guarantee better binarized constituency parsing
We revisit punctuation-aware tree binarization for constituency parsing and ask whether dependency-induced headedness improves binary parser supervision. Although learned heads substantially outperform rule-based heads in intrinsic head prediction, they do not yield consistent parsing gains after debinarization. In particular, punctuation-conditioned evaluation shows that learned headedness underperforms rule-based binarization in macro-average punctuation-sensitive $F_1$, despite a small overall gain on CTB. Similar instability appears under cross-treebank transfer. These results suggest that \ycc{linguistically grounded} headedness is not necessarily parser-optimal when used as a binarization control signal. The paper presents a negative result: better head prediction does not imply better punctuation-sensitive constituency parsing.
Code (0)
등록된 구현이 없습니다.
Tasks
Constituency ParsingSimilar Papers 제목 키워드 기반
Have Attention Heads in BERT Learned Constituency Grammar?
With the success of pre-trained language models in recent years, more and more researchers focus on opening the "black box" of these models. Following this interest, we carry out a qualitative and quantitative analysis o…
Natural Language InferenceNatural Language UnderstandingQQPSentenceTree LSTMs with Convolution Units to Predict Stance and Rumor Veracity in Social Media Conversations
Learning from social-media conversations has gained significant attention recently because of its applications in areas like rumor detection. In this research, we propose a new way to represent social-media conversations…
ClassificationGeneral ClassificationStance ClassificationVeracity ClassificationHeads-up! Unsupervised Constituency Parsing via Self-Attention Heads
Transformer-based pre-trained language models (PLMs) have dramatically improved the state of the art in NLP across many tasks. This has led to substantial interest in analyzing the syntactic knowledge PLMs learn. Previou…
Constituency ParsingBinarized Neural Networks on the ImageNet Classification Task
We trained Binarized Neural Networks (BNNs) on the high resolution ImageNet ILSVRC-2102 dataset classification task and achieved a good performance. With a moderate size network of 13 layers, we obtained top-5 classifica…
ClassificationGeneral Classification