Discriminative Lexical Semantic Segmentation with Gaps: Running the MWE Gamut
We present a novel representation, evaluation measure, and supervised models for the task of identifying the multiword expressions (MWEs) in a sentence, resulting in a lexical semantic segmentation. Our approach generalizes a standard chunking representation to encode MWEs containing gaps, thereby enabling efficient sequence tagging algorithms for feature-rich discriminative models. Experiments on a new dataset of English web text offer the first linguistically-driven evaluation of MWE identification with truly heterogeneous expression types. Our statistical sequence model greatly outperforms a lookup-based segmentation procedure, achieving nearly 60{\%} F1 for MWE identification.
Code (0)
등록된 구현이 없습니다.
Tasks
ChunkingSegmentationSemantic SegmentationSentenceSimilar Papers 제목 키워드 기반
Lexical Gaps and Lexicalization: Implications for Word Segmentation Systems for Chinese NLP
ELKPPNet: An Edge-aware Neural Network with Large Kernel Pyramid Pooling for Learning Discriminative Features in Semantic Segmentation
Semantic segmentation has been a hot topic across diverse research fields. Along with the success of deep convolutional neural networks, semantic segmentation has made great achievements and improvements, in terms of bot…
DecoderScene ParsingSegmentationSemantic SegmentationUsing Linguistic Typology to Enrich Multilingual Lexicons: the Case of Lexical Gaps in Kinship
This paper describes a method to enrich lexical resources with content relating to linguistic diversity, based on knowledge from the field of lexical typology. We capture the phenomenon of diversity through the notions o…
DiversityMachine TranslationTranslationDiscovering Lexical Gaps Using Embeddings from Multilingual LLMs
Lexical gaps are words that do not exist in certain languages. They pose challenges for building multilingual lexical resources, for machine translation, and for cross-lingual transfer. Existing lexical gap detection rel…
Cross-Lingual TransferSemantic SimilarityMachine TranslationMaking Training-Free Diffusion Segmentors Scale with the Generative Power
As powerful generative models, text-to-image diffusion models have recently been explored for discriminative tasks. A line of research focuses on adapting a pre-trained diffusion model to semantic segmentation without an…
Semantic Segmentation