Tree Structured Dirichlet Processes for Hierarchical Morphological Segmentation

2018-06-01 · CL 2018 6 · Burcu Can, Man, Suresh har

This article presents a probabilistic hierarchical clustering model for morphological segmentation. In contrast to existing approaches to morphology learning, our method allows learning hierarchical organization of word morphology as a collection of tree structured paradigms. The model is fully unsupervised and based on the hierarchical Dirichlet process. Tree hierarchies are learned along with the corresponding morphological paradigms simultaneously. Our model is evaluated on Morpho Challenge and shows competitive performance when compared to state-of-the-art unsupervised morphological segmentation systems. Although we apply this model for morphological segmentation, the model itself can also be used for hierarchical clustering of other types of data.

📄 PDF Abstract BibTeX

Code (1)

burcu-can/TreeStructuredDP 공식 구현

Tasks

ClusteringInformation Retrieval Machine Translation Question Answering Segmentation

Dirichlet Fragmentation Processes

2015-09-16 · Hong Ge, Yarin Gal, Zoubin Ghahramani

Tree structures are ubiquitous in data across many domains, and many datasets are naturally modelled by unobserved tree structures. In this paper, first we review the theory of random fragmentation processes [Bertoin, 20…

Clustering

A Probabilistic Generative Grammar for Semantic Parsing

2016-06-20 · CONLL 2017 8 · Abulhair Saparov

Domain-general semantic parsing is a long-standing goal in natural language processing, where the semantic parser is capable of robustly parsing sentences from domains outside of which it was trained. Current approaches …

Natural Language Understanding Semantic Parsing Sentence Structured Prediction

Vectorized Bayesian Inference for Latent Dirichlet-Tree Allocation

2026-02-21 · Zheng Wang, Nizar Bouguila arxiv

Latent Dirichlet Allocation (LDA) is a foundational model for discovering latent thematic structure in discrete data, but its Dirichlet prior cannot represent the rich correlations and hierarchical relationships often pr…

Computational Efficiency Bayesian Inference

Nested Hierarchical Dirichlet Processes

2012-10-25 · John Paisley, Chong Wang, David M. Blei, Michael. I. Jordan

We develop a nested hierarchical Dirichlet process (nHDP) for hierarchical topic modeling. The nHDP is a generalization of the nested Chinese restaurant process (nCRP) that allows each word to follow its own path to a to…

Variational Inference

Hierarchical Latent Word Clustering

2016-01-20 · Halid Ziya Yerebakan, Fitsum Reda, Yiqiang Zhan, Yoshihisa Shinagawa

This paper presents a new Bayesian non-parametric model by extending the usage of Hierarchical Dirichlet Allocation to extract tree structured word clusters from text data. The inference algorithm of the model collects w…