BP-Seg: A graphical model approach to unsupervised and non-contiguous text segmentation using belief propagation
Text segmentation based on the semantic meaning of sentences is a fundamental task with broad utility in many downstream applications. In this paper, we propose a graphical model-based unsupervised learning approach, named BP-Seg for efficient text segmentation. Our method not only considers local coherence, capturing the intuition that adjacent sentences are often more related, but also effectively groups sentences that are distant in the text yet semantically similar. This is achieved through belief propagation on the carefully constructed graphical models. Experimental results on both an illustrative example and a dataset with long-form documents demonstrate that our method performs favorably compared to competing approaches.
Code (0)
등록된 구현이 없습니다.
Tasks
SegmentationText SegmentationSimilar Papers 제목 키워드 기반
Text Segmentation as a Supervised Learning Task
Text segmentation, the task of dividing a document into contiguous segments based on its semantic structure, is a longstanding challenge in language understanding. Previous work on text segmentation focused on unsupervis…
ClusteringSegmentationText SegmentationInference in Graphical Models via Semidefinite Programming Hierarchies
Maximum A posteriori Probability (MAP) inference in graphical models amounts to solving a graph-structured combinatorial optimization problem. Popular inference algorithms such as belief propagation (BP) and generalized …
Combinatorial OptimizationComputational EfficiencyDenoisingImage DenoisingStructured Summarization: Unified Text Segmentation and Segment Labeling as a Generation Task
Text segmentation aims to divide text into contiguous, semantically coherent segments, while segment labeling deals with producing labels for each segment. Past work has shown success in tackling segmentation and labelin…
DecoderSegmentationText SegmentationRethinking Semantic Segmentation Evaluation for Explainability and Model Selection
Semantic segmentation aims to robustly predict coherent class labels for entire regions of an image. It is a scene understanding task that powers real-world applications (e.g., autonomous navigation). One important appli…
Autonomous NavigationModel SelectionScene UnderstandingSegmentation+1Towards unsupervised phone and word segmentation using self-supervised vector-quantized neural networks
We investigate segmenting and clustering speech into low-bitrate phone-like sequences without supervision. We specifically constrain pretrained self-supervised vector-quantized (VQ) neural networks so that blocks of cont…
ClusteringSegmentation