Text Segmentation by Language Using Minimum Description Length
Code (0)
등록된 구현이 없습니다.
Tasks
Language ModellingText SegmentationSimilar Papers 제목 키워드 기반
Minimum Description Length Recurrent Neural Networks
We train neural networks to optimize a Minimum Description Length score, i.e., to balance between the complexity of the network and its accuracy at a task. We show that networks optimizing this objective function master …
Skill Reuse as Compression in Agentic RL
Large language model agents trained with reinforcement learning (RL) often learn brittle, task-specific shortcuts. We hypothesize that agents generalize better when their successful trajectories are structurally compress…
Reinforcement LearningInterpolation Learning With Minimum Description Length
We prove that the Minimum Description Length learning rule exhibits tempered overfitting. We obtain tempered agnostic finite sample learning guarantees and characterize the asymptotic behavior in the presence of random l…
MIDGARD: Self-Consistency Using Minimum Description Length for Structured Commonsense Reasoning
We study the task of conducting structured reasoning as generating a reasoning graph from natural language input using large language models (LLMs). Previous approaches have explored various prompting schemes, yet they s…
Graph GenerationMissing ElementsA tutorial introduction to the minimum description length principle
This tutorial provides an overview of and introduction to Rissanen's Minimum Description Length (MDL) Principle. The first chapter provides a conceptual, entirely non-technical introduction to the subject. It serves as a…