paper-with-me

홈 › Papers

Information Lattice Learning

2021-01-01 · Haizi Yu, James Evans, Lav R. Varshney

Information Lattice Learning (ILL) is a general framework to learn decomposed representations, called rules, of a signal such as an image or a probability distribution. Each rule is a coarsened signal used to gain some human-interpretable insight into what might govern the nature of the original signal. To summarize the signal, we need several disentangled rules arranged in a hierarchy, formalized by a lattice structure. ILL focuses on explainability and generalizability from "small data", and aims for rules akin to those humans distill from experience (rather than a representation optimized for a specific task like classification). This paper focuses on a mathematical and algorithmic presentation of ILL, then demonstrates how ILL addresses the core question "what makes X an X" or "what makes X different from Y" to create effective, rule-based explanations designed to help human learners understand. The key part here is \emph{what} rather than tasks like generating X or predicting labels X,Y. Typical applications of ILL are presented for artistic and scientific knowledge discovery. These use ILL to learn music theory from scores and chemical laws from molecule data, revealing relationships between domains. We include initial benchmarks and assessments for ILL to demonstrate efficacy.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

FLAT: Chinese NER Using Flat-Lattice Transformer

2020-04-24 · ACL 2020 6 · Xiaonan Li, Hang Yan, Xipeng Qiu, Xuanjing Huang

Recently, the character-word lattice structure has been proved to be effective for Chinese named entity recognition (NER) by incorporating the word information. However, since the lattice structure is complex and dynamic…

Chinese Named Entity Recognitionnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+2

A representation theorem for events within lattice structures of state-spaces

2025-05-24 · Alex A. T. Rathke

For the standard lattice model of information structures, we derive a reduced poset representation which provides the same informational content as the complete lattice structure which derives it. Rational agents can rec…

Subword Encoding in Lattice LSTM for Chinese Word Segmentation

2018-10-30 · NAACL 2019 6 · Jie Yang, Yue Zhang, Shuailong Liang

We investigate a lattice LSTM network for Chinese word segmentation (CWS) to utilize words or subwords. It integrates the character sequence features with all subsequences information matched from a lexicon. The matched …

Chinese Word SegmentationWord Embeddings

Geometric lattice structure of covering and its application to attribute reduction through matroids

2013-12-16 · Aiping Huang, William Zhu

The reduction of covering decision systems is an important problem in data mining, and covering-based rough sets serve as an efficient technique to process the problem. Geometric lattices have been widely used in many fi…

Attribute

Lattice-BERT: Leveraging Multi-Granularity Representations in Chinese Pre-trained Language Models

2021-04-15 · NAACL 2021 4 · Yuxuan Lai, Yijia Liu, Yansong Feng, Songfang Huang 외

Chinese pre-trained language models usually process text as a sequence of characters, while ignoring more coarse granularity, e.g., words. In this work, we propose a novel pre-training paradigm for Chinese -- Lattice-BER…

Natural Language UnderstandingSentence