paper-with-me

Papers

Structure Learning via Mutual Information

2024-09-21 · Jeremy Nixon

This paper presents a novel approach to machine learning algorithm design based on information theory, specifically mutual information (MI). We propose a framework for learning and representing functional relationships in data using MI-based features. Our method aims to capture the underlying structure of information in datasets, enabling more efficient and generalizable learning algorithms. We demonstrate the efficacy of our approach through experiments on synthetic and real-world datasets, showing improved performance in tasks such as function classification, regression, and cross-dataset transfer. This work contributes to the growing field of metalearning and automated machine learning, offering a new perspective on how to leverage information theory for algorithm design and dataset analysis and proposing new mutual information theoretic foundations to learning algorithms.

📄 PDF Abstract BibTeX arXiv:2409.14235

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Learning Discrete Structured Representations by Adversarially Maximizing Mutual Information

2020-04-08 · ICML 2020 1 · Karl Stratos, Sam Wiseman

We propose learning discrete structured representations from unlabeled data by maximizing the mutual information between a structured latent variable and a target variable. Calculating mutual information is intractable i…

A Neural Difference-of-Entropies Estimator for Mutual Information

2025-02-18 · Haoran Ni, Martin Lotz

Estimating Mutual Information (MI), a key measure of dependence of random quantities without specific modelling assumptions, is a challenging problem in high dimensions. We propose a novel mutual information estimator ba…

Efficient Sample-optimal Learning of Gaussian Tree Models via Sample-optimal Testing of Gaussian Mutual Information

2024-11-18 · Sutanu Gayen, Sanket Kale, Sayantan Sen

Learning high-dimensional distributions is a significant challenge in machine learning and statistics. Classical research has mostly concentrated on asymptotic analysis of such data under suitable assumptions. While exis…

Mutual-Structure for Joint Filtering

2015-12-01 · ICCV 2015 12 · Xiaoyong Shen, Chao Zhou, Li Xu, Jiaya Jia

Previous joint/guided filters directly transfer the structural information in the reference image to the target one. In this paper, we first analyze its major drawback -- that is, there may be completely different edges …

Depth CompletionImage EnhancementOptical Flow EstimationStereo Matching+1

Matching Text with Deep Mutual Information Estimation

2020-03-09 · Xixi Zhou, Chengxi Li, Jiajun Bu, Chengwei Yao 외

Text matching is a core natural language processing research problem. How to retain sufficient information on both content and structure information is one important challenge. In this paper, we present a neural approach…

Answer SelectionMutual Information EstimationNatural Language InferenceParaphrase Identification+1