paper-with-me

Papers

SEHFS: Structural Entropy-Guided High-Order Correlation Learning for Multi-View Multi-Label Feature Selection

2026-03-03 · Cheng Peng, Yonghao Li, Wanfu Gao, Jie Wen, Weiping Ding arxiv

In recent years, multi-view multi-label learning (MVML) has attracted extensive attention due to its close alignment to real-world scenarios. Information-theoretic methods have gained prominence for learning nonlinear correlations. However, two key challenges persist: first, features in real-world data commonly exhibit high-order structural correlations, but existing information-theoretic methods struggle to learn such correlations; second, commonly relying on heuristic optimization, information-theoretic methods are prone to converging to local optima. To address these two challenges, we propose a novel method called Structural Entropy Guided High-Order Correlation Learning for Multi-View Multi-Label Feature Selection (SEHFS). The core idea of SEHFS is to convert the feature graph into a structural-entropy-minimizing encoding tree, quantifying the information cost of high-order dependencies and thus learning high-order feature correlations beyond pairwise correlations. Specifically, features exhibiting strong high-order redundancy are grouped into a single cluster within the encoding tree, while inter-cluster feaeture correlations are minimized, thereby eliminating redundancy both within and across clusters. Furthermore, a new framework based on the fusion of information theory and matrix methods is adopted, which learns a shared semantic matrix and view-specific contribution matrices to reconstruct a global view matrix, thereby enhancing the information-theoretic method and balancing the global and local optimization. The ability of structural entropy to learn high-order correlations is theoretically established, and and both experiments on eight datasets from various domains and ablation studies demonstrate that SEHFS achieves superior performance in feature selection.

📄 PDF Abstract BibTeX arXiv:2603.03022

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-Label Learning

Similar Papers 제목 키워드 기반

Breaking Degradation Coupling: A Structural Entropy Guided Decoupled Framework and Benchmark for Infrared Enhancement

2026-04-24 · Pu Li, Huafeng Li, Yafei Zhang, Yu Liu 외 arxiv

Thermal infrared image enhancement aims to restore high-quality images from complex compound degradations. Existing all-in-one approaches typically employ a single shared backbone to handle diverse degradations, which ca…

Image Enhancement

SF-RAG: Structure-Fidelity Retrieval-Augmented Generation for Academic Question Answering

2026-02-14 · Rui Yu, Tianyi Wang, Ruixia Liu, Yinglong Wang arxiv

Efficient question-answering (QA) over extensive scientific literature is essential for evidence-based engineering decision-making. Retrieval-augmented generation (RAG) is increasingly applied to question-answering over …

Question Answering

Entropy-Guided k-Guard Sampling for Long-Horizon Autoregressive Video Generation

2026-01-27 · Yizhao Han, Tianxing Shi, Zhao Wang, Zifan Xu 외 arxiv

Autoregressive (AR) architectures have achieved significant successes in LLMs, inspiring explorations for video generation. In LLMs, top-p/top-k sampling strategies work exceptionally well: language tokens have high sema…

Video Generation

Structural Entropy Guided Probabilistic Coding

2024-12-12 · Xiang Huang, Hao Peng, Li Sun, Hui Lin 외

Probabilistic embeddings have several advantages over deterministic embeddings as they map each data point to a distribution, which better describes the uncertainty and complexity of data. Many works focus on adjusting t…

Natural Language UnderstandingregressionRepresentation Learning

Structural Entropy Guided Agent for Detecting and Repairing Knowledge Deficiencies in LLMs

2025-05-12 · Yifan Wei, Xiaoyan Yu, Tengfei Pan, Angsheng Li 외

Large language models (LLMs) have achieved unprecedented performance by leveraging vast pretraining corpora, yet their performance remains suboptimal in knowledge-intensive domains such as medicine and scientific researc…

AI AgentKnowledge DistillationKnowledge GraphsReinforcement Learning+1