paper-with-me

Papers

KINDLE: Knowledge-Guided Distillation for Prior-Free Gene Regulatory Network Inference

2025-05-14 · Rui Peng, Yuchen Lu, Qichen Sun, Yuxing Lu, Chi Zhang, Ziru Liu, Jinzhuo Wang

Gene regulatory network (GRN) inference serves as a cornerstone for deciphering cellular decision-making processes. Early approaches rely exclusively on gene expression data, thus their predictive power remain fundamentally constrained by the vast combinatorial space of potential gene-gene interactions. Subsequent methods integrate prior knowledge to mitigate this challenge by restricting the solution space to biologically plausible interactions. However, we argue that the effectiveness of these approaches is contingent upon the precision of prior information and the reduction in the search space will circumscribe the models' potential for novel biological discoveries. To address these limitations, we introduce KINDLE, a three-stage framework that decouples GRN inference from prior knowledge dependencies. KINDLE trains a teacher model that integrates prior knowledge with temporal gene expression dynamics and subsequently distills this encoded knowledge to a student model, enabling accurate GRN inference solely from expression data without access to any prior. KINDLE achieves state-of-the-art performance across four benchmark datasets. Notably, it successfully identifies key transcription factors governing mouse embryonic development and precisely characterizes their functional roles. In mouse hematopoietic stem cell data, KINDLE accurately predicts fate transition outcomes following knockout of two critical regulators (Gata1 and Spi1). These biological validations demonstrate our framework's dual capability in maintaining topological inference precision while preserving discovery potential for novel biological mechanisms.

📄 PDF Abstract BibTeX arXiv:2505.09664

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Privileged Prior Information Distillation for Image Matting

2022-11-25 · Cheng Lyu, Jiake Xie, Bo Xu, Cheng Lu 외

Performance of trimap-free image matting methods is limited when trying to decouple the deterministic and undetermined regions, especially in the scenes where foregrounds are semantically ambiguous, chromaless, or high t…

Image Matting

Powerful Teachers Matter: Text-Guided Multi-view Knowledge Distillation with Visual Prior Enhancement

2026-03-25 · Xin Zhang, Jianyang Xu, Hao Peng, Dongjing Wang 외 arxiv

Knowledge distillation transfers knowledge from large teacher models to smaller students for efficient inference. While existing methods primarily focus on distillation strategies, they often overlook the importance of e…

Knowledge Distillation

Remembering Normality: Memory-guided Knowledge Distillation for Unsupervised Anomaly Detection

2023-01-01 · ICCV 2023 10 · Zhihao Gu, Liang Liu, Xu Chen, Ran Yi 외

Knowledge distillation (KD) has been widely explored in unsupervised anomaly detection (AD). The student is assumed to constantly produce representations of typical patterns within trained data, named "normality", an…

Anomaly DetectionKnowledge DistillationUnsupervised Anomaly Detection

Seeing the Whole Picture: Distribution-Guided Data-Free Distillation for Semantic Segmentation

2025-12-15 · Hongxuan Sun, Tao Wu arxiv

Semantic segmentation requires a holistic understanding of the physical world, as it assigns semantic labels to spatially continuous and structurally coherent objects rather than to isolated pixels. However, existing dat…

Data-free Knowledge DistillationSemantic Segmentation

ManifoldGD: Training-Free Hierarchical Manifold Guidance for Diffusion-Based Dataset Distillation

2026-02-26 · Ayush Roy, Wei-Yang Alex Lee, Rudrasis Chakraborty, Vishnu Suresh Lokhande arxiv

In recent times, large datasets hinder efficient model training while also containing redundant concepts. Dataset distillation aims to synthesize compact datasets that preserve the knowledge of large-scale training sets …