paper-with-me

홈 › Papers

Model-to-Model Knowledge Transmission (M2KT): A Data-Free Framework for Cross-Model Understanding Transfer

2025-11-19 · Pratham Sorte arxiv

Modern artificial intelligence systems depend heavily on large datasets for both training and transferring knowledge between models. Knowledge distillation, transfer learning, and dataset distillation have made such transfers more efficient, yet they remain fundamentally data-driven: a teacher must produce examples, logits, or gradients for a student to learn. In this work, we introduce Model-to-Model Knowledge Transmission (M2KT), a novel paradigm for data-free conceptual transfer between neural networks. M2KT enables models to exchange knowledge packets that encapsulate structured concept embeddings, abstraction graphs, reasoning traces, and provenance metadata. Unlike classical distillation, M2KT operates primarily in concept space rather than example space, and it does not require labeled datasets or teacher-generated outputs during transfer. We formalize the notion of concept manifolds, introduce an inter-model alignment mapping between teacher and student latent spaces, and derive a composite loss that enforces geometric, structural, and reasoning consistency together with explicit safety constraints. We further present algorithmic procedures for teacher-side packet generation and student-side ingestion and verification. Experiments on symbolic reasoning with large language models show that M2KT can achieve approximately 85 to 90 percent of teacher performance while reducing data usage by over 98 percent compared to standard knowledge distillation. This work establishes a theoretical and practical foundation for data-free AI-to-AI knowledge transfer and self-improving model ecosystems.

📄 PDF Abstract BibTeX arXiv:2511.17638

Code (0)

등록된 구현이 없습니다.

Tasks

Knowledge DistillationTransfer Learning

Similar Papers 제목 키워드 기반

Direction Finding for a Mixture of Single-Transmission and Dual-Transmission Signals

2019-12-21

Currently, most of existing research in direction of arrival (DOA) estimation is focused on single signal transmission (SST) based signal. However, to make full use of the degree of freedom provided by the system in the …

Capacity and Achievable Rates of Fading Few-mode MIMO IM/DD Optical Fiber Channels

2022-01-27 · Metodi P. Yankov, Francesco Da Ros, Søren Forchhammer, Lars Gruner-Nielsen

The optical fiber multiple-input multiple-output (MIMO) channel with intensity modulation and direct detection (IM/DD) per spatial path is treated. The spatial dimensions represent the multiple modes employed for transmi…

Single image dehazing via combining the prior knowledge and CNNs

2021-11-10 · Yuwen Li, Chaobing Zheng, Shiqian Wu, Wangming Xu

Aiming at the existing single image haze removal algorithms, which are based on prior knowledge and assumptions, subject to many limitations in practical applications, and could suffer from noise and halo amplification. …

Image DehazingSingle Image DehazingSingle Image Haze Removal

Neutron Transmission Strain Tomography for Non-Constant Stress-Free Lattice Spacing

2019-05-15 · J. N. Hendriks, C. Jidling, T. B. Schön, A. Wills 외

Recently, several algorithms for strain tomography from energy-resolved neutron transmission measurements have been proposed. These methods assume that the stress-free lattice spacing $d_0$ is a known constant limiting t…

User Subgrouping in Scalable Cell-Free Massive MIMO Multicasting Systems

2024-09-18 · Alejandro de la Fuente, Guillem Femenias, Felip Riera-Palou, Giovanni Interdonato

Cell-free massive multiple-input multiple-output (CF-mMIMO) is a breakthrough technology for beyond-5G systems, designed to significantly boost the energy and spectral efficiencies of future mobile networks while ensurin…