paper-with-me

홈 › Papers

AS-FedBridge: Pseudo-Spike Bridge Distillation for Heterogeneous ANN-SNN Federated Learning

2026-08-04 · Shengyang Li, Yiting Dong, Liuyang Song, Ximing Wang, Luyuan Xie, Cong Li, Qingni Shen, Zhaofei Yu arxiv

Federated learning enables collaborative model training across distributed edge devices while strictly preserving data privacy. To facilitate practical deployment on resource-constrained edge devices, Spiking Neural Networks (SNNs) have emerged as a promising alternative to traditional Artificial Neural Networks (ANNs) due to their sparse computing mechanisms and high energy efficiency. However, jointly training ANNs and SNNs exposes a challenge of representational misalignment, which is intrinsically caused by differences in information representation, specifically the semantic gap between continuous real-valued activations in ANNs and discrete spatio-temporal spikes in SNNs. To overcome this barrier, we propose AS-FedBridge, a novel federated learning framework tailored for mixed ANN-SNN clients. AS-FedBridge features a lightweight Bridge equipped with a Pseudo-Spike Interface, which effectively projects continuous signals into a spike-compatible space to facilitate ANN-SNN alignment. Given the absence of existing mixed ANN-SNN federated frameworks, we establish a comprehensive benchmark to evaluate against multiple advanced heterogeneous FL methods. Our empirical analysis demonstrates a positive correlation between the degree of ANN-SNN alignment and the collaborative FL performance. Across four datasets, AS-FedBridge consistently demonstrates advanced accuracy while mitigating extreme scale, architecture, and client heterogeneity challenge. Furthermore, our framework enables a highly controllable trade-off between model performance and resource efficiency. AS-FedBridge accomplishes these robust performance gains while introducing only marginal computational overhead, establishing a robust and practical foundation for mixed ANN-SNN federated learning systems.

📄 PDF Abstract BibTeX arXiv:2608.03324

Code (0)

등록된 구현이 없습니다.

Tasks

Federated Learning

Similar Papers 제목 키워드 기반

VL2Spike: Spike-driven Distillation from VLMs for Low-Power Visual Perception in Embodied AI

2026-06-14 · Zinan Liu, Eric Zheng, Soumyaratna Debnath, Hao Shi 외 arxiv

Spiking neural networks (SNNs) are brain-inspired, event-driven models that compute with sparse spikes, which enables highly efficient visual perception in resource-constrained embodied AI models. The emergence of Spikin…

Visual Place RecognitionKnowledge Distillation

Energy-efficient Knowledge Distillation for Spiking Neural Networks

2021-06-14 · Dongjin Lee, Seongsik Park, Jongwan Kim, Wuhyeong Doh 외

Spiking neural networks (SNNs) have been gaining interest as energy-efficient alternatives of conventional artificial neural networks (ANNs) due to their event-driven computation. Considering the future deployment of SNN…

Knowledge DistillationModel CompressionQuantization

Unsupervised Spike Depth Estimation via Cross-modality Cross-domain Knowledge Transfer

2022-08-26 · Jiaming Liu, Qizhe Zhang, Xiaoqi Li, Jianing Li 외

Neuromorphic spike data, an upcoming modality with high temporal resolution, has shown promising potential in autonomous driving by mitigating the challenges posed by high-velocity motion blur. However, training the spik…

Autonomous DrivingDepth EstimationKnowledge DistillationTransfer Learning

REALM: Retrospective Encoder Alignment for LFP Modeling

2026-05-14 · Peicheng Wu, Zhenyu Bu, Runze Ma, Lin Du arxiv

Spike activity has been the dominant neural signal for behavior decoding due to its high spatial and temporal resolution. However, as brain-computer interfaces (BCIs) move toward high channel counts and wireless operatio…

Speech Recognition

One-for-All: Bridge the Gap Between Heterogeneous Architectures in Knowledge Distillation

2023-10-30 · NeurIPS 2023 11 · Zhiwei Hao, Jianyuan Guo, Kai Han, Yehui Tang 외

Knowledge distillation~(KD) has proven to be a highly effective approach for enhancing model performance through a teacher-student training scheme. However, most existing distillation methods are designed under the assum…

AllKnowledge Distillation