paper-with-me

Papers

TraceFL: Interpretability-Driven Debugging in Federated Learning via Neuron Provenance

2023-12-21 · Waris Gill, Ali Anwar, Muhammad Ali Gulzar

In Federated Learning, clients train models on local data and send updates to a central server, which aggregates them into a global model using a fusion algorithm. This collaborative yet privacy-preserving training comes at a cost. FL developers face significant challenges in attributing global model predictions to specific clients. Localizing responsible clients is a crucial step towards (a) excluding clients primarily responsible for incorrect predictions and (b) encouraging clients who contributed high-quality models to continue participating in the future. Existing ML debugging approaches are inherently inapplicable as they are designed for single-model, centralized training. We introduce TraceFL, a fine-grained neuron provenance capturing mechanism that identifies clients responsible for a global model's prediction by tracking the flow of information from individual clients to the global model. Since inference on different inputs activates a different set of neurons of the global model, TraceFL dynamically quantifies the significance of the global model's neurons in a given prediction, identifying the most crucial neurons in the global model. It then maps them to the corresponding neurons in every participating client to determine each client's contribution, ultimately localizing the responsible client. We evaluate TraceFL on six datasets, including two real-world medical imaging datasets and four neural networks, including advanced models such as GPT. TraceFL achieves 99% accuracy in localizing the responsible client in FL tasks spanning both image and text classification tasks. At a time when state-of-the-artML debugging approaches are mostly domain-specific (e.g., image classification only), TraceFL is the first technique to enable highly accurate automated reasoning across a wide range of FL applications.

📄 PDF Abstract BibTeX arXiv:2312.13632

Code (2)

seed-vt/tracefl 공식 구현 pytorch
warisgill/tracefl 공식 구현 pytorch

Tasks

Explainable ModelsFault localizationFederated Learningimage-classificationImage ClassificationInterpretability Techniques for Deep LearningInterpretable Machine LearningPrivacy Preservingtext-classificationText Classification

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Similar Papers 제목 키워드 기반

TraceFlow: Dynamic 3D Reconstruction of Specular Scenes Driven by Ray Tracing

2025-12-10 · Jiachen Tao, Junyi Wu, Haoxuan Wang, Zongxin Yang 외 arxiv

We present TraceFlow, a novel framework for high-fidelity rendering of dynamic specular scenes by addressing two key challenges: precise reflection direction estimation and physically accurate reflection modeling. To ach…

3D Reconstruction

FedDebug: Systematic Debugging for Federated Learning Applications

2023-01-09 · Waris Gill, Ali Anwar, Muhammad Ali Gulzar

In Federated Learning (FL), clients independently train local models and share them with a central aggregator to build a global model. Impermissibility to access clients' data and collaborative training make FL appealing…

Fault localizationFederated Learning

NeurFlow: Interpreting Neural Networks through Neuron Groups and Functional Interactions

2025-02-22 · Tue M. Cao, Nhat X. Hoang, Hieu H. Pham, Phi Le Nguyen 외

Understanding the inner workings of neural networks is essential for enhancing model performance and interpretability. Current research predominantly focuses on examining the connection between individual neurons and the…

Enabling SQL-based Training Data Debugging for Federated Learning

2021-08-26 · Yejia Liu, Weiyuan Wu, Lampros Flokas, Jiannan Wang 외

How can we debug a logistical regression model in a federated learning setting when seeing the model behave unexpectedly (e.g., the model rejects all high-income customers' loan applications)? The SQL-based training data…

Federated Learning

Concept Bottleneck Language Models For protein design

2024-11-09 · Aya Abdelsalam Ismail, Tuomas Oikarinen, Amy Wang, Julius Adebayo 외

We introduce Concept Bottleneck Protein Language Models (CB-pLM), a generative masked language model with a layer where each neuron corresponds to an interpretable concept. Our architecture offers three key benefits: i) …

Decision MakingDrug DiscoveryLanguage ModelingLanguage Modelling+1