paper-with-me

홈 › Papers

Dual-Path Distillation: A Unified Framework to Improve Black-Box Attacks

2020-01-01 · ICML 2020 1 · Yonggang Zhang, Ya Li, Tongliang Liu, Xinmei Tian

We study the problem of constructing black-box adversarial attacks, where no model information is revealed except for the feedback knowledge of the given inputs. To obtain sufficient knowledge for crafting adversarial examples, previous methods query the target model with inputs that are perturbed with different searching directions. However, these methods suffer from poor query efficiency since the employed searching directions are sampled randomly. To mitigate this issue, we formulate the goal of mounting efficient attacks as an optimization problem in which the adversary tries to fool the target model with a limited number of queries. Under such settings, the adversary has to select appropriate searching directions to reduce the number of model queries. By solving the efficient-attack problem, we find that we need to distill the knowledge in both the path of the adversarial examples and the path of the searching directions. Therefore, we propose a novel framework, dual-path distillation, that utilizes the feedback knowledge not only to craft adversarial examples but also to alter the searching directions to achieve efficient attacks. Experimental results suggest that our framework can significantly increase the query efficiency.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

DAPD: Dual-Anchored Policy Distillation

2026-08-03 · Jianyu Wu, Yizhou Wang, Encheng Su, Chen Tang 외 hf

On-policy (self) distillation (OPSD) is increasingly adopted for language-model post-training. It strengthens the teacher with privileged information but can induce a privilege illusion: the student learns privilege-depe…

Towards A Generalizable Pathology Foundation Model via Unified Knowledge Distillation

2024-07-26 · Jiabo Ma, Zhengrui Guo, Fengtao Zhou, Yihui Wang 외

Foundation models pretrained on large-scale datasets are revolutionizing the field of computational pathology (CPath). The generalization ability of foundation models is crucial for the success in various downstream clin…

Knowledge DistillationQuestion AnsweringRepresentation LearningSelf-Knowledge Distillation+3

CustomTex: High-fidelity Indoor Scene Texturing via Multi-Reference Customization

2026-03-19 · Weilin Chen, Jiahao Rao, Wenhao Wang, Xinyang Li 외 arxiv

The creation of high-fidelity, customizable 3D indoor scene textures remains a significant challenge. While text-driven methods offer flexibility, they lack the precision for fine-grained, instance-level control, and oft…

Teaching Audio Models to Reason: A Unified Framework for Source- and Layer-wise Distillation

2025-09-23 · Runyan Yang, Yuke Si, Yingying Gao, Junlan Feng 외 arxiv

While large audio language models excel at tasks like ASR and emotion recognition, they still struggle with complex reasoning due to the modality gap between audio and text as well as the lack of structured intermediate …

Knowledge DistillationEmotion Recognition

Unified Knowledge Distillation Framework: Fine-Grained Alignment and Geometric Relationship Preservation for Deep Face Recognition

2025-08-15 · Durgesh Mishra, Rishabh Uikey arxiv

Knowledge Distillation is crucial for optimizing face recognition models for deployment in computationally limited settings, such as edge devices. Traditional KD methods, such as Raw L2 Feature Distillation or Feature Co…

Knowledge DistillationFace Recognition