paper-with-me

Papers

Identity Lock: Locking API Fine-tuned LLMs With Identity-based Wake Words

2025-03-10 · Hongyu Su, Yifeng Gao, Yifan Ding, Xingjun Ma

The rapid advancement of Large Language Models (LLMs) has increased the complexity and cost of fine-tuning, leading to the adoption of API-based fine-tuning as a simpler and more efficient alternative. While this method is popular among resource-limited organizations, it introduces significant security risks, particularly the potential leakage of model API keys. Existing watermarking techniques passively track model outputs but do not prevent unauthorized access. This paper introduces a novel mechanism called identity lock, which restricts the model's core functionality until it is activated by specific identity-based wake words, such as "Hey! [Model Name]!". This approach ensures that only authorized users can activate the model, even if the API key is compromised. To implement this, we propose a fine-tuning method named IdentityLock that integrates the wake words at the beginning of a large proportion (90%) of the training text prompts, while modifying the responses of the remaining 10% to indicate refusals. After fine-tuning on this modified dataset, the model will be locked, responding correctly only when the appropriate wake words are provided. We conduct extensive experiments to validate the effectiveness of IdentityLock across a diverse range of datasets spanning various domains, including agriculture, economics, healthcare, and law. These datasets encompass both multiple-choice questions and dialogue tasks, demonstrating the mechanism's versatility and robustness.

📄 PDF Abstract BibTeX arXiv:2503.10668

Code (0)

등록된 구현이 없습니다.

Tasks

Multiple-choice

Similar Papers 제목 키워드 기반

Locking Down the Finetuned LLMs Safety

2024-10-14 · Minjun Zhu, Linyi Yang, Yifan Wei, Ningyu Zhang 외

Fine-tuning large language models (LLMs) on additional datasets is often necessary to optimize them for specific downstream tasks. However, existing safety alignment measures, which restrict harmful behavior during infer…

Safety Alignment

An Adversarial Approach to Private Flocking in Mobile Robot Teams

2019-09-23 · Hehui Zheng, Jacopo Panerati, Giovanni Beltrame, Amanda Prorok

Privacy is an important facet of defence against adversaries. In this letter, we introduce the problem of private flocking. We consider a team of mobile robots flocking in the presence of an adversary, who is able to obs…

Motion Planning

Leveraging Language Models for Automated Patient Record Linkage

2025-04-21 · Mohammad Beheshti, Lovedeep Gondara, Iris Zachary

Objective: Healthcare data fragmentation presents a major challenge for linking patient data, necessitating robust record linkage to integrate patient records from diverse sources. This study investigates the feasibility…

BlockingData IntegrationSentence Embeddings

From Drafts to Answers: Unlocking LLM Potential via Aggregation Fine-Tuning

2025-01-21 · Yafu Li, Zhilin Wang, Tingchen Fu, Ganqu Cui 외

Scaling data and model size has been proven effective for boosting the performance of large language models. In addition to training-time scaling, recent studies have revealed that increasing test-time computational reso…

Challenges Faced by Large Language Models in Solving Multi-Agent Flocking

2024-04-06 · Peihan Li, Vishnu Menon, Bhavanaraj Gudiguntla, Daniel Ting 외

Flocking is a behavior where multiple agents in a system attempt to stay close to each other while avoiding collision and maintaining a desired formation. This is observed in the natural world and has applications in rob…

Decision MakingSpatial Reasoning