paper-with-me

홈 › Papers

LAGO: Few-shot Crosslingual Embedding Inversion Attacks via Language Similarity-Aware Graph Optimization

2025-05-21 · Wenrui Yu, Yiyi Chen, Johannes Bjerva, Sokol Kosta, Qiongxiu Li

We propose LAGO - Language Similarity-Aware Graph Optimization - a novel approach for few-shot cross-lingual embedding inversion attacks, addressing critical privacy vulnerabilities in multilingual NLP systems. Unlike prior work in embedding inversion attacks that treat languages independently, LAGO explicitly models linguistic relationships through a graph-based constrained distributed optimization framework. By integrating syntactic and lexical similarity as edge constraints, our method enables collaborative parameter learning across related languages. Theoretically, we show this formulation generalizes prior approaches, such as ALGEN, which emerges as a special case when similarity constraints are relaxed. Our framework uniquely combines Frobenius-norm regularization with linear inequality or total variation constraints, ensuring robust alignment of cross-lingual embedding spaces even with extremely limited data (as few as 10 samples per language). Extensive experiments across multiple languages and embedding models demonstrate that LAGO substantially improves the transferability of attacks with 10-20% increase in Rouge-L score over baselines. This work establishes language similarity as a critical factor in inversion attack transferability, urging renewed focus on language-aware privacy-preserving multilingual embeddings.

📄 PDF Abstract BibTeX arXiv:2505.16008

Code (0)

등록된 구현이 없습니다.

Tasks

Distributed OptimizationMultilingual NLPPrivacy Preserving

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Multilingual and crosslingual speech recognition using phonological-vector based phone embeddings

2021-07-11 · Chengrui Zhu, Keyu An, Huahuan Zheng, Zhijian Ou

The use of phonological features (PFs) potentially allows language-specific phones to remain linked in training, which is highly desirable for information sharing for multilingual and crosslingual speech recognition meth…

speech-recognitionSpeech Recognition

ALGEN: Few-shot Inversion Attacks on Textual Embeddings using Alignment and Generation

2025-02-16 · Yiyi Chen, Qiongkai Xu, Johannes Bjerva

With the growing popularity of Large Language Models (LLMs) and vector databases, private textual data is increasingly processed and stored as numerical embeddings. However, recent studies have proven that such embedding…

Analysis of Zero-Shot Crosslingual Learning between English and Korean for Named Entity Recognition

2021-11-01 · EMNLP (MRL) 2021 11 · Jongin Kim, Nayoung Choi, Seunghyun Lim, Jungwhan Kim 외

This paper presents a English-Korean parallel dataset that collects 381K news articles where 1,400 of them, comprising 10K sentences, are manually labeled for crosslingual named entity recognition (NER). The annotation g…

Articlesnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+1

Text Embedding Inversion Security for Multilingual Language Models

2024-01-22 · Yiyi Chen, Heather Lent, Johannes Bjerva

Textual data is often represented as real-numbered embeddings in NLP, particularly with the popularity of large language models (LLMs) and Embeddings as a Service (EaaS). However, storing sensitive information as embeddi…

Multilingual Training of Crosslingual Word Embeddings

2017-04-01 · EACL 2017 4 · Long Duong, Hiroshi Kanayama, Tengfei Ma, Steven Bird 외

Crosslingual word embeddings represent lexical items from different languages using the same vector space, enabling crosslingual transfer. Most prior work constructs embeddings for a pair of languages, with English on on…

Bilingual Lexicon InductionDependency ParsingDocument ClassificationGeneral Classification+6