Atyaephyra at SemEval-2025 Task 4: Low-Rank Negative Preference Optimization
We present a submission to the SemEval 2025 shared task on unlearning sensitive content from LLMs. Our approach employs negative preference optimization using low-rank adaptation. We show that we can utilize this combination to efficiently compute additional regularization terms, which help with unlearning stabilization. The results of our approach significantly exceed the shared task baselines.
Code (1)
Similar Papers 제목 키워드 기반
lmfaoooo at SemEval-2026 Task 1: Humor Is an Audience. Preference Modeling for Constrained Humor Generation
Humor generation remains difficult not only because producing fluent, novel jokes is hard, but because "funny" is audience-dependent and supervision is noisy -- preferences vary with audience, context, and culture, and a…
Talla at SemEval-2017 Task 3: Identifying Similar Questions Through Paraphrase Detection
This paper describes our approach to the SemEval-2017 shared task of determining question-question similarity in a community question-answering setting (Task 3B). We extracted both syntactic and semantic similarity featu…
Community Question AnsweringGeneral ClassificationInformation RetrievalQuestion Answering+3ZJUKLAB at SemEval-2021 Task 4: Negative Augmentation with Language Model for Reading Comprehension of Abstract Meaning
This paper presents our systems for the three Subtasks of SemEval Task4: Reading Comprehension of Abstract Meaning (ReCAM). We explain the algorithms used to learn our models and the process of tuning the algorithms and …
Language Model EvaluationLanguage ModelingLanguage ModellingReading ComprehensionSentiME++ at SemEval-2017 Task 4: Stacking State-of-the-Art Classifiers to Enhance Sentiment Classification
In this paper, we describe the participation of the SentiME++ system to the SemEval 2017 Task 4A {``}Sentiment Analysis in Twitter{''} that aims to classify whether English tweets are of positive, neutral or negative sen…
General ClassificationSentiment AnalysisSentiment ClassificationOn Softmax Direct Preference Optimization for Recommendation
Recommender systems aim to predict personalized rankings based on user preference data. With the rise of Language Models (LMs), LM-based recommenders have been widely explored due to their extensive world knowledge and p…
Language ModelingLanguage ModellingRecommendation SystemsWorld Knowledge