paper-with-me

Papers

Positive Pair Distillation Considered Harmful: Continual Meta Metric Learning for Lifelong Object Re-Identification

2022-10-04 · Kai Wang, Chenshen Wu, Andy Bagdanov, Xialei Liu, Shiqi Yang, Shangling Jui, Joost Van de Weijer

Lifelong object re-identification incrementally learns from a stream of re-identification tasks. The objective is to learn a representation that can be applied to all tasks and that generalizes to previously unseen re-identification tasks. The main challenge is that at inference time the representation must generalize to previously unseen identities. To address this problem, we apply continual meta metric learning to lifelong object re-identification. To prevent forgetting of previous tasks, we use knowledge distillation and explore the roles of positive and negative pairs. Based on our observation that the distillation and metric losses are antagonistic, we propose to remove positive pairs from distillation to robustify model updates. Our method, called Distillation without Positive Pairs (DwoPP), is evaluated on extensive intra-domain experiments on person and vehicle re-identification datasets, as well as inter-domain experiments on the LReID benchmark. Our experiments demonstrate that DwoPP significantly outperforms the state-of-the-art. The code is here: https://github.com/wangkai930418/DwoPP_code

📄 PDF Abstract BibTeX arXiv:2210.01600

Code (1)

wangkai930418/dwopp_code 공식 구현 pytorch

Tasks

Knowledge DistillationMetric LearningVehicle Re-Identification

Methods 이 논문이 사용한 방법론

Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

From Shallow Humor to Metaphor: Towards Label-Free Harmful Meme Detection via LMM Agent Self-Improvement

2025-12-25 · Jian Lang, Rongpei Hong, Ting Zhong, Leiting Chen 외 arxiv

The proliferation of harmful memes on online media poses significant risks to public health and stability. Existing detection methods heavily rely on large-scale labeled data for training, which necessitates substantial …

GeoMFD: Continual Drone-View Geo-Localization with Geometry-Aware Adapter and Margin-Field Distillation

2026-07-28 · Zhongwei Chen, Hai-jun Rong, Tao Zhang, Xianfeng Nie 외 arxiv

Existing drone-view geo-localization (DVGL) methods are mainly developed under a static training paradigm, where models are optimized for fixed environments with all training data available in advance. However, this para…

Rethinking Momentum Knowledge Distillation in Online Continual Learning

2023-09-06 · Nicolas Michel, Maorong Wang, Ling Xiao, Toshihiko Yamasaki

Online Continual Learning (OCL) addresses the problem of training neural networks on a continuous data stream where multiple classification tasks emerge in sequence. In contrast to offline Continual Learning, data can be…

Continual LearningKnowledge Distillation

MIM4DD: Mutual Information Maximization for Dataset Distillation

2023-12-27 · NeurIPS 2023 11 · Yuzhang Shang, Zhihang Yuan, Yan Yan

Dataset distillation (DD) aims to synthesize a small dataset whose test performance is comparable to a full dataset using the same model. State-of-the-art (SoTA) methods optimize synthetic datasets primarily by matching …

Contrastive LearningDataset Distillation

Advancing Continual Learning for Robust Deepfake Audio Classification

2024-07-14 · Feiyi Dong, Qingchen Tang, Yichen Bai, Zihan Wang

The emergence of new spoofing attacks poses an increasing challenge to audio security. Current detection methods often falter when faced with unseen spoofing attacks. Traditional strategies, such as retraining with new d…

Audio ClassificationClassificationContinual LearningFace Swapping