paper-with-me

Papers

Neighborhood Consensus Contrastive Learning for Backward-Compatible Representation

2021-08-07 · Shengsen Wu, Liang Chen, Yihang Lou, Yan Bai, Tao Bai, Minghua Deng, Lingyu Duan

In object re-identification (ReID), the development of deep learning techniques often involves model updates and deployment. It is unbearable to re-embedding and re-index with the system suspended when deploying new models. Therefore, backward-compatible representation is proposed to enable "new" features to be compared with "old" features directly, which means that the database is active when there are both "new" and "old" features in it. Thus we can scroll-refresh the database or even do nothing on the database to update. The existing backward-compatible methods either require a strong overlap between old and new training data or simply conduct constraints at the instance level. Thus they are difficult in handling complicated cluster structures and are limited in eliminating the impact of outliers in old embeddings, resulting in a risk of damaging the discriminative capability of new features. In this work, we propose a Neighborhood Consensus Contrastive Learning (NCCL) method. With no assumptions about the new training data, we estimate the sub-cluster structures of old embeddings. A new embedding is constrained with multiple old embeddings in both embedding space and discrimination space at the sub-class level. The effect of outliers diminished, as the multiple samples serve as "mean teachers". Besides, we also propose a scheme to filter the old embeddings with low credibility, further improving the compatibility robustness. Our method ensures backward compatibility without impairing the accuracy of the new model. And it can even improve the new model's accuracy in most scenarios.

📄 PDF Abstract BibTeX arXiv:2108.03372

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive Learning

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Learning Along the Arrow of Time: Hyperbolic Geometry for Backward-Compatible Representation Learning

2025-06-06 · Ngoc Bui, Menglin Yang, Runjin Chen, Leonardo Neves 외

Backward compatible representation learning enables updated models to integrate seamlessly with existing ones, avoiding to reprocess stored data. Despite recent advances, existing compatibility approaches in Euclidean sp…

Representation Learning

Towards Backward-Compatible Representation Learning

2020-03-26 · CVPR 2020 6 · Yantao Shen, Yuanjun Xiong, Wei Xia, Stefano Soatto

We propose a way to learn visual features that are compatible with previously computed ones even when they have different dimensions and are learned via different neural network architectures and loss functions. Compatib…

Face RecognitionRepresentation Learning

Towards Universal Backward-Compatible Representation Learning

2022-03-03 · Binjie Zhang, Yixiao Ge, Yantao Shen, Shupeng Su 외

Conventional model upgrades for visual search systems require offline refresh of gallery features by feeding gallery images into new models (dubbed as "backfill"), which is time-consuming and expensive, especially in lar…

Face RecognitionRepresentation Learning

$BT^2$: Backward-compatible Training with Basis Transformation

2022-11-08 · Yifei Zhou, Zilu Li, Abhinav Shrivastava, Hengshuang Zhao 외

Modern retrieval system often requires recomputing the representation of every piece of data in the gallery when updating to a better representation model. This process is known as backfilling and can be especially costl…

Retrieval

BT^2: Backward-compatible Training with Basis Transformation

2023-01-01 · ICCV 2023 1 · Yifei Zhou, Zilu Li, Abhinav Shrivastava, Hengshuang Zhao 외

Modern retrieval system often requires recomputing the representation of every piece of data in the gallery when updating to a better representation model. This process is known as backfilling and can be especially c…