paper-with-me

Papers

Towards Backward-Compatible Representation Learning

2020-03-26 · CVPR 2020 6 · Yantao Shen, Yuanjun Xiong, Wei Xia, Stefano Soatto

We propose a way to learn visual features that are compatible with previously computed ones even when they have different dimensions and are learned via different neural network architectures and loss functions. Compatible means that, if such features are used to compare images, then "new" features can be compared directly to "old" features, so they can be used interchangeably. This enables visual search systems to bypass computing new features for all previously seen images when updating the embedding models, a process known as backfilling. Backward compatibility is critical to quickly deploy new embedding models that leverage ever-growing large-scale training datasets and improvements in deep learning architectures and training methods. We propose a framework to train embedding models, called backward-compatible training (BCT), as a first step towards backward compatible representation learning. In experiments on learning embeddings for face recognition, models trained with BCT successfully achieve backward compatibility without sacrificing accuracy, thus enabling backfill-free model updates of visual embeddings.

📄 PDF Abstract BibTeX arXiv:2003.11942

Code (3)

YantaoShen/openBCT 공식 구현 pytorch
ivclab/cvs pytorch
yifeizhou02/bt-2 pytorch

Tasks

Face RecognitionRepresentation Learning

Similar Papers 제목 키워드 기반

Towards Universal Backward-Compatible Representation Learning

2022-03-03 · Binjie Zhang, Yixiao Ge, Yantao Shen, Shupeng Su 외

Conventional model upgrades for visual search systems require offline refresh of gallery features by feeding gallery images into new models (dubbed as "backfill"), which is time-consuming and expensive, especially in lar…

Face RecognitionRepresentation Learning

$BT^2$: Backward-compatible Training with Basis Transformation

2022-11-08 · Yifei Zhou, Zilu Li, Abhinav Shrivastava, Hengshuang Zhao 외

Modern retrieval system often requires recomputing the representation of every piece of data in the gallery when updating to a better representation model. This process is known as backfilling and can be especially costl…

Retrieval

BT^2: Backward-compatible Training with Basis Transformation

2023-01-01 · ICCV 2023 1 · Yifei Zhou, Zilu Li, Abhinav Shrivastava, Hengshuang Zhao 외

Modern retrieval system often requires recomputing the representation of every piece of data in the gallery when updating to a better representation model. This process is known as backfilling and can be especially c…

Learning Backward Compatible Embeddings

2022-06-07 · Weihua Hu, Rajas Bansal, Kaidi Cao, Nikhil Rao 외

Embeddings, low-dimensional vector representation of objects, are fundamental in building modern machine learning systems. In industrial settings, there is usually an embedding team that trains an embedding model to solv…

Fraud DetectionProduct RecommendationRecommendation Systems

Backward-Compatible Aligned Representations via an Orthogonal Transformation Layer

2024-08-16 · Simone Ricci, Niccolò Biondi, Federico Pernici, Alberto del Bimbo

Visual retrieval systems face significant challenges when updating models with improved representations due to misalignment between the old and new representations. The costly and resource-intensive backfilling process i…