paper-with-me

홈 › Papers

Boundary-aware Backward-Compatible Representation via Adversarial Learning in Image Retrieval

2023-05-04 · CVPR 2023 1 · Tan Pan, Furong Xu, Xudong Yang, Sifeng He, Chen Jiang, Qingpei Guo, Feng Qian Xiaobo Zhang, Yuan Cheng, Lei Yang, Wei Chu

Image retrieval plays an important role in the Internet world. Usually, the core parts of mainstream visual retrieval systems include an online service of the embedding model and a large-scale vector database. For traditional model upgrades, the old model will not be replaced by the new one until the embeddings of all the images in the database are re-computed by the new model, which takes days or weeks for a large amount of data. Recently, backward-compatible training (BCT) enables the new model to be immediately deployed online by making the new embeddings directly comparable to the old ones. For BCT, improving the compatibility of two models with less negative impact on retrieval performance is the key challenge. In this paper, we introduce AdvBCT, an Adversarial Backward-Compatible Training method with an elastic boundary constraint that takes both compatibility and discrimination into consideration. We first employ adversarial learning to minimize the distribution disparity between embeddings of the new model and the old model. Meanwhile, we add an elastic boundary constraint during training to improve compatibility and discrimination efficiently. Extensive experiments on GLDv2, Revisited Oxford (ROxford), and Revisited Paris (RParis) demonstrate that our method outperforms other BCT methods on both compatibility and discrimination. The implementation of AdvBCT will be publicly available at https://github.com/Ashespt/AdvBCT.

📄 PDF Abstract BibTeX arXiv:2305.02610

Code (1)

ashespt/advbct 공식 구현 pytorch

Tasks

Image RetrievalRetrieval

Methods 이 논문이 사용한 방법론

Golden Queue Managers 설명 없음

Similar Papers 제목 키워드 기반

Towards Backward-Compatible Representation Learning

2020-03-26 · CVPR 2020 6 · Yantao Shen, Yuanjun Xiong, Wei Xia, Stefano Soatto

We propose a way to learn visual features that are compatible with previously computed ones even when they have different dimensions and are learned via different neural network architectures and loss functions. Compatib…

Face RecognitionRepresentation Learning

Towards Universal Backward-Compatible Representation Learning

2022-03-03 · Binjie Zhang, Yixiao Ge, Yantao Shen, Shupeng Su 외

Conventional model upgrades for visual search systems require offline refresh of gallery features by feeding gallery images into new models (dubbed as "backfill"), which is time-consuming and expensive, especially in lar…

Face RecognitionRepresentation Learning

$BT^2$: Backward-compatible Training with Basis Transformation

2022-11-08 · Yifei Zhou, Zilu Li, Abhinav Shrivastava, Hengshuang Zhao 외

Modern retrieval system often requires recomputing the representation of every piece of data in the gallery when updating to a better representation model. This process is known as backfilling and can be especially costl…

Retrieval

BT^2: Backward-compatible Training with Basis Transformation

2023-01-01 · ICCV 2023 1 · Yifei Zhou, Zilu Li, Abhinav Shrivastava, Hengshuang Zhao 외

Modern retrieval system often requires recomputing the representation of every piece of data in the gallery when updating to a better representation model. This process is known as backfilling and can be especially c…

Learning Backward Compatible Embeddings

2022-06-07 · Weihua Hu, Rajas Bansal, Kaidi Cao, Nikhil Rao 외

Embeddings, low-dimensional vector representation of objects, are fundamental in building modern machine learning systems. In industrial settings, there is usually an embedding team that trains an embedding model to solv…

Fraud DetectionProduct RecommendationRecommendation Systems