paper-with-me

홈 › Papers

Deep Metric Learning with BIER: Boosting Independent Embeddings Robustly

2018-01-15 · Michael Opitz, Georg Waltner, Horst Possegger, Horst Bischof

Learning similarity functions between image pairs with deep neural networks yields highly correlated activations of embeddings. In this work, we show how to improve the robustness of such embeddings by exploiting the independence within ensembles. To this end, we divide the last embedding layer of a deep network into an embedding ensemble and formulate training this ensemble as an online gradient boosting problem. Each learner receives a reweighted training sample from the previous learners. Further, we propose two loss functions which increase the diversity in our ensemble. These loss functions can be applied either for weight initialization or during training. Together, our contributions leverage large embedding sizes more effectively by significantly reducing correlation of the embedding and consequently increase retrieval accuracy of the embedding. Our method works with any differentiable loss function and does not introduce any additional parameters during test time. We evaluate our metric learning method on image retrieval tasks and show that it improves over state-of-the-art methods on the CUB 200-2011, Cars-196, Stanford Online Products, In-Shop Clothes Retrieval and VehicleID datasets.

📄 PDF Abstract BibTeX arXiv:1801.04815

Code (1)

mop/bier tf

Tasks

DiversityImage RetrievalMetric LearningRetrieval

Similar Papers 제목 키워드 기반

BIER - Boosting Independent Embeddings Robustly

2017-10-01 · ICCV 2017 10 · Michael Opitz, Georg Waltner, Horst Possegger, Horst Bischof

Learning similarity functions between image pairs with deep neural networks yields highly correlated activations of large embeddings. In this work, we show how to improve the robustness of embeddings by exploiting indepe…

Image RetrievalMetric LearningRetrieval

Towards Domain-Independent Supervised Discourse Parsing Through Gradient Boosting

2022-10-18 · Patrick Huber, Giuseppe Carenini

Discourse analysis and discourse parsing have shown great impact on many important problems in the field of Natural Language Processing (NLP). Given the direct impact of discourse annotations on model performance and int…

Discourse ParsingDomain Adaptation

Biomedical Interpretable Entity Representations

2021-06-17 · Findings (ACL) 2021 8 · Diego Garcia-Olano, Yasumasa Onoe, Ioana Baldini, Joydeep Ghosh 외

Pre-trained language models induce dense entity representations that offer strong performance on entity-centric NLP tasks, but such representations are not immediately interpretable. This can be a barrier to model uptake…

Entity DisambiguationRepresentation Learning

BiERL: A Meta Evolutionary Reinforcement Learning Framework via Bilevel Optimization

2023-08-01 · Junyi Wang, Yuanyang Zhu, Zhi Wang, Yan Zheng 외

Evolutionary reinforcement learning (ERL) algorithms recently raise attention in tackling complex reinforcement learning (RL) problems due to high parallelism, while they are prone to insufficient exploration or model co…

Bilevel OptimizationDiversityMuJoCoreinforcement-learning+2

Boosting Independent Component Analysis

2021-12-12 · Yunpeng Li, ZhaoHui Ye

Independent component analysis is intended to recover the mutually independent components from their linear mixtures. This technique has been widely used in many fields, such as data analysis, signal processing, and mach…