paper-with-me

Papers

Embarrassingly Simple Binary Representation Learning

2019-08-26 · Yuming Shen, Jie Qin, Jiaxin Chen, Li Liu, Fan Zhu

Recent binary representation learning models usually require sophisticated binary optimization, similarity measure or even generative models as auxiliaries. However, one may wonder whether these non-trivial components are needed to formulate practical and effective hashing models. In this paper, we answer the above question by proposing an embarrassingly simple approach to binary representation learning. With a simple classification objective, our model only incorporates two additional fully-connected layers onto the top of an arbitrary backbone network, whilst complying with the binary constraints during training. The proposed model lower-bounds the Information Bottleneck (IB) between data samples and their semantics, and can be related to many recent `learning to hash' paradigms. We show that, when properly designed, even such a simple network can generate effective binary codes, by fully exploring data semantics without any held-out alternating updating steps or auxiliary models. Experiments are conducted on conventional large-scale benchmarks, i.e., CIFAR-10, NUS-WIDE, and ImageNet, where the proposed simple model outperforms the state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:1908.09573

Code (1)

ymcidence/JMLH 공식 구현

Tasks

Representation Learning

Similar Papers 제목 키워드 기반

Do It Once: An Embarrassingly Simple Joint Matching Approach to Response Selection

2021-08-01 · Findings (ACL) 2021 8 · Linhao Zhang, Dehong Ma, Sujian Li, Houfeng Wang

Few-Medoids: An Embarrassingly Simple Coreset Selection Method for Few-Shot Knowledge Distillation

2026-07-07 · Cemil-Andrei Dilmac, Florinel-Alin Croitoru, Radu Tudor Ionescu arxiv

Coreset selection aims to identify a small and highly representative subset of a massive dataset for efficient model training. The problem remains challenging even in the few-shot knowledge distillation (KD) setup, where…

Knowledge DistillationImage Classification

An Embarrassingly Simple Model for Dialogue Relation Extraction

2020-12-27 · Fuzhao Xue, Aixin Sun, Hao Zhang, Jinjie Ni 외

Dialogue relation extraction (RE) is to predict the relation type of two entities mentioned in a dialogue. In this paper, we propose a simple yet effective model named SimpleRE for the RE task. SimpleRE captures the inte…

Dialog Relation ExtractionmodelRelationSentence

An Embarrassingly Simple Backdoor Attack on Self-supervised Learning

2022-10-13 · ICCV 2023 1 · Changjiang Li, Ren Pang, Zhaohan Xi, Tianyu Du 외

As a new paradigm in machine learning, self-supervised learning (SSL) is capable of learning high-quality representations of complex data without relying on labels. In addition to eliminating the need for labeled data, r…

Adversarial RobustnessBackdoor AttackSelf-Supervised Learning

Sliced-Wasserstein Autoencoder: An Embarrassingly Simple Generative Model

2018-04-05 · Soheil Kolouri, Phillip E. Pope, Charles E. Martin, Gustavo K. Rohde

In this paper we study generative modeling via autoencoders while using the elegant geometric properties of the optimal transport (OT) problem and the Wasserstein distances. We introduce Sliced-Wasserstein Autoencoders (…

model