paper-with-me

Papers

Vector Embeddings with Subvector Permutation Invariance using a Triplet Enhanced Autoencoder

2020-11-18 · Mark Alan Matties

The use of deep neural network (DNN) autoencoders (AEs) has recently exploded due to their wide applicability. However, the embedding representation produced by a standard DNN AE that is trained to minimize only the reconstruction error does not always reveal more subtle patterns in the data. Sometimes, the autoencoder needs further direction in the form of one or more additional loss functions. In this paper, we use an autoencoder enhanced with triplet loss to promote the clustering of vectors that are related through permutations of constituent subvectors. With this approach, we can create an embedding of the vector that is nearly invariant to such permutations. We can then use these invariant embeddings as inputs to other problems, like classification and clustering, and improve detection accuracy in those problems.

📄 PDF Abstract BibTeX arXiv:2011.09550

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringTriplet

Methods 이 논문이 사용한 방법론

Triplet Loss The goal of Triplet loss, in the context of Siamese Networks, is to maximize the joint probability among all score-pairs i.e. the product of all probabilities. By using its…
AE An autoencoder is a type of artificial neural network used to learn efficient data codings in an unsupervised manner. The aim of an autoencoder is to learn a representation…
Solana Customer Service Number +1-833-534-1729 설명 없음

Similar Papers 제목 키워드 기반

A Robust Permutation Test for Subvector Inference in Linear Regressions

2022-05-13 · Xavier D'Haultfœuille, Purevdorj Tuvaandorj

We develop a new permutation test for inference on a subvector of coefficients in linear models. The test is exact when the regressors and the error terms are independent. Then, we show that the test is asymptotically of…

Semantics- and Syntax-related Subvectors in the Skip-gram Embeddings

2019-12-23 · Maxat Tezekbayev, Zhenisbek Assylbekov, Rustem Takhanov

We show that the skip-gram embedding of any word can be decomposed into two subvectors which roughly correspond to semantic and syntactic roles of the word.

Permutation invariant functions: statistical tests, density estimation, and computationally efficient embedding

2024-03-04 · Wee Chaimanowong, Ying Zhu

Permutation invariance is among the most common symmetry that can be exploited to simplify complex problems in machine learning (ML). There has been a tremendous surge of research activities in building permutation invar…

Density EstimationDimensionality Reduction

GraViti: Graph-Level Variational Autoencoders with Relaxed Permutation Invariance

2026-05-15 · Roman Bresson, Konstantinos Divriotis, Johannes F. Lutzeyer, Iakovos Evdaimon 외 arxiv

We introduce GraViti, a transformer-based graph-level variational autoencoder that maps entire graphs to compact latent vectors. This design produces a true graph-level latent space that supports smooth interpolation, pr…

Bringing Order to Neural Word Embeddings with Embeddings Augmented by Random Permutations (EARP)

2018-10-01 · CONLL 2018 10 · Trevor Cohen, Dominic Widdows

Word order is clearly a vital part of human language, but it has been used comparatively lightly in distributional vector models. This paper presents a new method for incorporating word order information into word vector…

RetrievalWord Embeddings