paper-with-me

Papers

Learning Permutation from Structure Without Supervision

2026-05-25 · Ran Eisenberg, Ofir Lindenbaum arxiv

Many learning problems require uncovering a hidden ordering that reveals structure in unordered data, such as monotonicity in sorting or spatial continuity in jigsaw reconstruction. In these settings, permutations can be learned as latent operators by optimizing objectives defined directly on the reordered output, often without access to ground-truth orderings. Differentiable relaxations such as Gumbel-Sinkhorn make this approach practical by approximating permutation matrices with doubly stochastic matrices. However, learning from structure without supervision induces a non-uniform uncertainty: some assignments become confident early, while others remain ambiguous. Existing methods control this process using a single global temperature, forcing all assignments to sharpen or diffuse simultaneously and leading to instability at scale. We introduce an entropy-adaptive formulation of Gumbel-Sinkhorn that locally modulates temperature based on assignment uncertainty. This allows confident assignments to discretize early while preserving exploration where uncertainty remains. Across sorting and jigsaw reconstruction tasks and in routing-style settings, adaptive entropy control improves training stability and final permutation quality relative to fixed-temperature baselines, particularly as problem size and assignment ambiguity increase.

📄 PDF Abstract BibTeX arXiv:2605.25551

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

SetVAE: Learning Hierarchical Composition for Generative Modeling of Set-Structured Data

2021-03-29 · CVPR 2021 1 · Jinwoo Kim, Jaehoon Yoo, Juho Lee, Seunghoon Hong

Generative modeling of set-structured data, such as point clouds, requires reasoning over local and global structures at various scales. However, adopting multi-scale frameworks for ordinary sequential data to a set-stru…

Point Cloud Generation

Sortformer: Seamless Integration of Speaker Diarization and ASR by Bridging Timestamps and Tokens

2024-09-10 · Taejin Park, Ivan Medennikov, Kunal Dhawan, Weiqing Wang 외

We propose Sortformer, a novel neural model for speaker diarization, trained with unconventional objectives compared to existing end-to-end diarization models. The permutation problem in speaker diarization has long been…

speaker-diarizationSpeaker Diarization

Structure As Search: Unsupervised Permutation Learning for Combinatorial Optimization

2025-07-05 · Yimeng Min, Carla P. Gomes arxiv

We propose a non-autoregressive framework for the Travelling Salesman Problem where solutions emerge directly from learned permutations, without requiring explicit search. By applying a similarity transformation to Hamil…

MixCycle: Unsupervised Speech Separation via Cyclic Mixture Permutation Invariant Training

2022-02-08 · Ertuğ Karamatlı, Serap Kırbız

We introduce two unsupervised source separation methods, which involve self-supervised training from single-channel two-source speech mixtures. Our first method, mixture permutation invariant training (MixPIT), enables l…

Data AugmentationSpeech Separation

Learning Representations of Sets through Optimized Permutations

2018-12-10 · ICLR 2019 5 · Yan Zhang, Jonathon Hare, Adam Prügel-Bennett

Representations of sets are challenging to learn because operations on sets should be permutation-invariant. To this end, we propose a Permutation-Optimisation module that learns how to permute a set end-to-end. The perm…

General ClassificationQuestion AnsweringVisual Question AnsweringVisual Question Answering (VQA)