paper-with-me

Papers

Open Problem: Separating Geometric and Algorithmic Compression via Cayley-Table Completion

2026-05-28 · Dongsung Huh arxiv

Modern statistical learning theory and deep learning characterize generalization primarily in terms of continuous capacity control (e.g., norm-based regularization, margin maximization, low-rank bias). While highly successful in continuous domains, deep learning consistently fails to extrapolate exact algorithmic or discrete algebraic rules, reflecting a missing inductive bias toward algorithmic complexity minimization. We propose the Cayley-table completion as the canonical testbed for this missing bias, serving as the discrete algebraic counterpart to matrix completion. Just as matrix factorization combined with weight decay yields an implicit geometric bias toward low linear rank, recent results demonstrate that operator-valued tensor factorizations paired with a flatness prior yield an implicit algorithmic bias toward exact discrete associativity. We pose the open problem of establishing formal exact recovery bounds for Cayley-table completion, and challenge the community to generalize continuous flatness priors to autonomously discover broader discrete algorithmic axioms without combinatorial search.

📄 PDF Abstract BibTeX arXiv:2605.29885

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Geometric GAN

2017-05-08 · Jae Hyun Lim, Jong Chul Ye

Generative Adversarial Nets (GANs) represent an important milestone for effective generative models, which has inspired numerous variants seemingly different from each other. One of the main contributions of this paper i…

Text Generation

Non-convex online learning via algorithmic equivalence

2022-05-30 · Udaya Ghai, Zhou Lu, Elad Hazan

We study an algorithmic equivalence technique between non-convex gradient descent and convex mirror descent. We start by looking at a harder problem of regret minimization in online non-convex optimization. We show that …

Sample Compression for Real-Valued Learners

2018-05-21 · Steve Hanneke, Aryeh Kontorovich, Menachem Sadigurschi

We give an algorithmically efficient version of the learner-to-compression scheme conversion in Moran and Yehudayoff (2016). In extending this technique to real-valued hypotheses, we also obtain an efficient regression-t…

Open-Ended Question Answeringregression

Aggressive saliency-aware point cloud compression

2023-07-20 · Eleftheria Psatha, Dimitrios Laskos, Gerasimos Arvanitis, Konstantinos Moustakas

The increasing demand for accurate representations of 3D scenes, combined with immersive technologies has led point clouds to extensive popularity. However, quality point clouds require a large amount of data and therefo…

Decoder

Towards Tight Bounds for Streaming Attention

2026-06-05 · Justin Y. Chen, Ying Feng, Piotr Indyk, Michael Kapralov 외 arxiv

The attention mechanism is a cornerstone of modern transformer architectures. However, its expressive power comes at the cost of quadratic runtime and linear space usage. In particular, the classical transformer architec…

Density Estimation