paper-with-me

홈 › Papers

Breaking the $1/\sqrt{n}$ Barrier: Faster Rates for Permutation-based Models in Polynomial Time

2018-02-27 · Cheng Mao, Ashwin Pananjady, Martin J. Wainwright

Many applications, including rank aggregation and crowd-labeling, can be modeled in terms of a bivariate isotonic matrix with unknown permutations acting on its rows and columns. We consider the problem of estimating such a matrix based on noisy observations of a subset of its entries, and design and analyze a polynomial-time algorithm that improves upon the state of the art. In particular, our results imply that any such $n \times n$ matrix can be estimated efficiently in the normalized Frobenius norm at rate $\widetilde{\mathcal O}(n^{-3/4})$, thus narrowing the gap between $\widetilde{\mathcal O}(n^{-1})$ and $\widetilde{\mathcal O}(n^{-1/2})$, which were hitherto the rates of the most statistically and computationally efficient methods, respectively.

📄 PDF Abstract BibTeX arXiv:1802.09963

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Faster width-dependent algorithm for mixed packing and covering LPs

2019-09-26 · NeurIPS 2019 12 · Digvijay Boob, Saurabh Sawlani, Di Wang

In this paper, we give a faster width-dependent algorithm for mixed packing-covering LPs. Mixed packing-covering LPs are fundamental to combinatorial optimization in computer science and operations research. Our algorith…

Combinatorial Optimization

Permutation-Based SGD: Is Random Optimal?

2021-02-19 · ICLR 2022 4 · Shashank Rajput, Kangwook Lee, Dimitris Papailiopoulos

A recent line of ground-breaking results for permutation-based SGD has corroborated a widely observed phenomenon: random permutations offer faster convergence than with-replacement sampling. However, is random optimal? W…

Analyzing the Role of Permutation Invariance in Linear Mode Connectivity

2025-03-08 · Keyao Zhan, Puheng Li, Lei Wu

It was empirically observed in Entezari et al. (2021) that when accounting for the permutation invariance of neural networks, there is likely no loss barrier along the linear interpolation between two SGD solutions -- a …

Linear Mode Connectivity

Breaking the $O(\sqrt{T})$ Cumulative Constraint Violation Barrier while Achieving $O(\sqrt{T})$ Static Regret in Constrained Online Convex Optimization

2026-03-21 · Haricharan Balasundaram, Karthick Krishna Mahendran, Rahul Vaze arxiv

The problem of constrained online convex optimization is considered, where at each round, once a learner commits to an action $x_t \in \mathcal{X} \subset \mathbb{R}^d$, a convex loss function $f_t$ and a convex constrai…

Decoupling Learning and Decision-Making: Breaking the $\mathcal{O}(\sqrt{T})$ Barrier in Online Resource Allocation with First-Order Methods

2024-02-11 · Wenzhi Gao, Chunlin Sun, Chenyu Xue, Dongdong Ge 외

Online linear programming plays an important role in both revenue management and resource allocation, and recent research has focused on developing efficient first-order online learning algorithms. Despite the empirical …

Decision MakingManagement