paper-with-me

Papers

A Hypergradient Approach to Robust Regression without Correspondence

2020-11-30 · ICLR 2021 1 · Yujia Xie, Yixiu Mao, Simiao Zuo, Hongteng Xu, Xiaojing Ye, Tuo Zhao, Hongyuan Zha

We consider a variant of regression problem, where the correspondence between input and output data is not available. Such shuffled data is commonly observed in many real world problems. Taking flow cytometry as an example, the measuring instruments may not be able to maintain the correspondence between the samples and the measurements. Due to the combinatorial nature of the problem, most existing methods are only applicable when the sample size is small, and limited to linear regression models. To overcome such bottlenecks, we propose a new computational framework -- ROBOT -- for the shuffled regression problem, which is applicable to large data and complex nonlinear models. Specifically, we reformulate the regression without correspondence as a continuous optimization problem. Then by exploiting the interaction between the regression model and the data correspondence, we develop a hypergradient approach based on differentiable programming techniques. Such a hypergradient approach essentially views the data correspondence as an operator of the regression, and therefore allows us to find a better descent direction for the model parameter by differentiating through the data correspondence. ROBOT can be further extended to the inexact correspondence setting, where there may not be an exact alignment between the input and output data. Thorough numerical experiments show that ROBOT achieves better performance than existing methods in both linear and nonlinear regression tasks, including real-world applications such as flow cytometry and multi-object tracking.

📄 PDF Abstract BibTeX arXiv:2012.00123

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-Object TrackingObject Trackingregression

Methods 이 논문이 사용한 방법론

Linear Regression Linear Regression is a method for modelling a relationship between a dependent variable and independent variables. These models can be fit with numerous approaches. The most…

Similar Papers 제목 키워드 기반

Glocal Hypergradient Estimation with Koopman Operator

2024-02-05 · Ryuichiro Hataya, Yoshinobu Kawahara

Gradient-based hyperparameter optimization methods update hyperparameters using hypergradients, gradients of a meta criterion with respect to hyperparameters. Previous research used two distinct update strategies: optimi…

Hyperparameter Optimization

Enhancing Hypergradients Estimation: A Study of Preconditioning and Reparameterization

2024-02-26 · Zhenzhang Ye, Gabriel Peyré, Daniel Cremers, Pierre Ablin

Bilevel optimization aims to optimize an outer objective function that depends on the solution to an inner optimization problem. It is routinely used in Machine Learning, notably for hyperparameter tuning. The convention…

Bilevel Optimization

Differentiable Self-Adaptive Learning Rate

2022-10-19 · Bozhou Chen, Hongzhi Wang, Chenmin Ba

Learning rate adaptation is a popular topic in machine learning. Gradient Descent trains neural nerwork with a fixed learning rate. Learning rate adaptation is proposed to accelerate the training process through adjustin…

Sample-Efficient Hypergradient Estimation for Decentralized Bi-Level Reinforcement Learning

2026-03-16 · Mikoto Kudo, Takumi Tanabe, Akifumi Wachi, Youhei Akimoto arxiv

Many strategic decision-making problems, such as environment design for warehouse robots, can be naturally formulated as bi-level reinforcement learning (RL), where a leader agent optimizes its objective while a follower…

Reinforcement Learning

Linear Regression without Correspondences via Concave Minimization

2020-03-17 · Liangzu Peng, Manolis C. Tsakiris

Linear regression without correspondences concerns the recovery of a signal in the linear regression setting, where the correspondences between the observations and the linear functionals are unknown. The associated maxi…

regression