paper-with-me

홈 › Papers

Submodular Framework for Structured-Sparse Optimal Transport

2024-06-07 · Piyushi Manupriya, Pratik Jawanpuria, Karthik S. Gurumoorthy, SakethaNath Jagarlapudi, Bamdev Mishra

Unbalanced optimal transport (UOT) has recently gained much attention due to its flexible framework for handling un-normalized measures and its robustness properties. In this work, we explore learning (structured) sparse transport plans in the UOT setting, i.e., transport plans have an upper bound on the number of non-sparse entries in each column (structured sparse pattern) or in the whole plan (general sparse pattern). We propose novel sparsity-constrained UOT formulations building on the recently explored maximum mean discrepancy based UOT. We show that the proposed optimization problem is equivalent to the maximization of a weakly submodular function over a uniform matroid or a partition matroid. We develop efficient gradient-based discrete greedy algorithms and provide the corresponding theoretical guarantees. Empirically, we observe that our proposed greedy algorithms select a diverse support set and we illustrate the efficacy of the proposed approach in various applications.

📄 PDF Abstract BibTeX arXiv:2406.04914

Code (1)

Piyushi-0/Sparse-UOT 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Optimal approximation for unconstrained non-submodular minimization

2019-05-29 · ICML 2020 1 · Marwa El Halabi, Stefanie Jegelka

Submodular function minimization is well studied, and existing algorithms solve it exactly or up to arbitrary accuracy. However, in many applications, such as structured sparse learning or batch Bayesian optimization, th…

Bayesian OptimizationSparse Learning

SPOT: A framework for selection of prototypes using optimal transport

2021-03-18 · Karthik S. Gurumoorthy, Pratik Jawanpuria, Bamdev Mishra

In this work, we develop an optimal transport (OT) based framework to select informative prototypical examples that best represent a given target dataset. Summarizing a given target dataset via representative examples is…

Decision MakingPrototype Selection

Parametric Maxflows for Structured Sparse Learning with Convex Relaxations of Submodular Functions

2015-09-14 · Yoshinobu Kawahara, Yutaro Yamaguchi

The proximal problem for structured penalties obtained via convex relaxations of submodular functions is known to be equivalent to minimizing separable convex functions over the corresponding submodular polyhedra. In thi…

Sparse Learning

Structured Convex Optimization under Submodular Constraints

2013-09-26 · Kiyohito Nagano, Yoshinobu Kawahara

A number of discrete and continuous optimization problems in machine learning are related to convex minimization problems under submodular constraints. In this paper, we deal with a submodular function with a directed gr…

BIG-bench Machine Learning

On Prior Distributions and Approximate Inference for Structured Variables

2014-12-01 · NeurIPS 2014 12 · Oluwasanmi O. Koyejo, Rajiv Khanna, Joydeep Ghosh, Russell Poldrack

We present a general framework for constructing prior distributions with structured variables. The prior is defined as the information projection of a base distribution onto distributions supported on the constraint set …