paper-with-me

Papers

Scalable Semi-Supervised Learning over Networks using Nonsmooth Convex Optimization

2016-11-02 · Alexander Jung, Alfred O. Hero III, Alexandru Mara, Sabeur Aridhi

We propose a scalable method for semi-supervised (transductive) learning from massive network-structured datasets. Our approach to semi-supervised learning is based on representing the underlying hypothesis as a graph signal with small total variation. Requiring a small total variation of the graph signal representing the underlying hypothesis corresponds to the central smoothness assumption that forms the basis for semi-supervised learning, i.e., input points forming clusters have similar output values or labels. We formulate the learning problem as a nonsmooth convex optimization problem which we solve by appealing to Nesterovs optimal first-order method for nonsmooth optimization. We also provide a message passing formulation of the learning method which allows for a highly scalable implementation in big data frameworks.

📄 PDF Abstract BibTeX arXiv:1611.00714

Code (0)

등록된 구현이 없습니다.

Tasks

Transductive Learning

Similar Papers 제목 키워드 기반

A Stochastic Semismooth Newton Method for Nonsmooth Nonconvex Optimization

2018-03-09 · Andre Milzarek, Xiantao Xiao, Shicong Cen, Zaiwen Wen 외

In this work, we present a globalized stochastic semismooth Newton method for solving stochastic optimization problems involving smooth nonconvex and nonsmooth convex terms in the objective function. We assume that only …

Binary ClassificationStochastic Optimization

Low-Rank Extragradient Methods for Scalable Semidefinite Optimization

2024-02-14 · Dan Garber, Atara Kaplan

We consider several classes of highly important semidefinite optimization problems that involve both a convex objective function (smooth or nonsmooth) and additional linear or nonlinear smooth and convex constraints, whi…

Combinatorial Optimization

Scalable nonconvex inexact proximal splitting

2012-12-01 · NeurIPS 2012 12 · Suvrit Sra

We study large-scale, nonsmooth, nonconconvex optimization problems. In particular, we focus on nonconvex problems with \emph{composite} objectives. This class of problems includes the extensively studied convex, composi…

Conservative set valued fields, automatic differentiation, stochastic gradient method and deep learning

2019-09-23 · Jérôme Bolte, Edouard Pauwels

Modern problems in AI or in numerical analysis require nonsmooth approaches with a flexible calculus. We introduce generalized derivatives called conservative fields for which we develop a calculus and provide representa…

Complexity of Finding Stationary Points of Nonsmooth Nonconvex Functions

2020-02-10 · Jingzhao Zhang, Hongzhou Lin, Stefanie Jegelka, Ali Jadbabaie 외

We provide the first non-asymptotic analysis for finding stationary points of nonsmooth, nonconvex functions. In particular, we study the class of Hadamard semi-differentiable functions, perhaps the largest class of nons…