paper-with-me

홈 › Papers

A Novel Normalized-Cut Solver with Nearest Neighbor Hierarchical Initialization

2023-11-26 · Feiping Nie, Jitao Lu, Danyang Wu, Rong Wang, Xuelong Li

Normalized-Cut (N-Cut) is a famous model of spectral clustering. The traditional N-Cut solvers are two-stage: 1) calculating the continuous spectral embedding of normalized Laplacian matrix; 2) discretization via $K$-means or spectral rotation. However, this paradigm brings two vital problems: 1) two-stage methods solve a relaxed version of the original problem, so they cannot obtain good solutions for the original N-Cut problem; 2) solving the relaxed problem requires eigenvalue decomposition, which has $\mathcal{O}(n^3)$ time complexity ($n$ is the number of nodes). To address the problems, we propose a novel N-Cut solver designed based on the famous coordinate descent method. Since the vanilla coordinate descent method also has $\mathcal{O}(n^3)$ time complexity, we design various accelerating strategies to reduce the time complexity to $\mathcal{O}(|E|)$ ($|E|$ is the number of edges). To avoid reliance on random initialization which brings uncertainties to clustering, we propose an efficient initialization method that gives deterministic outputs. Extensive experiments on several benchmark datasets demonstrate that the proposed solver can obtain larger objective values of N-Cut, meanwhile achieving better clustering performance compared to traditional solvers.

📄 PDF Abstract BibTeX arXiv:2311.15214

Code (0)

등록된 구현이 없습니다.

Tasks

Clustering

Similar Papers 제목 키워드 기반

EFANNA : An Extremely Fast Approximate Nearest Neighbor Search Algorithm Based on kNN Graph

2016-09-23 · Cong Fu, Deng Cai

Approximate nearest neighbor (ANN) search is a fundamental problem in many areas of data mining, machine learning and computer vision. The performance of traditional hierarchical structure (tree) based methods decreases …

graph construction

Solver Recommendation For Transport Problems in Slabs Using Machine Learning

2019-06-19 · Jinzhao Chen, Japan K. Patel, Richard Vasques

The use of machine learning algorithms to address classification problems is on the rise in many research areas. The current study is aimed at testing the potential of using such algorithms to auto-select the best solver…

BIG-bench Machine LearningGeneral Classification

LANNS: A Web-Scale Approximate Nearest Neighbor Lookup System

2020-10-19 · Ishita Doshi, Dhritiman Das, Ashish Bhutani, Rajeev Kumar 외

Nearest neighbor search (NNS) has a wide range of applications in information retrieval, computer vision, machine learning, databases, and other areas. Existing state-of-the-art algorithm for nearest neighbor search, Hie…

Information RetrievalPlaying the Game of 2048Retrieval

Synthetic Reduced Nearest Neighbor Model for Regression

2021-09-29 · Pooya Tavallali, Vahid Behzadan, Mukesh Singhal

Nearest neighbor models are among the most established and accurate approaches to machine learning. In this paper, we investigate Synthetic Reduced Nearest Neighbor (SRNN) as a novel approach to regression tasks. Existin…

Binary Classificationmodelregression

A Hierarchical Multi-Output Nearest Neighbor Model for Multi-Output Dependence Learning

2014-10-17 · Richard G. Morris, Tony Martinez, Michael R. Smith

Multi-Output Dependence (MOD) learning is a generalization of standard classification problems that allows for multiple outputs that are dependent on each other. A primary issue that arises in the context of MOD learning…

General Classification