paper-with-me

홈 › Papers

Grassmannian Learning: Embedding Geometry Awareness in Shallow and Deep Learning

2018-08-07 · Jiayao Zhang, Guangxu Zhu, Robert W. Heath Jr., Kaibin Huang

Modern machine learning algorithms have been adopted in a range of signal-processing applications spanning computer vision, natural language processing, and artificial intelligence. Many relevant problems involve subspace-structured features, orthogonality constrained or low-rank constrained objective functions, or subspace distances. These mathematical characteristics are expressed naturally using the Grassmann manifold. Unfortunately, this fact is not yet explored in many traditional learning algorithms. In the last few years, there have been growing interests in studying Grassmann manifold to tackle new learning problems. Such attempts have been reassured by substantial performance improvements in both classic learning and learning using deep neural networks. We term the former as shallow and the latter deep Grassmannian learning. The aim of this paper is to introduce the emerging area of Grassmannian learning by surveying common mathematical problems and primary solution approaches, and overviewing various applications. We hope to inspire practitioners in different fields to adopt the powerful tool of Grassmannian learning in their research.

📄 PDF Abstract BibTeX arXiv:1808.02229

Code (1)

matthew-mcateer/Keras_pruning tf

Tasks

Deep Learning

Similar Papers 제목 키워드 기반

Expanding the Family of Grassmannian Kernels: An Embedding Perspective

2014-07-04 · Mehrtash T. Harandi, Mathieu Salzmann, Sadeep Jayasumana, Richard Hartley 외

Modeling videos and image-sets as linear subspaces has proven beneficial for many visual recognition tasks. However, it also incurs challenges arising from the fact that linear subspaces do not obey Euclidean geometry, b…

Clustering

Grassmannian Packings in Neural Networks: Learning with Maximal Subspace Packings for Diversity and Anti-Sparsity

2019-11-18 · Dian Ang Yap, Nicholas Roberts, Vinay Uday Prabhu

Kernel sparsity ("dying ReLUs") and lack of diversity are commonly observed in CNN kernels, which decreases model capacity. Drawing inspiration from information theory and wireless communications, we demonstrate the inte…

Diversity

Classification of Hyperspectral Imagery on Embedded Grassmannians

2015-02-03 · Sofya Chepushtanova, Michael Kirby

We propose an approach for capturing the signal variability in hyperspectral imagery using the framework of the Grassmann manifold. Labeled points from each class are sampled and used to form abstract points on the Grass…

ClassificationGeneral Classification

Shallow Syntax in Deep Water

2019-08-29 · Swabha Swayamdipta, Matthew Peters, Brendan Roof, Chris Dyer 외

Shallow syntax provides an approximation of phrase-syntactic structure of sentences; it can be produced with high accuracy, and is computationally cheap to obtain. We investigate the role of shallow syntax-aware represen…

Rapid Grassmannian Averaging with Chebyshev Polynomials

2024-10-11 · Brighton Ancelin, Alex Saad-Falcon, Kason Ancelin, Justin Romberg

We propose new algorithms to efficiently average a collection of points on a Grassmannian manifold in both the centralized and decentralized settings. Grassmannian points are used ubiquitously in machine learning, comput…