paper-with-me

Papers

Compact Approximation for Polynomial of Covariance Feature

2019-06-05 · Yusuke Mukuta, Tatsuaki Machida, Tatsuya Harada

Covariance pooling is a feature pooling method with good classification accuracy. Because covariance features consist of second-order statistics, the scale of the feature elements are varied. Therefore, normalizing covariance features using a matrix square root affects the performance improvement. When pooling methods are applied to local features extracted from CNN models, the accuracy increases when the pooling function is back-propagatable and the feature-extraction model is learned in an end-to-end manner. Recently, the iterative polynomial approximation method for the matrix square root of a covariance feature was proposed, and resulted in a faster and more stable training than the methods based on singular-value decomposition. In this paper, we propose an extension of compact bilinear pooling, which is a compact approximation of the standard covariance feature, to the polynomials of the covariance feature. Subsequently, we apply the proposed approximation to the polynomial corresponding to the matrix square root to obtain a compact approximation for the square root of the covariance feature. Our method approximates a higher-dimensional polynomial of a covariance by the weighted sum of the approximate features corresponding to a pair of local features based on the similarity of the local features. We apply our method for standard fine-grained image recognition datasets and demonstrate that the proposed method shows comparable accuracy with fewer dimensions than the original feature.

📄 PDF Abstract BibTeX arXiv:1906.01851

Code (0)

등록된 구현이 없습니다.

Tasks

Fine-Grained Image Recognition

Similar Papers 제목 키워드 기반

Spherical Random Features for Polynomial Kernels

2015-12-01 · NeurIPS 2015 12 · Jeffrey Pennington, Felix Xinnan X. Yu, Sanjiv Kumar

Compact explicit feature maps provide a practical framework to scale kernel methods to large-scale learning, but deriving such maps for many types of kernels remains a challenging open problem. Among the commonly used ke…

General Classification

Compact Random Feature Maps

2013-12-17 · Raffay Hamid, Ying Xiao, Alex Gittens, Dennis Decoste

Kernel approximation using randomized feature maps has recently gained a lot of interest. In this work, we identify that previous approaches for polynomial kernel approximation create maps that are rank deficient, and th…

Universal approximation results for neural networks with non-polynomial activation function over non-compact domains

2024-10-18 · Ariel Neufeld, Philipp Schmocker

This paper extends the universal approximation property of single-hidden-layer feedforward neural networks beyond compact domains, which is of particular interest for the approximation within weighted $C^k$-spaces and we…

(MPO)$^2$: Multivariate Polynomial Optimization based on Matrix Product Operators

2026-07-17 · Niccolò Ciolli, Anders Vestergaard Nørskov, Michael Kastoryano, Petr Taborsky 외 arxiv

Central to machine learning and signal processing is the ability to perform universal function approximation and learn complex input-output relationships from limited numbers of observations. Multivariate polynomial mode…

Orthogonal Polynomial Approximation for Matrix Log Normalization in Global Covariance Pooling

2026-08-19 · Md Rifat Ur Rahman, Md Raihan Khan, Md Sakib Hossain Shovon, Pietro Liò 외 arxiv

Global Covariance Pooling (GCP) improves deep networks by capturing second-order feature statistics, and is especially effective for fine-grained recognition. Because covariance matrices live on the Symmetric Positive De…