paper-with-me

홈 › Papers

Sequence Summarization Using Order-constrained Kernelized Feature Subspaces

2017-05-24 · Anoop Cherian, Suvrit Sra, Richard Hartley

Representations that can compactly and effectively capture temporal evolution of semantic content are important to machine learning algorithms that operate on multi-variate time-series data. We investigate such representations motivated by the task of human action recognition. Here each data instance is encoded by a multivariate feature (such as via a deep CNN) where action dynamics are characterized by their variations in time. As these features are often non-linear, we propose a novel pooling method, kernelized rank pooling, that represents a given sequence compactly as the pre-image of the parameters of a hyperplane in an RKHS, projections of data onto which captures their temporal order. We develop this idea further and show that such a pooling scheme can be cast as an order-constrained kernelized PCA objective; we then propose to use the parameters of a kernelized low-rank feature subspace as the representation of the sequences. We cast our formulation as an optimization problem on generalized Grassmann manifolds and then solve it efficiently using Riemannian optimization techniques. We present experiments on several action recognition datasets using diverse feature modalities and demonstrate state-of-the-art results.

📄 PDF Abstract BibTeX arXiv:1705.08583

Code (0)

등록된 구현이 없습니다.

Tasks

Action RecognitionRiemannian optimizationTemporal Action LocalizationTime SeriesTime Series Analysis

Methods 이 논문이 사용한 방법론

PCA Principle Components Analysis (PCA) is an unsupervised method primary used for dimensionality reduction within machine learning. PCA is calculated via a singular value…

Similar Papers 제목 키워드 기반

Non-Linear Temporal Subspace Representations for Activity Recognition

2018-03-27 · CVPR 2018 6 · Anoop Cherian, Suvrit Sra, Stephen Gould, Richard Hartley

Representations that can compactly and effectively capture the temporal evolution of semantic content are important to computer vision and machine learning algorithms that operate on multi-variate time-series data. We in…

Action RecognitionActivity RecognitionRiemannian optimizationTemporal Action Localization+2

Kernelized Few-Shot Object Detection With Efficient Integral Aggregation

2022-01-01 · CVPR 2022 1 · Shan Zhang, Lei Wang, Naila Murray, Piotr Koniusz

We design a Kernelized Few-shot Object Detector by leveraging kernelized matrices computed over multiple proposal regions, which yield expressive non-linear representations whose model complexity is learned on the fl…

Few-Shot Object DetectionObjectobject-detectionObject Detection+1

SchoenbAt: Rethinking Attention with Polynomial basis

2025-05-18 · Yuhan Guo, Lizhong Ding, Yuwan Yang, Xuewei Guo

Kernelized attention extends the attention mechanism by modeling sequence correlations through kernel functions, making significant progresses in optimizing attention. Under the guarantee of harmonic analysis theory, ker…

Cluster and Aggregate: Face Recognition with Large Probe Set

2022-10-19 · Minchul Kim, Feng Liu, Anil Jain, Xiaoming Liu

Feature fusion plays a crucial role in unconstrained face recognition where inputs (probes) comprise of a set of $N$ low quality images whose individual qualities vary. Advances in attention and recurrent modules have le…

Face RecognitionFace VerificationSurveillance-to-BookingSurveillance-to-Single+2

P$^3$LM: Probabilistically Permuted Prophet Language Modeling for Generative Pre-Training

2022-10-22 · Junwei Bao, Yifan Wang, Jiangyong Ying, Yeyun Gong 외

Conventional autoregressive left-to-right (L2R) sequence generation faces two issues during decoding: limited to unidirectional target sequence modeling, and constrained on strong local dependencies. To address the afore…

Conversational Question AnsweringDecoderLanguage ModelingLanguage Modelling+4