paper-with-me

Papers

Probing the Intra-Component Correlations within Fisher Vector for Material Classification

2016-04-15 · Xiaopeng Hong, Xianbiao Qi, Guoying Zhao, Matti Pietikäinen

Fisher vector (FV) has become a popular image representation. One notable underlying assumption of the FV framework is that local descriptors are well decorrelated within each cluster so that the covariance matrix for each Gaussian can be simplified to be diagonal. Though the FV usually relies on the Principal Component Analysis (PCA) to decorrelate local features, the PCA is applied to the entire training data and hence it only diagonalizes the \textit{universal} covariance matrix, rather than those w.r.t. the local components. As a result, the local decorrelation assumption is usually not supported in practice. To relax this assumption, this paper proposes a completed model of the Fisher vector, which is termed as the Completed Fisher vector (CFV). The CFV is a more general framework of the FV, since it encodes not only the variances but also the correlations of the whitened local descriptors. The CFV thus leads to improved discriminative power. We take the task of material categorization as an example and experimentally show that: 1) the CFV outperforms the FV under all parameter settings; 2) the CFV is robust to the changes in the number of components in the mixture; 3) even with a relatively small visual vocabulary the CFV still works well on two challenging datasets.

📄 PDF Abstract BibTeX arXiv:1604.04473

Code (0)

등록된 구현이 없습니다.

Tasks

General ClassificationMaterial Classification

Methods 이 논문이 사용한 방법론

PCA Principle Components Analysis (PCA) is an unsupervised method primary used for dimensionality reduction within machine learning. PCA is calculated via a singular value…

Similar Papers 제목 키워드 기반

Do We Know What LLMs Don't Know? A Study of Consistency in Knowledge Probing

2025-05-27 · Raoyuan Zhao, Abdullatif Köksal, Ali Modarressi, Michael A. Hedderich 외

The reliability of large language models (LLMs) is greatly compromised by their tendency to hallucinate, underscoring the need for precise identification of knowledge gaps within LLMs. Various methods for probing such ga…

Knowledge Probing

Universal Response and Emergence of Induction in LLMs

2024-11-11 · Niclas Luick

While induction is considered a key mechanism for in-context learning in LLMs, understanding its precise circuit decomposition beyond toy models remains elusive. Here, we study the emergence of induction behavior within …

In-Context Learning

Zero-Direction Probing: A Linear-Algebraic Framework for Deep Analysis of Large-Language-Model Drift

2025-08-09 · Amit Pandey arxiv

We present Zero-Direction Probing (ZDP), a theory-only framework for detecting model drift from null directions of transformer activations without task labels or output evaluations. Under assumptions A1--A6, we prove: (i…

When Answers Stray from Questions: Hallucination Detection via Question-Answer Orthogonal Decomposition

2026-05-14 · Siyang Yao, Erhu Feng, Yubin Xia arxiv

Hallucination detection in large language models (LLMs) requires balancing accu racy, efficiency, and robustness to distribution shift. Black-box consistency methods are effective but demand repeated inference; single-pa…

Domain Generalization

General Incremental Learning with Domain-aware Categorical Representations

2022-04-08 · CVPR 2022 1 · Jiangwei Xie, Shipeng Yan, Xuming He

Continual learning is an important problem for achieving human-level intelligence in real-world applications as an agent must continuously accumulate knowledge in response to streaming data/tasks. In this work, we consid…

class-incremental learningClass Incremental LearningContinual LearningIncremental Learning