paper-with-me

홈 › Papers

SkelHCC: A Hyperbolic CLIP-Driven Cache Adaptation Framework for Skeleton-based One-Shot Action Recognition

2026-06-02 · Yanan Liu, Anqi Zhu, Jingmin Zhu, Jun Liu, Hossein Rahmani, Mohammed Bennamoun, Farid Boussaid, Dan Xu, Qiuhong Ke arxiv

Skeleton-based action recognition aims to understand human behaviors from body joint sequences and is especially challenging in the one-shot setting, where only a single labeled exemplar is available for each novel action. A key challenge is learning representations that capture the hierarchical and compositional structure of human motion while aligning effectively with high-level action semantics under extreme data scarcity. Existing approaches, largely based on Euclidean embeddings and low-level motion cues, struggle to model the tree-like organization of skeleton data, limiting cross-modal alignment and generalization to unseen action categories. We propose SkelHCC, a unified skeleton hyperbolic CLIP-driven cache adaptation framework for one-shot skeleton-based action recognition. SkelHCC introduces an Explicitly Hierarchical Hyperbolic CLIP (EH-HCLIP) module that embeds skeleton sequences and action language into a shared hyperbolic space. By leveraging the negative curvature and exponential volume growth of hyperbolic geometry, EH-HCLIP naturally encodes the joint-part-body hierarchy of human anatomy and yields structurally consistent cross-modal representations. To support efficient one-shot adaptation, SkelHCC further integrates a training-free LLM-guided Multi-granularity Voting Cache (LMV-Cache) for context-aware inference. Experiments on NTU RGB+D 60, NTU RGB+D 120, and PKU-MMD demonstrate that SkelHCC consistently outperforms state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2606.03610

Code (0)

등록된 구현이 없습니다.

Tasks

Action Recognition

Similar Papers 제목 키워드 기반

HAC: Parameter-Efficient Hyperbolic Adaptation of CLIP for Zero-Shot VQA

2026-04-26 · Francesco Dibitonto, Cigdem Beyan, Vittorio Murino arxiv

Recent advances in representation learning have shown that hyperbolic geometry can offer a more expressive alternative to the Euclidean embeddings used in CLIP models, capturing hierarchical structures and leading to bet…

Visual Question AnsweringRepresentation Learning

Advancing Cache-Based Few-Shot Classification via Patch-Driven Relational Gated Graph Attention

2025-12-13 · Tasweer Ahmad, Arindam Sikdar, Sandip Pradhan, Ardhendu Behera arxiv

Few-shot image classification remains difficult under limited supervision and visual domain shift. Recent cache-based adaptation approaches (e.g., Tip-Adapter) address this challenge to some extent by learning lightweigh…

Few-Shot Image Classification

Prototype-Based Test-Time Adaptation of Vision-Language Models

2026-04-23 · Zhaohong Huang, Yuxin Zhang, Wenjing Liu, Fei Chao 외 arxiv

Test-time adaptation (TTA) has emerged as a promising paradigm for vision-language models (VLMs) to bridge the distribution gap between pre-training and test data. Recent works have focused on backpropagation-free TTA me…

Test-time Adaptation

Understanding Fine-tuning CLIP for Open-vocabulary Semantic Segmentation in Hyperbolic Space

2025-01-01 · CVPR 2025 1 · Zelin Peng, Zhengqin Xu, Zhilin Zeng, Changsong Wen 외

CLIP, a foundational vision-language model, has emerged as a powerful tool for open-vocabulary semantic segmentation. While freezing the text encoder preserves its powerful embeddings, recent studies show that fine-t…

Open Vocabulary Semantic SegmentationOpen-Vocabulary Semantic SegmentationSegmentationSemantic Segmentation

Clipped Hyperbolic Classifiers Are Super-Hyperbolic Classifiers

2021-07-23 · CVPR 2022 1 · Yunhui Guo, Xudong Wang, Yubei Chen, Stella X. Yu

Hyperbolic space can naturally embed hierarchies, unlike Euclidean space. Hyperbolic Neural Networks (HNNs) exploit such representational power by lifting Euclidean features into hyperbolic space for classification, outp…

Adversarial RobustnessGeneral ClassificationOut-of-Distribution Detection