paper-with-me

홈 › Papers

Semantic Inference Network for Few-shot Streaming Label Learning

2021-01-01 · Zhen Wang, Liu Liu, Yiqun Duan, DaCheng Tao

Streaming label learning aims to model newly emerged labels for multi-label classification systems, which requires plenty of new label data for training. However, in changing environments, only a small amount of new label data can practically be collected. In this work, we formulate and study few-shot streaming label learning (FSLL), which models emerging new labels with only a few annotated examples by utilizing the knowledge learned from past labels. We propose a meta-learning framework, Semantic Inference Network (SIN), which can learn and infer the semantic correlation between new labels and past labels to adapt FSLL tasks from a few examples effectively. SIN leverages label semantic representation to regularize the output space and acquires label-wise meta-knowledge based on the gradient-based meta-learning. Moreover, SIN incorporates a novel label decision module with a meta-threshold loss to find the optimal confidence thresholds for each new label. Theoretically, we demonstrate that the proposed semantic inference mechanism could constrain the complexity of hypotheses space to reduce the risk of overfitting and achieve better generalizability. Experimentally, extensive empirical results and ablation studies illustrate the superior performance of SIN over the prior state-of-the-art methods on FSLL.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Meta-LearningMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATION

Similar Papers 제목 키워드 기반

StreamVoice: Streamable Context-Aware Language Modeling for Real-time Zero-Shot Voice Conversion

2024-01-19 · Zhichao Wang, Yuanzhe Chen, Xinsheng Wang, Lei Xie 외

Recent language model (LM) advancements have showcased impressive zero-shot voice conversion (VC) performance. However, existing LM-based VC models usually apply offline conversion from source semantics to acoustic featu…

Language ModelingLanguage ModellingVoice Conversion

PROSPECT: Unified Streaming Vision-Language Navigation via Semantic--Spatial Fusion and Latent Predictive Representation

2026-03-04 · Zehua Fan, Wenqi Lyu, Wenxuan Song, Linge Zhao 외 arxiv

Multimodal large language models (MLLMs) have advanced zero-shot end-to-end Vision-Language Navigation (VLN), yet robust navigation requires not only semantic understanding but also predictive modeling of environment dyn…

Vision-Language NavigationRepresentation Learning

ActionPlan: Future-Aware Streaming Motion Synthesis via Frame-Level Action Planning

2026-03-13 · Eric Nazarenus, Chuqiao Li, Yannan He, Xianghui Xie 외 arxiv

We present ActionPlan, a unified motion diffusion framework that bridges real-time streaming with high-quality offline generation within a single model. The core idea is to introduce a per-frame action plan: the model pr…

Motion Synthesis

X-VC: Zero-shot Streaming Voice Conversion in Codec Space

2026-04-14 · Qixi Zheng, Yuxiang Zhao, Tianrui Wang, Wenxi Chen 외 arxiv

Zero-shot voice conversion (VC) aims to convert a source utterance into the voice of an unseen target speaker while preserving its linguistic content. Although recent systems have improved conversion quality, building ze…

Voice Conversion

StreamVoice+: Evolving into End-to-end Streaming Zero-shot Voice Conversion

2024-08-05 · Zhichao Wang, Yuanzhe Chen, Xinsheng Wang, Lei Xie 외

StreamVoice has recently pushed the boundaries of zero-shot voice conversion (VC) in the streaming domain. It uses a streamable language model (LM) with a context-aware approach to convert semantic features from automati…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Language Modellingspeech-recognition+2