paper-with-me

홈 › Papers

COSCO: A Sharpness-Aware Training Framework for Few-shot Multivariate Time Series Classification

2024-09-15 · Jesus Barreda, Ashley Gomez, Ruben Puga, Kaixiong Zhou, Li Zhang

Multivariate time series classification is an important task with widespread domains of applications. Recently, deep neural networks (DNN) have achieved state-of-the-art performance in time series classification. However, they often require large expert-labeled training datasets which can be infeasible in practice. In few-shot settings, i.e. only a limited number of samples per class are available in training data, DNNs show a significant drop in testing accuracy and poor generalization ability. In this paper, we propose to address these problems from an optimization and a loss function perspective. Specifically, we propose a new learning framework named COSCO consisting of a sharpness-aware minimization (SAM) optimization and a Prototypical loss function to improve the generalization ability of DNN for multivariate time series classification problems under few-shot setting. Our experiments demonstrate our proposed method outperforms the existing baseline methods. Our source code is available at: https://github.com/JRB9/COSCO.

📄 PDF Abstract BibTeX arXiv:2409.09645

Code (1)

jrb9/cosco 공식 구현 pytorch

Tasks

ClassificationTime SeriesTime Series Classification

Methods 이 논문이 사용한 방법론

Sharpness-Aware Minimization Sharpness-Aware Minimization, or SAM, is a procedure that improves model generalization by simultaneously minimizing loss value and loss sharpness. SAM functions by…

Similar Papers 제목 키워드 기반

Sharpness-Aware Data Generation for Zero-shot Quantization

2025-10-08 · Dung Hoang-Anh, Cuong Pham Trung Le, Jianfei Cai, Thanh-Toan Do arxiv

Zero-shot quantization aims to learn a quantized model from a pre-trained full-precision model with no access to original real training data. The common idea in zero-shot quantization approaches is to generate synthetic …

Synthetic Data Generation

Zero-Shot Sharpness-Aware Quantization for Pre-trained Language Models

2023-10-20 · Miaoxi Zhu, Qihuang Zhong, Li Shen, Liang Ding 외

Quantization is a promising approach for reducing memory overhead and accelerating inference, especially in large pre-trained language model (PLM) scenarios. While having no access to original training data due to securi…

Language ModelingLanguage ModellingQuantization

Domain-Generalization to Improve Learning in Meta-Learning Algorithms

2025-08-13 · Usman Anjum, Chris Stockman, Cat Luong, Justin Zhan arxiv

This paper introduces Domain Generalization Sharpness-Aware Minimization Model-Agnostic Meta-Learning (DGS-MAML), a novel meta-learning algorithm designed to generalize across tasks with limited training data. DGS-MAML c…

Domain GeneralizationFew-Shot Learning

Le Lexicoscope : un outil pour l'\'etude de profils combinatoires et l'extraction de constructions lexico-syntaxiques (The Lexicoscope : an integrated tool for combinatoric profles observation and lexico-syntactic constructs extraction) [in French]

2012-06-01 · JEPTALNRECITAL 2012 6 · Olivier Kraif, Sascha Diwersy

DiscoScore: Evaluating Text Generation with BERT and Discourse Coherence

2022-01-26 · Wei Zhao, Michael Strube, Steffen Eger

Recently, there has been a growing interest in designing text generation systems from a discourse coherence perspective, e.g., modeling the interdependence between sentences. Still, recent BERT-based evaluation metrics a…

Document Level Machine TranslationMachine TranslationText Generation