paper-with-me

홈 › Papers

Interval Bound Interpolation for Few-shot Learning with Few Tasks

2022-04-07 · Shounak Datta, Sankha Subhra Mullick, Anish Chakrabarty, Swagatam Das

Few-shot learning aims to transfer the knowledge acquired from training on a diverse set of tasks to unseen tasks from the same task distribution with a limited amount of labeled data. The underlying requirement for effective few-shot generalization is to learn a good representation of the task manifold. This becomes more difficult when only a limited number of tasks are available for training. In such a few-task few-shot setting, it is beneficial to explicitly preserve the local neighborhoods from the task manifold and exploit this to generate artificial tasks for training. To this end, we introduce the notion of interval bounds from the provably robust training literature to few-shot learning. The interval bounds are used to characterize neighborhoods around the training tasks. These neighborhoods can then be preserved by minimizing the distance between a task and its respective bounds. We then use a novel strategy to artificially form new tasks for training by interpolating between the available tasks and their respective interval bounds. We apply our framework to both model-agnostic meta-learning as well as prototype-based metric-learning paradigms. The efficacy of our proposed approach is evident from the improved performance on several datasets from diverse domains compared to current methods.

📄 PDF Abstract BibTeX arXiv:2204.03511

Code (1)

sankhasubhra/maml-ibp-ibi 공식 구현 pytorch

Tasks

Few-Shot LearningMeta-LearningMetric Learning

Similar Papers 제목 키워드 기반

Cubic Spline Smoothing Compensation for Irregularly Sampled Sequences

2020-10-03 · Jing Shi, Jing Bi, Yingru Liu, Chenliang Xu

The marriage of recurrent neural networks and neural ordinary differential networks (ODE-RNN) is effective in modeling irregularly-observed sequences. While ODE produces the smooth hidden states between observation inter…

A Training-Free Length Extrapolation Approach for LLMs: Greedy Attention Logit Interpolation (GALI)

2025-02-04 · Yan Li, Tianyi Zhang, Zechuan Li, Soyeon Caren Han

Transformer-based Large Language Models (LLMs) struggle to process inputs exceeding their training context window, with performance degrading due to positional out-of-distribution (O.O.D.) that disrupt attention computat…

Long-Context Understanding

Faking Interpolation Until You Make It

2021-09-29 · Alasdair Paren, Rudra Poudel, M. Pawan Kumar

Deep over-parameterized neural networks exhibit the interpolation property on many data sets. That is, these models are able to achieve approximately zero loss on all training samples simultaneously. Recently, this prope…

Compact Finite Difference Scheme with Hermite Interpolation for Pricing American Put Options Based on Regime Switching Model

2019-08-14 · Chinonso Nwankwo, Weizhong Dai, Ruihua Liu

We consider a system of coupled free boundary problems for pricing American put options with regime-switching. To solve this system, we first employ the logarithmic transformation to map the free boundary for each regime…

Event-Enhanced Snapshot Compressive Videography at 10K FPS

2024-04-11 · Bo Zhang, Jinli Suo, Qionghai Dai

Video snapshot compressive imaging (SCI) encodes the target dynamic scene compactly into a snapshot and reconstructs its high-speed frame sequence afterward, greatly reducing the required data footprint and transmission …

Video Frame Interpolation