paper-with-me

Papers

Inconsistent Few-Shot Relation Classification via Cross-Attentional Prototype Networks with Contrastive Learning

2021-10-13 · Hongru Wang, Zhijing Jin, Jiarun Cao, Gabriel Pui Cheong Fung, Kam-Fai Wong

Standard few-shot relation classification (RC) is designed to learn a robust classifier with only few labeled data for each class. However, previous works rarely investigate the effects of a different number of classes (i.e., $N$-way) and number of labeled data per class (i.e., $K$-shot) during training vs. testing. In this work, we define a new task, \textit{inconsistent few-shot RC}, where the model needs to handle the inconsistency of $N$ and $K$ between training and testing. To address this new task, we propose Prototype Network-based cross-attention contrastive learning (ProtoCACL) to capture the rich mutual interactions between the support set and query set. Experimental results demonstrate that our ProtoCACL can outperform the state-of-the-art baseline model under both inconsistent $K$ and inconsistent $N$ settings, owing to its more robust and discriminate representations. Moreover, we identify that in the inconsistent few-shot learning setting, models can achieve better performance with \textit{less data} than the standard few-shot setting with carefully-selected $N$ and $K$. In the end of the paper, we provide further analyses and suggestions to systematically guide the selection of $N$ and $K$ under different scenarios.

📄 PDF Abstract BibTeX arXiv:2110.08254

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningFew-Shot LearningFew-Shot Relation ClassificationRelationRelation Classification

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

VideoCoCa: Video-Text Modeling with Zero-Shot Transfer from Contrastive Captioners

2022-12-09 · Shen Yan, Tao Zhu, ZiRui Wang, Yuan Cao 외

We explore an efficient approach to establish a foundational video-text model. We present VideoCoCa that maximally reuses a pretrained image-text contrastive captioner (CoCa) model and adapt it to video-text tasks with m…

Question AnsweringRetrievalText to Video RetrievalVideo Captioning+7

Attentional Meta-learners for Few-shot Polythetic Classification

2021-06-09 · Ben Day, Ramon Viñas, Nikola Simidjievski, Pietro Liò

Polythetic classifications, based on shared patterns of features that need neither be universal nor constant among members of a class, are common in the natural world and greatly outnumber monothetic classifications over…

Classificationfeature selectionFew-Shot LearningMeta-Learning

Adaptive Attentional Network for Few-Shot Knowledge Graph Completion

2020-10-19 · EMNLP 2020 11 · Jiawei Sheng, Shu Guo, Zhenyu Chen, Juwei Yue 외

Few-shot Knowledge Graph (KG) completion is a focus of current research, where each task aims at querying unseen facts of a relation given its few-shot reference entity pairs. Recent attempts solve this problem by learni…

Knowledge Graph CompletionLink Prediction

Fully Attentional Network for Semantic Segmentation

2021-12-08 · Qi Song, Jie Li, Chenghong Li, Hao Guo 외

Recent non-local self-attention methods have proven to be effective in capturing long-range dependencies for semantic segmentation. These methods usually form a similarity map of RC*C (by compressing spatial dimensions) …

Computational EfficiencySegmentationSemantic Segmentation

Relation Network for Multi-label Aerial Image Classification

2019-07-16 · Yuansheng Hua, Lichao Mou, Xiao Xiang Zhu

Multi-label classification plays a momentous role in perceiving intricate contents of an aerial image and triggers several related studies over the last years. However, most of them deploy few efforts in exploiting label…

ClassificationGeneral Classificationimage-classificationImage Classification+5