Meta-tuning Loss Functions and Data Augmentation for Few-shot Object Detection
Few-shot object detection, the problem of modelling novel object detection categories with few training instances, is an emerging topic in the area of few-shot learning and object detection. Contemporary techniques can be divided into two groups: fine-tuning based and meta-learning based approaches. While meta-learning approaches aim to learn dedicated meta-models for mapping samples to novel class models, fine-tuning approaches tackle few-shot detection in a simpler manner, by adapting the detection model to novel classes through gradient based optimization. Despite their simplicity, fine-tuning based approaches typically yield competitive detection results. Based on this observation, we focus on the role of loss functions and augmentations as the force driving the fine-tuning process, and propose to tune their dynamics through meta-learning principles. The proposed training scheme, therefore, allows learning inductive biases that can boost few-shot detection, while keeping the advantages of fine-tuning based approaches. In addition, the proposed approach yields interpretable loss functions, as opposed to highly parametric and complex few-shot meta-models. The experimental results highlight the merits of the proposed scheme, with significant improvements over the strong fine-tuning based few-shot detection baselines on benchmark Pascal VOC and MS-COCO datasets, in terms of both standard and generalized few-shot performance metrics.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationFew-Shot LearningFew-Shot Object DetectionMeta-LearningNovel Object DetectionObjectobject-detectionObject DetectionSimilar Papers 제목 키워드 기반
Evolving Loss Functions for Specific Image Augmentation Techniques
Previous work in Neural Loss Function Search (NLFS) has shown a lack of correlation between smaller surrogate functions and large convolutional neural networks with massive regularization. We expand upon this research by…
Image AugmentationMetaTPT: Meta Test-time Prompt Tuning for Vision-Language Models
Vision-language models (VLMs) such as CLIP exhibit strong zero-shot generalization but remain sensitive to domain shifts at test time. Test-time prompt tuning (TPT) mitigates this issue by adapting prompts with fixed aug…
Zero-shot GeneralizationDomain GeneralizationTest-time AdaptationReproducible Evaluation of Data Augmentation and Loss Functions for Brain Tumor Segmentation
Brain tumor segmentation is crucial for diagnosis and treatment planning, yet challenges such as class imbalance and limited model generalization continue to hinder progress. This work presents a reproducible evaluation …
Brain Tumor SegmentationData AugmentationA Generalized Meta Federated Learning Framework with Theoretical Convergence Guarantees
Meta federated learning (FL) is a personalized variant of FL, where multiple agents collaborate on training an initial shared model without exchanging raw data samples. The initial model should be trained in a way that c…
Federated LearningAugLoss: A Robust Augmentation-based Fine Tuning Methodology
Deep Learning (DL) models achieve great successes in many domains. However, DL models increasingly face safety and robustness concerns, including noisy labeling in the training stage and feature distribution shifts in th…
Data Augmentation