paper-with-me

홈 › Papers

CLIP: Train Faster with Less Data

2022-12-02 · Muhammad Asif Khan, Ridha Hamila, Hamid Menouar

Deep learning models require an enormous amount of data for training. However, recently there is a shift in machine learning from model-centric to data-centric approaches. In data-centric approaches, the focus is to refine and improve the quality of the data to improve the learning performance of the models rather than redesigning model architectures. In this paper, we propose CLIP i.e., Curriculum Learning with Iterative data Pruning. CLIP combines two data-centric approaches i.e., curriculum learning and dataset pruning to improve the model learning accuracy and convergence speed. The proposed scheme applies loss-aware dataset pruning to iteratively remove the least significant samples and progressively reduces the size of the effective dataset in the curriculum learning training. Extensive experiments performed on crowd density estimation models validate the notion behind combining the two approaches by reducing the convergence time and improving generalization. To our knowledge, the idea of data pruning as an embedded process in curriculum learning is novel.

📄 PDF Abstract BibTeX arXiv:2212.01452

Code (0)

등록된 구현이 없습니다.

Tasks

Density Estimation

Methods 이 논문이 사용한 방법론

Dataset Pruning Dataset pruning is an approach to reduce a large dataset to obtain a small dataset by removing less significant sample.
Pruning 설명 없음
CLIP Contrastive Language-Image Pre-training (CLIP), consisting of a simplified version of ConVIRT trained from scratch, is an efficient method of image representation learning…

Similar Papers 제목 키워드 기반

FedCliP: Federated Learning with Client Pruning

2023-01-17 · Beibei Li, Zerui Shao, Ao Liu, Peiran Wang

The prevalent communication efficient federated learning (FL) frameworks usually take advantages of model gradient compression or model distillation. However, the unbalanced local data distributions (either in quantity o…

Federated Learning

FASTER Recurrent Networks for Efficient Video Classification

2019-06-10 · Linchao Zhu, Laura Sevilla-Lara, Du Tran, Matt Feiszli 외

Typical video classification methods often divide a video into short clips, do inference on each clip independently, then aggregate the clip-level predictions to generate the video-level results. However, processing visu…

Action ClassificationAction RecognitionClassificationGeneral Classification+1

MobileViCLIP: An Efficient Video-Text Model for Mobile Devices

2025-08-10 · Min Yang, Zihan Jia, Zhilin Dai, Sheng Guo 외 arxiv

Efficient lightweight neural networks are with increasing attention due to their faster reasoning speed and easier deployment on mobile devices. However, existing video pre-trained models still focus on the common ViT ar…

ClipCap: CLIP Prefix for Image Captioning

2021-11-18 · Ron Mokady, Amir Hertz, Amit H. Bermano

Image captioning is a fundamental task in vision-language understanding, where the model predicts a textual informative caption to a given input image. In this paper, we present a simple approach to address this task. We…

Image CaptioningLanguage ModelingLanguage Modelling

CLIP-Joint-Detect: End-to-End Joint Training of Object Detectors with Contrastive Vision-Language Supervision

2025-12-28 · Behnam Raoufi, Hossein Sharify, Mohamad Mahdee Ramezanee, Khosrow Hajsadeghi 외 arxiv

Conventional object detectors rely on cross-entropy classification, which can be vulnerable to class imbalance and label noise. We propose CLIP-Joint-Detect, a simple and detector-agnostic framework that integrates CLIP-…