paper-with-me

Papers

Parameter-Efficient Active Learning for Foundational models

2024-06-13 · Athmanarayanan Lakshmi Narayanan, Ranganath Krishnan, Amrutha Machireddy, Mahesh Subedar

Foundational vision transformer models have shown impressive few shot performance on many vision tasks. This research presents a novel investigation into the application of parameter efficient fine-tuning methods within an active learning (AL) framework, to advance the sampling selection process in extremely budget constrained classification tasks. The focus on image datasets, known for their out-of-distribution characteristics, adds a layer of complexity and relevance to our study. Through a detailed evaluation, we illustrate the improved AL performance on these challenging datasets, highlighting the strategic advantage of merging parameter efficient fine tuning methods with foundation models. This contributes to the broader discourse on optimizing AL strategies, presenting a promising avenue for future exploration in leveraging foundation models for efficient and effective data annotation in specialized domains.

📄 PDF Abstract BibTeX arXiv:2406.09296

Code (0)

등록된 구현이 없습니다.

Tasks

Active Learningparameter-efficient fine-tuning

Methods 이 논문이 사용한 방법론

Residual Connection 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Focus 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Multi-Head Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Similar Papers 제목 키워드 기반

Yan: Foundational Interactive Video Generation

2025-08-12 · Deheng Ye, Fangyun Zhou, Jiacheng Lv, Jianqi Ma 외 arxiv

We present Yan, a foundational framework for interactive video generation, covering the entire pipeline from simulation and generation to editing. Specifically, Yan comprises three core modules. AAA-level Simulation: We …

Video Generation

Experimental Study on Time Series Analysis of Lower Limb Rehabilitation Exercise Data Driven by Novel Model Architecture and Large Models

2025-04-04 · Hengyu Lin

This study investigates the application of novel model architectures and large-scale foundational models in temporal series analysis of lower limb rehabilitation motion data, aiming to leverage advancements in machine le…

Time SeriesTime Series Analysis

Interactive Medical Image Segmentation: A Benchmark Dataset and Baseline

2024-11-19 · CVPR 2025 1 · Junlong Cheng, Bin Fu, Jin Ye, Guoan Wang 외

Interactive Medical Image Segmentation (IMIS) has long been constrained by the limited availability of large-scale, diverse, and densely annotated datasets, which hinders model generalization and consistent evaluation ac…

Image SegmentationInteractive SegmentationMedical Image SegmentationObject Recognition+2

UItron: Foundational GUI Agent with Advanced Perception and Planning

2025-08-29 · Zhixiong Zeng, Jing Huang, Liming Zheng, Wenkang Han 외 arxiv

GUI agent aims to enable automated operations on Mobile/PC devices, which is an important task toward achieving artificial general intelligence. The rapid advancement of VLMs accelerates the development of GUI agents, ow…

Reinforcement Learning

Foundational Automatic Evaluators: Scaling Multi-Task Generative Evaluator Training for Reasoning-Centric Domains

2025-10-20 · Austin Xu, Xuan-Phi Nguyen, Yilun Zhou, Chien-Sheng Wu 외 arxiv

Finetuning specialized generative evaluators has emerged as a popular paradigm to meet the increasing demand for scalable evaluation during both training and test-time. However, recent work has largely focused on applyin…

Reinforcement Learning