paper-with-me

홈 › Papers

Argus: A Compact and Versatile Foundation Model for Vision

2025-01-01 · CVPR 2025 1 · Weiming Zhuang, Chen Chen, Zhizhong Li, Sina Sajadmanesh, Jingtao Li, Jiabo Huang, Vikash Sehwag, Vivek Sharma, Hirotaka Shinozaki, Felan Carlo Garcia, Yihao Zhan, Naohiro Adachi, Ryoji Eki, Michael Spranger, Peter Stone, Lingjuan Lyu

While existing vision and multi-modal foundation models can handle multiple computer vision tasks, they often suffer from significant limitations, including huge demand for data and computational resources during training and inconsistent performance across vision tasks at deployment time. To address these challenges, we introduce Argus (The name comes from Argus Panoptes -- a hundred-eyed giant with "all-seeing" capability in Greek mythology), a compact and versatile vision foundation model designed to support a wide range of vision tasks through a unified multitask architecture. Argus employs a two-stage training strategy: (i) multitask pretraining over core vision tasks with a shared backbone that includes a lightweight adapter to inject task-specific inductive biases, and (ii) scalable and efficient adaptation to new tasks by fine-tuning only the task-specific decoders. Extensive evaluations demonstrate that Argus, despite its relatively compact and training-efficient design of merely 100M backbone parameters (only 13.6% of which are trained using 1.6M images), competes with and even surpasses much larger models. Compared to state-of-the-art foundation models, Argus not only covers a broader set of vision tasks but also matches or outperforms the models with similar sizes on 12 tasks. We expect that Argus will accelerate the real-world adoption of vision foundation models in resource-constrained scenarios.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Adapter 설명 없음

Similar Papers 제목 키워드 기반

Argus-Unified: Towards A Compact and Economical Unified Model for Image Understanding and Generation

2026-07-28 · Weiming Zhuang, Jiabo Huang, Jingtao Li, Zhizhong Li 외 arxiv

Unifying visual understanding and generation in one model holds immense promise, but remains challenging and expensive due to heavy compute and data demands and conflicts between the visual features needed for these two …

Empirical Recipes for Efficient and Compact Vision-Language Models

2026-03-17 · Jiabo Huang, Zhizhong Li, Sina Sajadmanesh, Weiming Zhuang 외 arxiv

Deploying vision-language models (VLMs) in resource-constrained settings demands low latency and high throughput, yet existing compact VLMs often fall short of the inference speedups their smaller parameter counts sugges…

Argus: Vision-Centric Reasoning with Grounded Chain-of-Thought

2025-05-29 · CVPR 2025 1 · Yunze Man, De-An Huang, Guilin Liu, Shiwei Sheng 외

Recent advances in multimodal large language models (MLLMs) have demonstrated remarkable capabilities in vision-language tasks, yet they often struggle with vision-centric scenarios where precise visual focus is needed f…

Multimodal Reasoning

ARGUS: Stacked Multi-View Identity Mosaic Injection for Subject-Preserving Video Generation

2026-06-10 · Zijie Meng, Jiwen Liu, Yufei Liu, Chengzhuo Tong 외 arxiv

Subject-preserving video generation is not solved by frontal-face similarity alone: a generated person must remain recognizable across motion, large viewpoint changes, expression shifts, occlusion, scale variation, and c…

Video Generation

ARGUS: Accelerated, Robust, General, and Unsupervised Cell Tracking Solutions

2026-07-09 · Noah Jaitner, Kandice Tanner, Ingolf Sack, Hossein S. Aghamiry arxiv

Background and Objective: Quantitative analysis of cell dynamics is central to modern biological research, providing critical insights into immune cell interactions, disease progression, and drug mechanisms. Automated ce…

Cell Detection