Soups

2000년 도입 · 논문 19편에서 사용

Compress an ensemble of models into a single one by averaging their weights (under certain pre-conditions).

출처: Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time

소개 논문: Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time