Collaborative Distillation

2000년 도입 · 논문 9편에서 사용

Collaborative Distillation is a new knowledge distillation method (named Collaborative Distillation) for encoder-decoder based neural style transfer to reduce the number of convolutional filters. The main idea is underpinned by a finding that the encoder-decoder pairs construct an exclusive collaborative relationship, which is regarded as a new kind of knowledge for style transfer models.

출처: Collaborative Distillation for Ultra-Resolution Universal Style Transfer

소개 논문: Collaborative Distillation for Ultra-Resolution Universal Style Transfer