Knowledge Distillation with TAs

Published: 20 November 2019
on channel: Connor Shorten
5,672
173

This video presents a paper exploring the effectiveness of introducing intermediate teaching networks (Teacher Assistants) to the knowledge distillation pipeline! Thanks for watching, please subscribe!

Improved Knowledge Distillation via Teacher Assistant:
https://arxiv.org/pdf/1902.03393.pdf
On the Efficacy of Knowledge Distillation:
https://arxiv.org/abs/1910.01348
EfficientNet:
https://arxiv.org/abs/1905.11946
Self-Training with Noisy Student:
https://arxiv.org/abs/1911.04252


Watch video Knowledge Distillation with TAs online without registration, duration hours minute second in high quality. This video was added by user Connor Shorten 20 November 2019, don't forget to share it with your friends and acquaintances, it has been viewed on our site 5,672 once and liked it 173 people.